justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 59567.63@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID59567.63@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 03:55:17
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_juk_multicore
Last heartbeat2024-08-19 05:00:16
From worker nodeHostnamewn-snel-009.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 03:56:42
Input fileshd-protodune:np04hd_raw_run028762_1271_dataflow6_datawriter_0_20240819T005558.hdf5
JobscriptExit code0
Real time1h (3720s)
CPU time56m (3383s = 90%)
Outputting started2024-08-19 04:58:53
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1271_dataflow6_datawriter_0_20240819T005558_reco_stage1_reco_stage2_20240819T045835_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1271_dataflow6_datawriter_0_20240819T005558_reco_stage1_reco_stage2_20240819T045835_keepup_hists.root
Finished2024-08-19 05:00:16
Saved logsjustin-logs:59567.63-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

hits in TPC 2
4325 hits in TPC 3
4756 hits in TPC 4
8829 hits in TPC 5
3426 hits in TPC 6
2223 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 11169 XUs and 6674 XVs -> 847 XUVs
C:0 T:2 12127 XUs and 11996 XVs -> 486 XUVs
C:0 T:3 759 XUs and 651 XVs -> 30 XUVs
C:0 T:4 390 XUs and 363 XVs -> 10 XUVs
C:0 T:5 48381 XUs and 29129 XVs -> 1156 XUVs
C:0 T:6 7082 XUs and 10349 XVs -> 431 XUVs
C:0 T:7 202 XUs and 407 XVs -> 13 XUVs
2973 XUVs total
1169 collection wire objects
2973 potential space points
Neighbour search...
94435 tests to find 53666 neighbours
Iterating with no regularization...
Begin: 1.27456e+07
0 1.22353e+07
1 1.21884e+07
2 1.21848e+07
Now with regularization...
Begin: 1.17648e+07
0 1.17635e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

no of hits closeby  0   event 305278 TrkackID 21 startx, y, z 50.8925 593.157 168.105  wireno, peakt tpcno 315 985.177 2 dist 129.444min T, max_T6.17298 1008.46
no of hits closeby  0   event 305278 TrkackID 21 startx, y, z 50.8925 593.157 168.105  wireno, peakt tpcno 315 985.177 2 dist 129.444min T, max_T6.17298 1008.46
19-Aug-2024 06:58:35 CEST  Closed output file "np04hd_raw_run028762_1271_dataflow6_datawriter_0_20240819T005558_reco_stage1_reco_stage2_20240819T045835_keepup.root"
19-Aug-2024 06:58:35 CEST  Closed input file "np04hd_raw_run028762_1271_dataflow6_datawriter_0_20240819T005558_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              50.9169       83.4495       120.673       82.1924       16.1507        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000385492   0.00201024    0.00323523    0.00198407    0.000777268      30     
produce:fembfilter:PDHDFEMBFilter                      0.493264      0.577475       0.88169      0.539635      0.0897521       30     
produce:wclsdatahd:WireCellToolkit                      27.5411       29.4401       31.8276       29.4989       1.15503        30     
produce:gaushit:GausHitFinder                           0.35021      0.600748      0.912523      0.600402      0.125825        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000208009   0.000354791   0.000613788   0.000341419   8.29236e-05      30     
produce:reco3d:SpacePointSolver                        0.230691      0.971752       2.03419      0.952905      0.496493        30     
produce:hitpdune:DisambigFromSpacePoints               0.174805      0.488722      0.992689       0.44332      0.189823        30     
produce:pandora:StandardPandora                         4.34228       17.5489       34.003        18.1881        7.935         30     
produce:pandoraWriter:StandardPandora                  0.0772989     0.148969      0.217111      0.147613      0.0327635       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.365592       1.26143       2.85488       1.13496      0.542591        30     
produce:pandoraShower:LArPandoraShowerCreation         0.344598       1.28919       3.22197       1.10124      0.707511        30     
produce:pandoracalo:Calorimetry                        0.213525      0.600433       1.31264      0.528034      0.238774        30     
produce:pandoracalonosce:Calorimetry                   0.187827      0.556175       1.27796      0.490757      0.242553        30     
produce:pandorapid:Chi2ParticleID                     0.000954406   0.00173032    0.00311374    0.00167251    0.000423785      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.281947       1.14429       3.82546      0.956381      0.717517        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.276594       1.10405       3.85009      0.898343      0.701633        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0803104      0.11859      0.171133      0.120739      0.021498        30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0287475     0.0425431     0.0685991     0.0414084    0.00833039       30     
produce:emtrkmichelid:EmTrackMichelId                   14.4342       25.356        37.8374       24.8499       5.27811        30     
[art]:TriggerResults:TriggerResultInserter            1.4337e-05    2.5858e-05    7.8076e-05    2.23765e-05   1.12048e-05      30     
end_path:out1:RootOutput                               4.218e-06    5.43087e-06   2.2221e-05     4.794e-06    3.1438e-06       30     
end_path:michelremoving:michelremoving                 0.022546      0.110013      0.606336      0.037413      0.143623        30     
end_path:michelremovinggnocchi:michelremoving          0.0220466     0.108387      0.603499      0.0365306     0.143689        30     
end_path:calibanagnocchi:CalibAnaTree                  0.228622      0.737886       1.59272      0.698438      0.259412        30     
end_path:out1:RootOutput(write)                         0.80885       1.11434       1.37528       1.12038      0.153594        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4954.75 MB
  Peak resident set size usage (VmHWM): 2636.13 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1271_dataflow6_datawriter_0_20240819T005558_reco_stage1_reco_stage2_20240819T045835_keepup.root
\tHists: np04hd_raw_run028762_1271_dataflow6_datawriter_0_20240819T005558_reco_stage1_reco_stage2_20240819T045835_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1271_dataflow6_datawriter_0_20240819T005558_reco_stage1_reco_stage2_20240819T045835_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1271_dataflow6_datawriter_0_20240819T005558_reco_stage1_reco_stage2_20240819T045835_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724040978.0,
    "core.end_time": 1724043516.0,
    "core.events": [
      305030,
      305038,
      305046,
      305054,
      305062,
      305086,
      305094,
      305102,
      305110,
      305118,
      305126,
      305134,
      305142,
      305150,
      305158,
      305166,
      305174,
      305182,
      305190,
      305198,
      305206,
      305214,
      305222,
      305230,
      305238,
      305246,
      305254,
      305262,
      305270,
      305278
    ],
    "core.event_count": 30,
    "core.first_event_number": 305030,
    "core.last_event_number": 305278,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1271_dataflow6_datawriter_0_20240819T005558.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1271_dataflow6_datawriter_0_20240819T005558_reco_stage1_reco_stage2_20240819T045835_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724040978.0,
    "core.end_time": 1724043516.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1271_dataflow6_datawriter_0_20240819T005558.hdf5"
    }
  ]
}
justIN time: 2024-11-17 05:12:23 UTC       justIN version: 01.01.09