justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 59508.22@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID59508.22@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 00:47:47
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_brug_multicore
Last heartbeat2024-08-19 01:53:10
From worker nodeHostnamewn-snel-009.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 00:50:23
Input fileshd-protodune:np04hd_raw_run028762_1082_dataflow1_datawriter_0_20240818T225837.hdf5
JobscriptExit code0
Real time1h (3681s)
CPU time56m (3373s = 91%)
Outputting started2024-08-19 01:51:53
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1082_dataflow1_datawriter_0_20240818T225837_reco_stage1_reco_stage2_20240819T015135_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1082_dataflow1_datawriter_0_20240818T225837_reco_stage1_reco_stage2_20240819T015135_keepup_hists.root
Finished2024-08-19 01:53:10
Saved logsjustin-logs:59508.22-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

er"
FrameSaver: q=1.40768e+06 n=983645 tag=wiener
9498 hits in TPC 0
3409 hits in TPC 1
6344 hits in TPC 2
4244 hits in TPC 3
4064 hits in TPC 4
6894 hits in TPC 5
4468 hits in TPC 6
2548 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 2381 XUs and 3370 XVs -> 222 XUVs
C:0 T:2 18806 XUs and 33344 XVs -> 926 XUVs
C:0 T:3 353 XUs and 231 XVs -> 1 XUVs
C:0 T:4 54 XUs and 51 XVs -> 4 XUVs
C:0 T:5 30466 XUs and 23138 XVs -> 632 XUVs
C:0 T:6 12056 XUs and 23463 XVs -> 360 XUVs
C:0 T:7 18 XUs and 22 XVs -> 1 XUVs
2146 XUVs total
1383 collection wire objects
2146 potential space points
Neighbour search...
36620 tests to find 21052 neighbours
Iterating with no regularization...
Begin: 8.38415e+06
0 7.79531e+06
1 7.76016e+06
2 7.75915e+06
Now with regularization...
Begin: 7.37558e+06
0 7.37532e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

19-Aug-2024 03:51:35 CEST  Closed output file "np04hd_raw_run028762_1082_dataflow1_datawriter_0_20240818T225837_reco_stage1_reco_stage2_20240819T015135_keepup.root"
19-Aug-2024 03:51:35 CEST  Closed input file "np04hd_raw_run028762_1082_dataflow1_datawriter_0_20240818T225837_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              62.2193       84.5591       114.146       83.538        12.129         30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000353171   0.00169619    0.00390043    0.00154119    0.000915581      30     
produce:fembfilter:PDHDFEMBFilter                      0.492922      0.557239      0.776536      0.530391      0.0648782       30     
produce:wclsdatahd:WireCellToolkit                      28.8981       30.6526       32.195        30.9189      0.942072        30     
produce:gaushit:GausHitFinder                          0.468673      0.612346      0.826003      0.590278      0.0935247       30     
produce:nhitsfilter:NumberOfHitsFilter                0.000258414   0.000337156   0.000485629   0.00032843    5.30558e-05      30     
produce:reco3d:SpacePointSolver                        0.237527      0.841157       2.20303      0.788564      0.447121        30     
produce:hitpdune:DisambigFromSpacePoints               0.244119      0.480537      0.965046      0.441088       0.15202        30     
produce:pandora:StandardPandora                         6.92297       17.3346       42.0442       16.4781       7.77823        30     
produce:pandoraWriter:StandardPandora                  0.0931901      0.15435      0.206169      0.153477      0.0268652       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.556855       1.21299       2.85707       1.14953      0.471626        30     
produce:pandoraShower:LArPandoraShowerCreation         0.653931       1.32448       2.75321       1.23357      0.488766        30     
produce:pandoracalo:Calorimetry                        0.315575      0.575578       1.25533      0.567182      0.179746        30     
produce:pandoracalonosce:Calorimetry                   0.266591      0.525952       1.13069      0.515735       0.16343        30     
produce:pandorapid:Chi2ParticleID                     0.00118998    0.00170648    0.00315729    0.00161288    0.000380734      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.628483       1.15962       2.52378       1.08744      0.431784        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.606492       1.12214       2.42228       1.04459      0.415068        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0862949     0.124274      0.168396      0.123132      0.0205241       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0303693     0.0437315     0.0597484     0.043202     0.00730047       30     
produce:emtrkmichelid:EmTrackMichelId                   18.6023       25.5959       33.4963       25.6252       3.76832        30     
[art]:TriggerResults:TriggerResultInserter            1.8034e-05    2.54169e-05   9.2523e-05    2.16805e-05   1.31491e-05      30     
end_path:out1:RootOutput                               4.048e-06    5.29037e-06   2.4365e-05     4.534e-06    3.55978e-06      30     
end_path:michelremoving:michelremoving                 0.0233304     0.120523      0.464278      0.0413382     0.136831        30     
end_path:michelremovinggnocchi:michelremoving          0.0225081     0.118727      0.458718      0.0402316     0.135419        30     
end_path:calibanagnocchi:CalibAnaTree                  0.301287      0.720302       1.4568        0.70973      0.226125        30     
end_path:out1:RootOutput(write)                        0.864803       1.15724       1.38136       1.15946      0.142251        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4957.72 MB
  Peak resident set size usage (VmHWM): 2640.01 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1082_dataflow1_datawriter_0_20240818T225837_reco_stage1_reco_stage2_20240819T015135_keepup.root
\tHists: np04hd_raw_run028762_1082_dataflow1_datawriter_0_20240818T225837_reco_stage1_reco_stage2_20240819T015135_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1082_dataflow1_datawriter_0_20240818T225837_reco_stage1_reco_stage2_20240819T015135_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1082_dataflow1_datawriter_0_20240818T225837_reco_stage1_reco_stage2_20240819T015135_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724029723.0,
    "core.end_time": 1724032296.0,
    "core.events": [
      259681,
      259689,
      259697,
      259705,
      259713,
      259721,
      259729,
      259737,
      259745,
      259753,
      259761,
      259769,
      259777,
      259785,
      259793,
      259801,
      259809,
      259817,
      259825,
      259833,
      259841,
      259849,
      259857,
      259865,
      259873,
      259881,
      259889,
      259929,
      259937,
      259945
    ],
    "core.event_count": 30,
    "core.first_event_number": 259681,
    "core.last_event_number": 259945,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1082_dataflow1_datawriter_0_20240818T225837.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1082_dataflow1_datawriter_0_20240818T225837_reco_stage1_reco_stage2_20240819T015135_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724029723.0,
    "core.end_time": 1724032296.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1082_dataflow1_datawriter_0_20240818T225837.hdf5"
    }
  ]
}
justIN time: 2024-11-17 06:09:25 UTC       justIN version: 01.01.09