justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 59645.127@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID59645.127@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2867
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 07:57:56
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_brug_multicore
Last heartbeat2024-08-19 09:01:39
From worker nodeHostnamewn-snel-002.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 07:58:52
Input fileshd-protodune:np04hd_raw_run028762_1495_dataflow1_datawriter_0_20240819T031459.hdf5
JobscriptExit code0
Real time1h (3692s)
CPU time56m (3381s = 91%)
Outputting started2024-08-19 09:00:25
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1495_dataflow1_datawriter_0_20240819T031459_reco_stage1_reco_stage2_20240819T090015_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1495_dataflow1_datawriter_0_20240819T031459_reco_stage1_reco_stage2_20240819T090015_keepup_hists.root
Finished2024-08-19 09:01:39
Saved logsjustin-logs:59645.127-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

aving 77681 traces tagged "gauss"
FrameSaver: q=1.69998e+06 n=1360841 tag=gauss
wclsFrameSaver: saving 105620 traces tagged "wiener"
FrameSaver: q=1.87693e+06 n=1224443 tag=wiener
4832 hits in TPC 0
4320 hits in TPC 1
11152 hits in TPC 2
6478 hits in TPC 3
3616 hits in TPC 4
5884 hits in TPC 5
10422 hits in TPC 6
7443 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1438 XUs and 781 XVs -> 54 XUVs
C:0 T:2 121191 XUs and 76192 XVs -> 3006 XUVs
C:0 T:3 73 XUs and 103 XVs -> 1 XUVs
C:0 T:4 102 XUs and 106 XVs -> 3 XUVs
C:0 T:5 26334 XUs and 31471 XVs -> 1085 XUVs
C:0 T:6 158320 XUs and 145121 XVs -> 14976 XUVs
C:0 T:7 89 XUs and 169 XVs -> 2 XUVs
19127 XUVs total
2874 collection wire objects
19127 potential space points
Neighbour search...
3182359 tests to find 1370014 neighbours
Iterating with no regularization...
Begin: 2.41282e+07
0 2.03861e+07
1 2.02138e+07
2 2.0187e+07
3 2.01781e+07
Now with regularization...
Begin: 1.89275e+07
0 1.89198e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

19-Aug-2024 11:00:15 CEST  Closed output file "np04hd_raw_run028762_1495_dataflow1_datawriter_0_20240819T031459_reco_stage1_reco_stage2_20240819T090015_keepup.root"
19-Aug-2024 11:00:15 CEST  Closed input file "np04hd_raw_run028762_1495_dataflow1_datawriter_0_20240819T031459_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              50.042        86.184        143.516       87.6896       20.6592        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00034043    0.00186419    0.00369002    0.00165445    0.000977529      30     
produce:fembfilter:PDHDFEMBFilter                      0.500477      0.618547      0.955247      0.539812      0.145512        30     
produce:wclsdatahd:WireCellToolkit                      28.5456       30.3767       32.4979       30.387       0.982572        30     
produce:gaushit:GausHitFinder                          0.257684      0.612144      0.966921      0.611719      0.161928        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000187863   0.000377068   0.000631066   0.000366008   0.000112301      30     
produce:reco3d:SpacePointSolver                        0.136588       1.11319       5.05614       0.8588        1.10161        30     
produce:hitpdune:DisambigFromSpacePoints               0.0980589     0.501379       1.52757      0.453814      0.291247        30     
produce:pandora:StandardPandora                         4.33727       17.2835       47.2067       15.902        10.1967        30     
produce:pandoraWriter:StandardPandora                  0.0668059     0.156302      0.260765      0.163929      0.0441494       30     
produce:pandoraTrack:LArPandoraTrackCreation           0.314112       1.28476       2.54498       1.1429        0.55956        30     
produce:pandoraShower:LArPandoraShowerCreation         0.244897       1.43881       3.54398       1.31175      0.823411        30     
produce:pandoracalo:Calorimetry                        0.173625      0.621317       1.71489      0.547113       0.29996        30     
produce:pandoracalonosce:Calorimetry                   0.151743      0.553036       1.10634      0.501645      0.230317        30     
produce:pandorapid:Chi2ParticleID                     0.00103694     0.0018221    0.00286873    0.00178198    0.000399955      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.191668       1.21655       3.10649       1.12524      0.696021        30     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.192643       1.1774        3.04587       1.08485      0.665275        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0615485     0.120463      0.190382      0.121565      0.0294441       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.022485      0.0436722     0.0637307     0.0429788    0.00979086       30     
produce:emtrkmichelid:EmTrackMichelId                   13.7122       26.956        42.628        26.5178       6.34378        30     
[art]:TriggerResults:TriggerResultInserter             1.596e-05    2.48483e-05   0.000102372   2.14855e-05   1.47676e-05      30     
end_path:out1:RootOutput                               3.336e-06    5.26487e-06   2.7411e-05     4.413e-06    4.15096e-06      30     
end_path:michelremoving:michelremoving                 0.0153565     0.0814228     0.313383      0.0392998     0.0809551       30     
end_path:michelremovinggnocchi:michelremoving          0.0149353     0.0803215     0.316704      0.038619      0.081528        30     
end_path:calibanagnocchi:CalibAnaTree                  0.169818      0.697112       1.43515      0.664955      0.310156        30     
end_path:out1:RootOutput(write)                        0.587964       1.11711       1.75681       1.15456      0.245824        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4968.46 MB
  Peak resident set size usage (VmHWM): 2646.95 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1495_dataflow1_datawriter_0_20240819T031459_reco_stage1_reco_stage2_20240819T090015_keepup.root
\tHists: np04hd_raw_run028762_1495_dataflow1_datawriter_0_20240819T031459_reco_stage1_reco_stage2_20240819T090015_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1495_dataflow1_datawriter_0_20240819T031459_reco_stage1_reco_stage2_20240819T090015_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1495_dataflow1_datawriter_0_20240819T031459_reco_stage1_reco_stage2_20240819T090015_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724055397.0,
    "core.end_time": 1724058016.0,
    "core.events": [
      358793,
      358801,
      358809,
      358817,
      358825,
      358833,
      358841,
      358849,
      358865,
      358873,
      358881,
      358889,
      358897,
      358905,
      358913,
      358921,
      358929,
      358937,
      358945,
      358953,
      358961,
      358969,
      358977,
      358985,
      358993,
      359001,
      359009,
      359017,
      359025,
      359033
    ],
    "core.event_count": 30,
    "core.first_event_number": 358793,
    "core.last_event_number": 359033,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1495_dataflow1_datawriter_0_20240819T031459.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1495_dataflow1_datawriter_0_20240819T031459_reco_stage1_reco_stage2_20240819T090015_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724055397.0,
    "core.end_time": 1724058016.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1495_dataflow1_datawriter_0_20240819T031459.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:27:02 UTC       justIN version: 01.01.08