justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 244745.183@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID244745.183@justin-prod-sched01.dune.hep.ac.uk
Workflow ID2868
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-08-19 06:55:34
SiteNL_NIKHEF
EntryVIRGO_NL_NIKHEF_dissel_multicore
Last heartbeat2024-08-19 08:14:01
From worker nodeHostnamewn-snel-007.farm.nikhef.nl
cpuinfoAMD EPYC 7H12 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit129600 (36 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-19 07:13:26
Input fileshd-protodune:np04hd_raw_run028762_1648_dataflow7_datawriter_0_20240819T051149.hdf5
JobscriptExit code0
Real time59m (3565s)
CPU time54m (3278s = 91%)
Outputting started2024-08-19 08:12:51
Output fileshd-protodune-det-reco:np04hd_raw_run028762_1648_dataflow7_datawriter_0_20240819T051149_reco_stage1_reco_stage2_20240819T081242_keepup.root
hd-protodune-det-reco:np04hd_raw_run028762_1648_dataflow7_datawriter_0_20240819T051149_reco_stage1_reco_stage2_20240819T081242_keepup_hists.root
Finished2024-08-19 08:14:01
Saved logsjustin-logs:244745.183-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

02688e+06 n=907031 tag=gauss
wclsFrameSaver: saving 65016 traces tagged "wiener"
FrameSaver: q=1.1198e+06 n=827705 tag=wiener
3882 hits in TPC 0
3081 hits in TPC 1
7927 hits in TPC 2
2987 hits in TPC 3
2907 hits in TPC 4
5475 hits in TPC 5
7274 hits in TPC 6
2274 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 174 XUs and 107 XVs -> 6 XUVs
C:0 T:2 39295 XUs and 51621 XVs -> 1481 XUVs
C:0 T:3 456 XUs and 514 XVs -> 11 XUVs
C:0 T:4 64 XUs and 53 XVs -> 3 XUVs
C:0 T:5 24431 XUs and 10911 XVs -> 380 XUVs
C:0 T:6 31235 XUs and 32453 XVs -> 1917 XUVs
C:0 T:7 192 XUs and 187 XVs -> 3 XUVs
3801 XUVs total
1613 collection wire objects
3801 potential space points
Neighbour search...
346717 tests to find 146900 neighbours
Iterating with no regularization...
Begin: 1.55755e+07
0 1.29559e+07
1 1.28437e+07
2 1.28314e+07
Now with regularization...
Begin: 1.17588e+07
0 1.17505e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------

19-Aug-2024 10:12:42 CEST  Closed output file "np04hd_raw_run028762_1648_dataflow7_datawriter_0_20240819T051149_reco_stage1_reco_stage2_20240819T081242_keepup.root"
19-Aug-2024 10:12:42 CEST  Closed input file "np04hd_raw_run028762_1648_dataflow7_datawriter_0_20240819T051149_reco_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              54.1103       81.6551       118.233       78.7694       15.8771        30     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000455103   0.00222993    0.00438283     0.0020391    0.00106956       30     
produce:fembfilter:PDHDFEMBFilter                      0.498593      0.574756      0.817041      0.532245      0.0853232       30     
produce:wclsdatahd:WireCellToolkit                      29.0593       31.7541       36.4956       30.7373       1.98116        30     
produce:gaushit:GausHitFinder                          0.273625      0.561197      0.778765       0.57714      0.126994        30     
produce:nhitsfilter:NumberOfHitsFilter                0.000171622   0.000349603   0.000587922   0.000325666   9.75005e-05      30     
produce:reco3d:SpacePointSolver                        0.0687881     0.786586       2.3903       0.577395      0.596375        30     
produce:hitpdune:DisambigFromSpacePoints               0.0768925     0.406027      0.860147      0.393675      0.182546        30     
produce:pandora:StandardPandora                         3.56524       14.1287       29.7536       11.6622       7.79749        30     
produce:pandoraWriter:StandardPandora                  0.0911787     0.146951      0.211579      0.146597      0.032164        30     
produce:pandoraTrack:LArPandoraTrackCreation           0.290989       1.16773       2.37486       1.15819      0.488424        30     
produce:pandoraShower:LArPandoraShowerCreation         0.352817       1.24239       2.5495        1.11894      0.591829        30     
produce:pandoracalo:Calorimetry                        0.202223      0.573573       1.09638      0.537373      0.220179        30     
produce:pandoracalonosce:Calorimetry                   0.161229      0.521588       1.10311      0.490326      0.219957        30     
produce:pandorapid:Chi2ParticleID                     0.000890299   0.00174497    0.00346677    0.00168731    0.000491262      30     
produce:pandoraShowercalo:ShowerCalorimetry            0.317477       1.07627       2.33726      0.954295      0.499369        30     
produce:pandoraShowercalonosce:ShowerCalorimetry        0.30974       1.04011       2.23882      0.918422      0.485572        30     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0657084     0.115225      0.154564       0.10943      0.0241451       30     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0273489     0.0414207     0.0593199     0.0403951    0.00850888       30     
produce:emtrkmichelid:EmTrackMichelId                   14.6232       25.3992       36.3395       24.4133       5.33048        30     
[art]:TriggerResults:TriggerResultInserter            1.3475e-05    2.67171e-05    8.566e-05    2.3068e-05    1.23952e-05      30     
end_path:out1:RootOutput                               3.436e-06    5.6259e-06    2.3995e-05     4.889e-06    3.50208e-06      30     
end_path:michelremoving:michelremoving                 0.0230819     0.120733      0.500854      0.0421372     0.123792        30     
end_path:michelremovinggnocchi:michelremoving          0.0218687     0.119553      0.501444      0.0406997     0.124507        30     
end_path:calibanagnocchi:CalibAnaTree                  0.199412      0.689543       1.20059      0.673466      0.244063        30     
end_path:out1:RootOutput(write)                        0.426823       1.0472        1.34114       1.03682      0.184036        30     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4941.89 MB
  Peak resident set size usage (VmHWM): 2621.06 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028762_1648_dataflow7_datawriter_0_20240819T051149_reco_stage1_reco_stage2_20240819T081242_keepup.root
\tHists: np04hd_raw_run028762_1648_dataflow7_datawriter_0_20240819T051149_reco_stage1_reco_stage2_20240819T081242_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028762_1648_dataflow7_datawriter_0_20240819T051149_reco_stage1_reco_stage2_20240819T081242_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run028762_1648_dataflow7_datawriter_0_20240819T051149_reco_stage1_reco_stage2_20240819T081242_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724052679.0,
    "core.end_time": 1724055163.0,
    "core.events": [
      395519,
      395527,
      395535,
      395551,
      395559,
      395567,
      395575,
      395583,
      395591,
      395599,
      395607,
      395615,
      395623,
      395631,
      395639,
      395647,
      395655,
      395663,
      395671,
      395679,
      395687,
      395695,
      395703,
      395711,
      395719,
      395727,
      395735,
      395743,
      395751,
      395767
    ],
    "core.event_count": 30,
    "core.first_event_number": 395519,
    "core.last_event_number": 395767,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1648_dataflow7_datawriter_0_20240819T051149.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run028762_1648_dataflow7_datawriter_0_20240819T051149_reco_stage1_reco_stage2_20240819T081242_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1724052679.0,
    "core.end_time": 1724055163.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      28762
    ],
    "core.runs_subruns": [
      2876200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run028762_1648_dataflow7_datawriter_0_20240819T051149.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:28:55 UTC       justIN version: 01.01.08