21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 228451.100@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 228451.100@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 7875 | |
| Stage ID | 1 | |
| User name | higuera@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-06-24 11:32:01 | |
| Site | UK_Oxford | |
| Entry | DUNE_UK_SGrid_Oxford_arc01 | |
| Last heartbeat | 2025-06-24 14:12:59 | |
| From worker node | Hostname | t2wn062.physics.ox.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 257400 (71 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | outputting_failed | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-06-24 12:06:32 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_438_20231202T180612Z_gen_g4_detsim_hitreco.root | |
| Jobscript | Exit code | 0 |
| Real time | 17m (1052s) | |
| CPU time | 13m (818s = 77%) | |
| Max RSS bytes | 1852182528 (1766 MiB) | |
| Outputting started | 2025-06-24 12:24:04 | |
| Output files | ||
| Finished | 2025-06-24 14:12:59 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory Justin processors: 1 /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/cdba6e7604dd8b049ed4282aee20b939a4b77fad/atmo_reco2_lbl_model.fcl Input PFN = root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/5e/63/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_438_20231202T180612Z_gen_g4_detsim_hitreco.root /cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so === Start last 100 lines of lar log file === Boundary wire vector sizes: 126, 91, 110 minwire 0: 1002 minwire 1: 1754 minwire 2: 679 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.843977, 0.00132231, 0.154701, Output 1: 0.927577, 0.071299, 0.00104572, 7.80343e-05, Output 2: 0.78362, 0.211221, 0.00497232, 0.000185954, %MSG-e DUNEAna: EnergyReco:energyrecnumumcs@BeginModule 24-Jun-2025 13:23:44 BST run: 74506302 subRun: 1 event: 43898 Failed to find product with label wclsmcnfsp:gauss ... returning empty vector %MSG 533 ***Wiener Filter*******ApplyPostfilter*** Running Ophitfinder with InputDigiType = 'recob' Found hits: 1778! Begin processing the 99th record. run: 74506302 subRun: 1 event: 43899 at 24-Jun-2025 13:23:50 BST %MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShower@BeginModule 24-Jun-2025 13:23:52 BST run: 74506302 subRun: 1 event: 43899 Trying to add data product: InitialTrack. This element does not exist in the element holder %MSG %MSG-e DUNEAna: EnergyReco:energyrecnumurange@BeginModule 24-Jun-2025 13:23:52 BST run: 74506302 subRun: 1 event: 43899 Failed to find product with label wclsmcnfsp:gauss ... returning empty vector %MSG %MSG-e DUNEAna: EnergyReco:energyrecnumumcs@BeginModule 24-Jun-2025 13:23:52 BST run: 74506302 subRun: 1 event: 43899 Failed to find product with label wclsmcnfsp:gauss ... returning empty vector %MSG 232 ***Wiener Filter*******ApplyPostfilter*** Running Ophitfinder with InputDigiType = 'recob' Found hits: 599! Begin processing the 100th record. run: 74506302 subRun: 1 event: 43900 at 24-Jun-2025 13:23:53 BST %MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShower@BeginModule 24-Jun-2025 13:23:55 BST run: 74506302 subRun: 1 event: 43900 Trying to add data product: InitialTrack. This element does not exist in the element holder %MSG Boundary wire vector sizes: 38, 37, 37 minwire 0: 1616 minwire 1: 1383 minwire 2: 1463 Used alternate method to get min and max wires due to vertex determination failure: 72, 371 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max wires due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max wires due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.0421216, 0.00342771, 0.954451, Output 1: 0.178784, 0.633242, 0.181885, 0.00608915, Output 2: 0.988017, 0.0114523, 0.000513356, 1.76322e-05, %MSG-e DUNEAna: EnergyReco:energyrecnumumcs@BeginModule 24-Jun-2025 13:23:56 BST run: 74506302 subRun: 1 event: 43900 Failed to find product with label wclsmcnfsp:gauss ... returning empty vector %MSG 540 ***Wiener Filter*******ApplyPostfilter*** Running Ophitfinder with InputDigiType = 'recob' Found hits: 1728! 24-Jun-2025 13:24:02 BST Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_438_20231202T180612Z_gen_g4_detsim_hitreco_reco2.root" 24-Jun-2025 13:24:02 BST Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/5e/63/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74506302_438_20231202T180612Z_gen_g4_detsim_hitreco.root" ======================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ======================================================================================================================================== Full event 1.95083 7.9154 105.842 6.27032 11.1023 100 ---------------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.0191538 0.0263897 0.124364 0.0209657 0.0132452 100 reco:pandora:StandardPandora 1.2809 3.28055 94.0804 1.72208 9.97227 100 reco:pandoraTrack:LArPandoraTrackCreation 0.00016566 0.00768283 0.27267 0.00183465 0.0285432 100 reco:pandoraShower:LArPandoraModularShowerCreation 0.000199062 0.018069 0.431357 0.00420315 0.0484205 100 reco:pandoracalo:Calorimetry 0.00013387 0.0223665 0.745959 0.00142723 0.0971379 100 reco:pandorapid:Chi2ParticleID 4.1798e-05 0.000240495 0.00197476 0.000201051 0.000236876 100 reco:cvnmap:CVNMapper 3.4565e-05 0.015417 0.0651355 0.0155412 0.0126406 100 reco:cvneva:CVNEvaluator 2.4455e-05 0.397455 2.93557 0.477597 0.350232 100 reco:energyrecnumu:EnergyReco 0.0562421 0.136375 0.800982 0.102264 0.126095 100 reco:energyrecnue:EnergyReco 0.000298999 0.0121757 0.0939337 0.00142143 0.0227621 100 reco:energyrecnc:EnergyReco 0.00196311 0.0958749 0.259125 0.108743 0.0530282 100 reco:energyrecnumurange:EnergyReco 0.000218068 0.0356366 0.591828 0.00187899 0.0961499 100 reco:energyrecnumumcs:EnergyReco 0.000145262 0.0357824 0.611099 0.00195365 0.0979436 100 reco:opdec:Deconvolution 0.0677173 0.266942 0.505055 0.270445 0.0873423 100 reco:ophitspe:OpHitFinderDeco 0.317111 3.24789 7.12928 3.17185 1.44617 100 reco:opflash:OpFlashFinder 0.000363871 0.00194518 0.00727135 0.00183997 0.000906527 100 reco:rns:RandomNumberSaver 2.5508e-05 7.69185e-05 0.000505726 7.31065e-05 4.65583e-05 100 reco:anglereconue:NuAngularReco 0.000153157 0.0019469 0.0708975 0.000531034 0.00743167 100 reco:anglereconumu:NuAngularReco 7.3678e-05 0.00162167 0.0686829 0.000316332 0.00717453 100 reco:anglereconuepfps:NuAngularReco 0.000141184 0.00181983 0.0685976 0.000500837 0.00714103 100 reco:anglereconumupfps:NuAngularReco 9.8525e-05 0.00167999 0.0684871 0.000365629 0.00715538 100 [art]:TriggerResults:TriggerResultInserter 1.1151e-05 1.94547e-05 8.9137e-05 1.82135e-05 8.83869e-06 100 end_path:out1:RootOutput 3.927e-06 1.28789e-05 4.4002e-05 1.2418e-05 5.54532e-06 100 end_path:out1:RootOutput(write) 0.0108693 0.30565 0.750941 0.356811 0.176793 100 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 3579.21 MB Peak resident set size usage (VmHWM): 1852.18 MB ==================================================================================================== Art has completed and will exit with status 0. === End last 100 lines of lar log file === lar exit code 0