21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 420720.97@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 420720.97@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 7875 | |
| Stage ID | 1 | |
| User name | higuera@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-06-24 10:33:53 | |
| Site | UK_Manchester | |
| Entry | UBoone_T2_UK_Manchester_ce02 | |
| Last heartbeat | 2025-06-24 21:24:41 | |
| From worker node | Hostname | wn1205251.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7702P 64-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 257400 (71 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-06-24 10:46:54 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74496296_410_20231201T212730Z_gen_g4_detsim_hitreco.root | |
| Jobscript | Exit code | 0 |
| Real time | 13m (813s) | |
| CPU time | 9m (546s = 67%) | |
| Max RSS bytes | 1971793920 (1880 MiB) | |
| Outputting started | 2025-06-24 11:00:28 | |
| Output files | usertests:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74496296_410_20231201T212730Z_gen_g4_detsim_hitreco_reco2.root | |
| Finished | 2025-06-24 21:24:41 | |
| Saved logs | justin-logs:420720.97-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
ry WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory Justin processors: 1 /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/cdba6e7604dd8b049ed4282aee20b939a4b77fad/atmo_reco2_lbl_model.fcl Input PFN = root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ab/0b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74496296_410_20231201T212730Z_gen_g4_detsim_hitreco.root /cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so === Start last 100 lines of lar log file === %MSG 677 ***Wiener Filter*******ApplyPostfilter*** Running Ophitfinder with InputDigiType = 'recob' Found hits: 2523! Begin processing the 98th record. run: 74496296 subRun: 1 event: 41098 at 24-Jun-2025 12:00:02 BST %MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShower@BeginModule 24-Jun-2025 12:00:08 BST run: 74496296 subRun: 1 event: 41098 Trying to add data product: InitialTrack. This element does not exist in the element holder %MSG Boundary wire vector sizes: 2545, 2814, 1613 minwire 0: 619 minwire 1: 562 minwire 2: 578 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.00176282, 0.994499, 0.00373789, Output 1: 0.898417, 0.0978574, 0.00345123, 0.000274258, Output 2: 0.0425115, 0.901196, 0.0544584, 0.00183373, 830 ***Wiener Filter*******ApplyPostfilter*** Running Ophitfinder with InputDigiType = 'recob' Found hits: 3188! Begin processing the 99th record. run: 74496296 subRun: 1 event: 41099 at 24-Jun-2025 12:00:15 BST %MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShower@BeginModule 24-Jun-2025 12:00:18 BST run: 74496296 subRun: 1 event: 41099 Trying to add data product: InitialTrack. This element does not exist in the element holder %MSG Boundary wire vector sizes: 196, 113, 139 minwire 0: 1608 minwire 1: 1647 minwire 2: 1379 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.000252227, 0.998804, 0.00094415, Output 1: 0.0130731, 0.982662, 0.00410694, 0.0001581, Output 2: 0.99872, 0.00124384, 3.53915e-05, 1.11713e-06, %MSG-e DUNEAna: EnergyReco:energyrecnumumcs@BeginModule 24-Jun-2025 12:00:18 BST run: 74496296 subRun: 1 event: 41099 Failed to find product with label wclsmcnfsp:gauss ... returning empty vector %MSG 593 ***Wiener Filter*******ApplyPostfilter*** Running Ophitfinder with InputDigiType = 'recob' Found hits: 1997! Begin processing the 100th record. run: 74496296 subRun: 1 event: 41100 at 24-Jun-2025 12:00:23 BST %MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShower@BeginModule 24-Jun-2025 12:00:25 BST run: 74496296 subRun: 1 event: 41100 Trying to add data product: InitialTrack. This element does not exist in the element holder %MSG %MSG-e DUNEAna: EnergyReco:energyrecnumumcs@BeginModule 24-Jun-2025 12:00:25 BST run: 74496296 subRun: 1 event: 41100 Failed to find product with label wclsmcnfsp:gauss ... returning empty vector %MSG 299 ***Wiener Filter*******ApplyPostfilter*** Running Ophitfinder with InputDigiType = 'recob' Found hits: 729! 24-Jun-2025 12:00:27 BST Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74496296_410_20231201T212730Z_gen_g4_detsim_hitreco_reco2.root" 24-Jun-2025 12:00:27 BST Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/ab/0b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74496296_410_20231201T212730Z_gen_g4_detsim_hitreco.root" ======================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ======================================================================================================================================== Full event 0.902429 5.50878 25.6166 4.9331 3.12719 100 ---------------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.0224469 0.0370938 0.400321 0.0278974 0.0393909 100 reco:pandora:StandardPandora 0.164267 1.93695 13.2034 1.51159 1.65129 100 reco:pandoraTrack:LArPandoraTrackCreation 0.000108565 0.00527829 0.109902 0.00119568 0.0139325 100 reco:pandoraShower:LArPandoraModularShowerCreation 0.000161946 0.0105398 0.109041 0.00256936 0.0199135 100 reco:pandoracalo:Calorimetry 9.0751e-05 0.0126091 0.459803 0.000876964 0.049714 100 reco:pandorapid:Chi2ParticleID 3.4505e-05 0.000137721 0.000632323 0.000108925 0.000104185 100 reco:cvnmap:CVNMapper 2.1401e-05 0.00807867 0.029431 0.00927266 0.00539266 100 reco:cvneva:CVNEvaluator 1.5339e-05 0.357674 2.08899 0.388091 0.276001 100 reco:energyrecnumu:EnergyReco 0.0670676 0.171827 2.00246 0.121279 0.24105 100 reco:energyrecnue:EnergyReco 0.000157768 0.0119163 0.0830268 0.000850445 0.0242368 100 reco:energyrecnc:EnergyReco 0.00223984 0.111182 0.298433 0.131399 0.0627808 100 reco:energyrecnumurange:EnergyReco 0.000151887 0.0496754 1.59547 0.00135012 0.194441 100 reco:energyrecnumumcs:EnergyReco 0.000113374 0.046189 1.25896 0.00131435 0.168536 100 reco:opdec:Deconvolution 0.0910127 0.291203 0.583914 0.296798 0.0871023 100 reco:ophitspe:OpHitFinderDeco 0.370463 2.19451 4.99794 2.1882 0.898958 100 reco:opflash:OpFlashFinder 0.00027553 0.00131016 0.00465069 0.00126234 0.000635489 100 reco:rns:RandomNumberSaver 1.7743e-05 2.35603e-05 0.000322498 1.92865e-05 3.01498e-05 100 reco:anglereconue:NuAngularReco 0.000131659 0.00116023 0.0232584 0.000294546 0.00332095 100 reco:anglereconumu:NuAngularReco 6.8329e-05 0.00105686 0.0231631 0.000197022 0.00332185 100 reco:anglereconuepfps:NuAngularReco 0.000107172 0.00116682 0.0228166 0.000297215 0.00327991 100 reco:anglereconumupfps:NuAngularReco 9.534e-05 0.00111031 0.0229028 0.000254835 0.00328901 100 [art]:TriggerResults:TriggerResultInserter 9.117e-06 1.20796e-05 4.9534e-05 1.07605e-05 4.61692e-06 100 end_path:out1:RootOutput 2.775e-06 3.7586e-06 2.9676e-05 3.306e-06 2.94696e-06 100 end_path:out1:RootOutput(write) 0.0135316 0.257026 0.560413 0.293715 0.133139 100 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 3648.81 MB Peak resident set size usage (VmHWM): 1971.79 MB ==================================================================================================== Art has completed and will exit with status 0. === End last 100 lines of lar log file === lar exit code 0