21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 420811.139@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 420811.139@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 7875 | |
| Stage ID | 1 | |
| User name | higuera@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-06-24 11:44:41 | |
| Site | UK_Oxford | |
| Entry | DUNE_UK_SGrid_Oxford_arc01 | |
| Last heartbeat | 2025-06-24 14:16:18 | |
| From worker node | Hostname | t2wn006.physics.ox.ac.uk |
| cpuinfo | AMD EPYC 7713P 64-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 257400 (71 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | outputting_failed | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-06-24 11:57:08 | |
| Input files | fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50571149_542_20231202T190906Z_gen_g4_detsim_hitreco.root | |
| Jobscript | Exit code | 0 |
| Real time | 24m (1468s) | |
| CPU time | 19m (1196s = 81%) | |
| Max RSS bytes | 1954271232 (1863 MiB) | |
| Outputting started | 2025-06-24 12:21:37 | |
| Output files | ||
| Finished | 2025-06-24 14:16:18 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory WARNING: '/_reco/localProducts_larsoft_v09_89_01_e26_prof/' is not a directory Justin processors: 1 /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/cdba6e7604dd8b049ed4282aee20b939a4b77fad/atmo_reco2_lbl_model.fcl Input PFN = root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/cb/8b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50571149_542_20231202T190906Z_gen_g4_detsim_hitreco.root /cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so === Start last 100 lines of lar log file === %MSG-e DUNEAna: EnergyReco:energyrecnumumcs@BeginModule 24-Jun-2025 13:21:16 BST run: 50571149 subRun: 1 event: 54297 Failed to find product with label wclsmcnfsp:gauss ... returning empty vector %MSG 540 ***Wiener Filter*******ApplyPostfilter*** Running Ophitfinder with InputDigiType = 'recob' Found hits: 1802! Begin processing the 98th record. run: 50571149 subRun: 1 event: 54298 at 24-Jun-2025 13:21:21 BST Boundary wire vector sizes: 80, 70, 66 minwire 0: 525 minwire 1: 1819 minwire 2: 413 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.26565, 0.0856067, 0.648743, Output 1: 0.645888, 0.341514, 0.0119906, 0.000607619, Output 2: 0.390968, 0.602809, 0.0061569, 6.6636e-05, %MSG-e DUNEAna: EnergyReco:energyrecnumumcs@BeginModule 24-Jun-2025 13:21:24 BST run: 50571149 subRun: 1 event: 54298 Failed to find product with label wclsmcnfsp:gauss ... returning empty vector %MSG 296 ***Wiener Filter*******ApplyPostfilter*** Running Ophitfinder with InputDigiType = 'recob' Found hits: 863! Begin processing the 99th record. run: 50571149 subRun: 1 event: 54299 at 24-Jun-2025 13:21:27 BST %MSG-e DUNEAna: EnergyReco:energyrecnumurange@BeginModule 24-Jun-2025 13:21:28 BST run: 50571149 subRun: 1 event: 54299 Failed to find product with label wclsmcnfsp:gauss ... returning empty vector %MSG %MSG-e DUNEAna: EnergyReco:energyrecnumumcs@BeginModule 24-Jun-2025 13:21:28 BST run: 50571149 subRun: 1 event: 54299 Failed to find product with label wclsmcnfsp:gauss ... returning empty vector %MSG 83 ***Wiener Filter*******ApplyPostfilter*** Running Ophitfinder with InputDigiType = 'recob' Found hits: 170! Begin processing the 100th record. run: 50571149 subRun: 1 event: 54300 at 24-Jun-2025 13:21:29 BST Boundary wire vector sizes: 44, 124, 94 minwire 0: 492 minwire 1: 1898 minwire 2: 547 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Used alternate method to get min and max tdcs due to vertex determination failure: 0, 299 Classifier summary: Output 0: 0.452284, 0.00415138, 0.543564, Output 1: 0.190507, 0.769953, 0.0379058, 0.00163431, Output 2: 0.521685, 0.474253, 0.00401931, 4.27001e-05, %MSG-e DUNEAna: EnergyReco:energyrecnumumcs@BeginModule 24-Jun-2025 13:21:32 BST run: 50571149 subRun: 1 event: 54300 Failed to find product with label wclsmcnfsp:gauss ... returning empty vector %MSG 311 ***Wiener Filter*******ApplyPostfilter*** Running Ophitfinder with InputDigiType = 'recob' Found hits: 927! 24-Jun-2025 13:21:36 BST Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50571149_542_20231202T190906Z_gen_g4_detsim_hitreco_reco2.root" 24-Jun-2025 13:21:36 BST Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/cb/8b/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50571149_542_20231202T190906Z_gen_g4_detsim_hitreco.root" ======================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ======================================================================================================================================== Full event 2.03637 11.8815 378.1 6.8718 37.4328 100 ---------------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.0188666 0.0357046 0.131383 0.0293352 0.0204949 100 reco:pandora:StandardPandora 1.29167 6.22821 361.376 1.74267 36.0115 100 reco:pandoraTrack:LArPandoraTrackCreation 0.000121524 0.0107368 0.280581 0.00217807 0.0334831 100 reco:pandoraShower:LArPandoraModularShowerCreation 0.000178152 0.0299416 0.505566 0.00453078 0.0777796 100 reco:pandoracalo:Calorimetry 0.000107487 0.0364424 1.6762 0.00157652 0.178104 100 reco:pandorapid:Chi2ParticleID 3.7842e-05 0.000231688 0.00330968 0.000151451 0.000362654 100 reco:cvnmap:CVNMapper 2.5048e-05 0.00930245 0.0728687 0.00944684 0.00860202 100 reco:cvneva:CVNEvaluator 1.7022e-05 0.465389 2.84028 0.566017 0.338949 100 reco:energyrecnumu:EnergyReco 0.0555847 0.234223 5.44623 0.122765 0.574407 100 reco:energyrecnue:EnergyReco 0.000257786 0.0153575 0.123556 0.00136176 0.0287316 100 reco:energyrecnc:EnergyReco 0.00227344 0.10484 0.36516 0.117336 0.0656897 100 reco:energyrecnumurange:EnergyReco 0.000173945 0.0989089 3.80248 0.00228362 0.419629 100 reco:energyrecnumumcs:EnergyReco 0.000121594 0.106552 4.51154 0.002192 0.484252 100 reco:opdec:Deconvolution 0.0663187 0.312939 0.713127 0.30708 0.114868 100 reco:ophitspe:OpHitFinderDeco 0.332197 3.81537 8.41748 3.61002 1.72403 100 reco:opflash:OpFlashFinder 0.000295468 0.00173305 0.00597449 0.00157067 0.000929227 100 reco:rns:RandomNumberSaver 1.9166e-05 3.12662e-05 0.000339884 2.7984e-05 3.13277e-05 100 reco:anglereconue:NuAngularReco 0.00016125 0.00266181 0.068712 0.000386659 0.00941839 100 reco:anglereconumu:NuAngularReco 9.1637e-05 0.0025481 0.0690548 0.000307076 0.00943474 100 reco:anglereconuepfps:NuAngularReco 0.000128447 0.00269136 0.0683666 0.000409753 0.00942033 100 reco:anglereconumupfps:NuAngularReco 0.000123287 0.00264558 0.0690603 0.000385096 0.00945405 100 [art]:TriggerResults:TriggerResultInserter 9.828e-06 1.64344e-05 0.000101175 1.561e-05 9.0371e-06 100 end_path:out1:RootOutput 2.826e-06 4.29716e-06 2.6712e-05 4.103e-06 2.31883e-06 100 end_path:out1:RootOutput(write) 0.00997141 0.363625 0.996544 0.411788 0.189104 100 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 3642.77 MB Peak resident set size usage (VmHWM): 1954.27 MB ==================================================================================================== Art has completed and will exit with status 0. === End last 100 lines of lar log file === lar exit code 0