21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 425401.160@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 425401.160@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 8046 | |
| Stage ID | 1 | |
| User name | higuera@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-07-01 05:42:56 | |
| Site | UK_QMUL | |
| Entry | DUNE_UK_London_QMUL_arcce02 | |
| Last heartbeat | 2025-07-01 12:59:57 | |
| From worker node | Hostname | cn047.htc.esc.qmul |
| cpuinfo | Intel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | outputting_failed | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-07-01 05:54:44 | |
| Input files | fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T004939Z_gen_003440_supernova_g4stage1_g4stage2_detsim_reco.root | |
| Jobscript | Exit code | 0 |
| Real time | 6h (22895s) | |
| CPU time | 6h (22474s = 98%) | |
| Max RSS bytes | 2588540928 (2468 MiB) | |
| Outputting started | 2025-07-01 12:16:19 | |
| Output files | ||
| Finished | 2025-07-01 12:59:57 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:55 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:55 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:55 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:55 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:55 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:55 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:55 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:55 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:55 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:55 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:55 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:55 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:56 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:56 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:56 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:56 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:56 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:56 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:56 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:56 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:56 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:56 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:56 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:56 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:56 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:56 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:56 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 13:11:56 BST run: 5003 subRun: 0 event: 34400 Comparing two wires in the same plane: return failure %MSG 01-Jul-2025 13:16:14 BST Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T004939Z_gen_003440_supernova_g4stage1_g4stage2_detsim_reco_20250701T055450Z_reco2.root" 01-Jul-2025 13:16:14 BST Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/f7/5a/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T004939Z_gen_003440_supernova_g4stage1_g4stage2_detsim_reco.root" ======================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ======================================================================================================================================== Full event 2121.27 2260.55 2444.76 2258.47 109.222 10 ---------------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.00370319 0.02862 0.116743 0.00888219 0.0407386 10 reco:pandora:StandardPandora 1857.44 1974.68 2129.73 1963.15 89.1007 10 reco:pandoraTrack:LArPandoraTrackCreation 0.000300056 0.0116661 0.0766979 0.00659962 0.0219736 10 reco:pandoraShower:LArPandoraModularShowerCreation 0.000266572 0.00242673 0.0130554 0.00099107 0.00383862 10 reco:pandoracalo:Calorimetry 0.000220164 0.00140596 0.00619979 0.000399514 0.00208828 10 reco:pandorapid:Chi2ParticleID 5.1098e-05 0.000272222 0.00196337 9.56085e-05 0.000564286 10 reco:linecluster:LineCluster 0.941298 0.994896 1.34777 0.956999 0.117931 10 reco:trajcluster:TrajCluster 0.286508 0.328183 0.421868 0.31847 0.0364766 10 reco:pmtracktc:PMAlgTrackMaker 3.89444 4.9447 7.35821 4.66477 0.933509 10 reco:emtrkmichelid:EmTrackMichelId 233.236 278.159 316.87 278.608 24.7919 10 reco:solarflash:SolarOpFlash 1.08174 1.16028 1.41029 1.12232 0.10202 10 [art]:TriggerResults:TriggerResultInserter 2.1343e-05 3.27935e-05 6.8168e-05 2.8552e-05 1.30055e-05 10 end_path:out1:RootOutput 6.453e-06 1.00557e-05 3.4626e-05 7.374e-06 8.20153e-06 10 end_path:out1:RootOutput(write) 0.195737 0.239382 0.382385 0.229377 0.0497017 10 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 4050.33 MB Peak resident set size usage (VmHWM): 2588.54 MB ==================================================================================================== Art has completed and will exit with status 0. Moving on to metadata extractor ============OUTPUT FILE: prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T004939Z_gen_003440_supernova_g4stage1_g4stage2_detsim_reco_20250701T055450Z_reco2.root Extracted metadata checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T004939Z_gen_003440_supernova_g4stage1_g4stage2_detsim_reco.root MD conversion to MetaCat OK all-input-dids.txt debugprod.log jobscript.log justin-processed-pfns.txt old_md.json prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T004939Z_gen_003440_supernova_g4stage1_g4stage2_detsim_reco_20250701T055450Z_reco2.root prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T004939Z_gen_003440_supernova_g4stage1_g4stage2_detsim_reco_20250701T055450Z_reco2.root.ext.json prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T004939Z_gen_003440_supernova_g4stage1_g4stage2_detsim_reco_20250701T055450Z_reco2.root.json reco2_hist.root