21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 425713.89@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 425713.89@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 8047 | |
| Stage ID | 1 | |
| User name | epennacc@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-07-01 16:14:39 | |
| Site | FR_CCIN2P3 | |
| Entry | DUNE_FR_CCIN2P3_cccondorce01 | |
| Last heartbeat | 2025-07-01 22:00:53 | |
| From worker node | Hostname | ccwcondor0592 |
| cpuinfo | AMD EPYC 7453 28-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 106200 (29 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | outputting_failed | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-07-01 16:24:52 | |
| Input files | fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250129T145150Z_gen_000915_supernova_g4stage1_g4stage2_detsim_reco.root | |
| Jobscript | Exit code | 0 |
| Real time | 5h (19041s) | |
| CPU time | 5h (18227s = 95%) | |
| Max RSS bytes | 2553487360 (2435 MiB) | |
| Outputting started | 2025-07-01 21:42:14 | |
| Output files | ||
| Finished | 2025-07-01 22:00:53 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
ame plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:07 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:07 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:07 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:07 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:07 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:07 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:07 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:07 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:07 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:07 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:07 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:07 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:07 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:07 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:07 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:07 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:08 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:08 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:08 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:08 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:08 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:08 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:08 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:08 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:08 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:08 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:08 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 01-Jul-2025 23:38:08 CEST run: 4984 subRun: 0 event: 9150 Comparing two wires in the same plane: return failure %MSG 01-Jul-2025 23:42:06 CEST Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250129T145150Z_gen_000915_supernova_g4stage1_g4stage2_detsim_reco_20250701T162502Z_reco2.root" 01-Jul-2025 23:42:06 CEST Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/34/b1/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250129T145150Z_gen_000915_supernova_g4stage1_g4stage2_detsim_reco.root" ======================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ======================================================================================================================================== Full event 1564.35 1862.22 2729.47 1771.66 327.53 10 ---------------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.00741529 0.0401069 0.127127 0.0186927 0.0438806 10 reco:pandora:StandardPandora 1366.27 1636.14 2533.66 1531.93 325.649 10 reco:pandoraTrack:LArPandoraTrackCreation 0.000397787 0.0202155 0.147485 0.00610679 0.0427723 10 reco:pandoraShower:LArPandoraModularShowerCreation 0.000394671 0.00448857 0.0317806 0.00181022 0.00912484 10 reco:pandoracalo:Calorimetry 0.000476093 0.00381739 0.0101438 0.00082102 0.00399503 10 reco:pandorapid:Chi2ParticleID 8.2735e-05 0.000420878 0.00271909 0.00015237 0.000768 10 reco:linecluster:LineCluster 1.0641 1.15422 1.64697 1.10627 0.165742 10 reco:trajcluster:TrajCluster 0.334267 0.421453 0.648463 0.401043 0.0833617 10 reco:pmtracktc:PMAlgTrackMaker 6.00526 8.58996 9.85536 8.8023 1.13263 10 reco:emtrkmichelid:EmTrackMichelId 167.623 214.163 270.063 205.142 30.8102 10 reco:solarflash:SolarOpFlash 1.25193 1.40758 1.55289 1.40503 0.0898814 10 [art]:TriggerResults:TriggerResultInserter 3.1329e-05 0.000135161 0.000782759 4.90425e-05 0.000219914 10 end_path:out1:RootOutput 8.827e-06 1.57507e-05 6.1626e-05 1.0445e-05 1.53346e-05 10 end_path:out1:RootOutput(write) 0.239989 0.274376 0.314588 0.278799 0.0204877 10 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 4073.98 MB Peak resident set size usage (VmHWM): 2553.49 MB ==================================================================================================== Art has completed and will exit with status 0. Moving on to metadata extractor ============OUTPUT FILE: prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250129T145150Z_gen_000915_supernova_g4stage1_g4stage2_detsim_reco_20250701T162502Z_reco2.root Extracted metadata checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250129T145150Z_gen_000915_supernova_g4stage1_g4stage2_detsim_reco.root MD conversion to MetaCat OK all-input-dids.txt debugprod.log jobscript.log justin-processed-pfns.txt old_md.json prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250129T145150Z_gen_000915_supernova_g4stage1_g4stage2_detsim_reco_20250701T162502Z_reco2.root prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250129T145150Z_gen_000915_supernova_g4stage1_g4stage2_detsim_reco_20250701T162502Z_reco2.root.ext.json prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250129T145150Z_gen_000915_supernova_g4stage1_g4stage2_detsim_reco_20250701T162502Z_reco2.root.json reco2_hist.root