21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 234070.0@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 234070.0@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 8026 | |
| Stage ID | 1 | |
| User name | epennacc@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-07-02 22:18:06 | |
| Site | US_FNAL-FermiGrid | |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly | |
| Last heartbeat | 2025-07-03 12:57:25 | |
| From worker node | Hostname | dunegli-6038489-0-fnpc7501.fnal.gov |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 172800 (48 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-07-03 05:49:23 | |
| Input files | fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T042946Z_gen_001893_supernova_g4stage1_g4stage2_detsim_reco.root | |
| Jobscript | Exit code | 0 |
| Real time | 7h (25437s) | |
| CPU time | 6h (25127s = 98%) | |
| Max RSS bytes | 2574098432 (2454 MiB) | |
| Outputting started | 2025-07-03 12:53:22 | |
| Output files | fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T042946Z_gen_001893_supernova_g4stage1_g4stage2_detsim_reco_20250703T054927Z_reco2.root | |
| Finished | 2025-07-03 12:57:25 | |
| Saved logs | justin-logs:234070.0-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
e same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:16 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:16 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:16 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:16 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:16 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 12:48:17 UTC run: 5056 subRun: 0 event: 18930 Comparing two wires in the same plane: return failure %MSG 03-Jul-2025 12:53:12 UTC Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T042946Z_gen_001893_supernova_g4stage1_g4stage2_detsim_reco_20250703T054927Z_reco2.root" 03-Jul-2025 12:53:12 UTC Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/a1/8c/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T042946Z_gen_001893_supernova_g4stage1_g4stage2_detsim_reco.root" ======================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ======================================================================================================================================== Full event 2293.4 2527.55 2709.76 2579.38 136.156 10 ---------------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.00642684 0.0133086 0.0195087 0.0140357 0.00407344 10 reco:pandora:StandardPandora 1953.85 2201.14 2370.08 2246.02 132.079 10 reco:pandoraTrack:LArPandoraTrackCreation 0.000396988 0.0118579 0.0834466 0.00389532 0.0241357 10 reco:pandoraShower:LArPandoraModularShowerCreation 0.000345404 0.00294123 0.0189154 0.00162146 0.00536921 10 reco:pandoracalo:Calorimetry 0.000287895 0.00390067 0.012635 0.000758547 0.00433232 10 reco:pandorapid:Chi2ParticleID 8.0308e-05 0.000330798 0.00212332 0.000137529 0.000598236 10 reco:linecluster:LineCluster 0.207597 0.243118 0.339146 0.2222 0.0417105 10 reco:trajcluster:TrajCluster 0.390104 0.44401 0.513302 0.441935 0.0359663 10 reco:pmtracktc:PMAlgTrackMaker 6.94803 8.61577 10.0447 8.79112 0.827213 10 reco:emtrkmichelid:EmTrackMichelId 268.539 316.027 334.506 325.43 20.4671 10 reco:solarflash:SolarOpFlash 0.743708 0.784555 0.810874 0.783594 0.0190169 10 [art]:TriggerResults:TriggerResultInserter 3.5243e-05 4.66971e-05 7.447e-05 4.4694e-05 1.0197e-05 10 end_path:out1:RootOutput 6.383e-06 1.20143e-05 2.8958e-05 1.1044e-05 6.01206e-06 10 end_path:out1:RootOutput(write) 0.254416 0.267432 0.301804 0.263754 0.0129579 10 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 4037.32 MB Peak resident set size usage (VmHWM): 2574.1 MB ==================================================================================================== Art has completed and will exit with status 0. Moving on to metadata extractor ============OUTPUT FILE: prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T042946Z_gen_001893_supernova_g4stage1_g4stage2_detsim_reco_20250703T054927Z_reco2.root Extracted metadata checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T042946Z_gen_001893_supernova_g4stage1_g4stage2_detsim_reco.root MD conversion to MetaCat OK all-input-dids.txt debugprod.log jobscript.log justin-processed-pfns.txt old_md.json prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T042946Z_gen_001893_supernova_g4stage1_g4stage2_detsim_reco_20250703T054927Z_reco2.root prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T042946Z_gen_001893_supernova_g4stage1_g4stage2_detsim_reco_20250703T054927Z_reco2.root.ext.json prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T042946Z_gen_001893_supernova_g4stage1_g4stage2_detsim_reco_20250703T054927Z_reco2.root.json reco2_hist.root