21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 425919.97@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 425919.97@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 8054 | |
| Stage ID | 1 | |
| User name | higuera@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-07-02 01:54:57 | |
| Site | US_UChicago | |
| Entry | Engage_US_MWT2_uct2_gk02_condce_mcore | |
| Last heartbeat | 2025-07-02 07:45:30 | |
| From worker node | Hostname | uct2-c618.mwt2.org |
| cpuinfo | AMD EPYC 7302 16-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 86400 (24 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-07-02 03:12:11 | |
| Input files | fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T163446Z_gen_000045_supernova_g4stage1_g4stage2_detsim_reco.root | |
| Jobscript | Exit code | 0 |
| Real time | 4h (15864s) | |
| CPU time | 4h (15542s = 97%) | |
| Max RSS bytes | 2557997056 (2439 MiB) | |
| Outputting started | 2025-07-02 07:36:51 | |
| Output files | fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T163446Z_gen_000045_supernova_g4stage1_g4stage2_detsim_reco_20250702T031216Z_reco2.root | |
| Finished | 2025-07-02 07:45:30 | |
| Saved logs | justin-logs:425919.97-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
T run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:21 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:21 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:21 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:21 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:21 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:21 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:21 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:21 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:21 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:21 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:21 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:21 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:21 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:21 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:21 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:21 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:21 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:21 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:21 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:21 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:21 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:22 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:22 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:22 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:22 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:22 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:22 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 02:34:22 CDT run: 4969 subRun: 0 event: 450 Comparing two wires in the same plane: return failure %MSG 02-Jul-2025 02:36:31 CDT Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T163446Z_gen_000045_supernova_g4stage1_g4stage2_detsim_reco_20250702T031216Z_reco2.root" 02-Jul-2025 02:36:31 CDT Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/d2/7a/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T163446Z_gen_000045_supernova_g4stage1_g4stage2_detsim_reco.root" ======================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ======================================================================================================================================== Full event 1494.25 1575.33 1759.06 1536.75 90.4308 10 ---------------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.00368979 0.0101185 0.029822 0.00678639 0.00870283 10 reco:pandora:StandardPandora 1367.61 1445.46 1623.3 1408.11 89.0727 10 reco:pandoraTrack:LArPandoraTrackCreation 0.000215886 0.00486233 0.0344205 0.0010566 0.0100392 10 reco:pandoraShower:LArPandoraModularShowerCreation 0.00022888 0.00146912 0.00557437 0.000763919 0.00170311 10 reco:pandoracalo:Calorimetry 0.000272682 0.00117625 0.0025589 0.00108927 0.000847898 10 reco:pandorapid:Chi2ParticleID 4.0636e-05 0.000143248 0.000558278 7.21105e-05 0.00017195 10 reco:linecluster:LineCluster 0.137353 0.201379 0.277496 0.19078 0.0375703 10 reco:trajcluster:TrajCluster 0.231612 0.285373 0.352449 0.281924 0.0419096 10 reco:pmtracktc:PMAlgTrackMaker 3.92582 4.90312 5.55678 4.98283 0.437824 10 reco:emtrkmichelid:EmTrackMichelId 117.859 123.717 129.894 123.588 3.85703 10 reco:solarflash:SolarOpFlash 0.452611 0.523531 0.665449 0.51903 0.0692544 10 [art]:TriggerResults:TriggerResultInserter 2.1992e-05 2.77872e-05 4.9914e-05 2.41505e-05 8.2404e-06 10 end_path:out1:RootOutput 8.246e-06 1.24104e-05 2.2743e-05 1.1777e-05 3.84578e-06 10 end_path:out1:RootOutput(write) 0.189248 0.21753 0.275911 0.204263 0.0298652 10 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 4039.63 MB Peak resident set size usage (VmHWM): 2558 MB ==================================================================================================== Art has completed and will exit with status 0. Moving on to metadata extractor ============OUTPUT FILE: prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T163446Z_gen_000045_supernova_g4stage1_g4stage2_detsim_reco_20250702T031216Z_reco2.root Extracted metadata checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T163446Z_gen_000045_supernova_g4stage1_g4stage2_detsim_reco.root MD conversion to MetaCat OK all-input-dids.txt debugprod.log jobscript.log justin-processed-pfns.txt old_md.json prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T163446Z_gen_000045_supernova_g4stage1_g4stage2_detsim_reco_20250702T031216Z_reco2.root prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T163446Z_gen_000045_supernova_g4stage1_g4stage2_detsim_reco_20250702T031216Z_reco2.root.ext.json prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250128T163446Z_gen_000045_supernova_g4stage1_g4stage2_detsim_reco_20250702T031216Z_reco2.root.json reco2_hist.root