21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 426462.62@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 426462.62@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 8055 | |
| Stage ID | 1 | |
| User name | higuera@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-07-02 22:30:28 | |
| Site | US_Wisconsin | |
| Entry | HCCHTPC_US_Wisconsin_osg01_rhel7 | |
| Last heartbeat | 2025-07-03 05:45:20 | |
| From worker node | Hostname | e4078 |
| cpuinfo | AMD EPYC 7763 64-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 82800 (23 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-07-02 22:31:42 | |
| Input files | fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T063952Z_gen_001626_supernova_g4stage1_g4stage2_detsim_reco.root | |
| Jobscript | Exit code | 0 |
| Real time | 6h (25014s) | |
| CPU time | 5h (21353s = 85%) | |
| Max RSS bytes | 2559815680 (2441 MiB) | |
| Outputting started | 2025-07-03 05:28:37 | |
| Output files | fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T063952Z_gen_001626_supernova_g4stage1_g4stage2_detsim_reco_20250702T223153Z_reco2.root | |
| Finished | 2025-07-03 05:45:20 | |
| Saved logs | justin-logs:426462.62-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:29 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:29 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:29 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:29 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:29 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:29 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:29 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:29 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:30 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:30 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:30 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:30 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:30 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:30 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:30 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:30 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:30 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:30 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:30 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:30 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:30 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:30 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:30 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:30 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:30 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:30 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:30 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 00:25:31 CDT run: 5021 subRun: 0 event: 16260 Comparing two wires in the same plane: return failure %MSG 03-Jul-2025 00:28:25 CDT Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T063952Z_gen_001626_supernova_g4stage1_g4stage2_detsim_reco_20250702T223153Z_reco2.root" 03-Jul-2025 00:28:25 CDT Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/0e/30/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T063952Z_gen_001626_supernova_g4stage1_g4stage2_detsim_reco.root" ======================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ======================================================================================================================================== Full event 2013.01 2471.14 2818.09 2559.53 294.566 10 ---------------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.00595395 0.0336659 0.0774186 0.0214993 0.0256221 10 reco:pandora:StandardPandora 1829.5 2204.22 2518.85 2259.15 261.414 10 reco:pandoraTrack:LArPandoraTrackCreation 0.000306725 0.00895242 0.0690458 0.000701083 0.0202653 10 reco:pandoraShower:LArPandoraModularShowerCreation 0.000259075 0.00292935 0.0138361 0.00112084 0.00401955 10 reco:pandoracalo:Calorimetry 0.000338433 0.00538583 0.0252473 0.00238944 0.00748111 10 reco:pandorapid:Chi2ParticleID 5.9421e-05 0.000257827 0.00100555 0.000111694 0.000316281 10 reco:linecluster:LineCluster 0.394323 0.513616 0.729939 0.472145 0.110763 10 reco:trajcluster:TrajCluster 0.327244 0.3977 0.517632 0.398203 0.0574519 10 reco:pmtracktc:PMAlgTrackMaker 8.43016 9.85135 11.0065 9.85207 0.77655 10 reco:emtrkmichelid:EmTrackMichelId 170.829 254.979 294.291 265.724 38.8355 10 reco:solarflash:SolarOpFlash 0.718212 0.78974 0.925004 0.766034 0.0720519 10 [art]:TriggerResults:TriggerResultInserter 3.3724e-05 4.86251e-05 0.000100388 4.2189e-05 1.86293e-05 10 end_path:out1:RootOutput 7.955e-06 1.45752e-05 4.5204e-05 1.1592e-05 1.03158e-05 10 end_path:out1:RootOutput(write) 0.255649 0.332628 0.45327 0.305883 0.0685888 10 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 4042.51 MB Peak resident set size usage (VmHWM): 2559.82 MB ==================================================================================================== Art has completed and will exit with status 0. Moving on to metadata extractor ============OUTPUT FILE: prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T063952Z_gen_001626_supernova_g4stage1_g4stage2_detsim_reco_20250702T223153Z_reco2.root Extracted metadata checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T063952Z_gen_001626_supernova_g4stage1_g4stage2_detsim_reco.root MD conversion to MetaCat OK all-input-dids.txt debugprod.log jobscript.log justin-processed-pfns.txt old_md.json prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T063952Z_gen_001626_supernova_g4stage1_g4stage2_detsim_reco_20250702T223153Z_reco2.root prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T063952Z_gen_001626_supernova_g4stage1_g4stage2_detsim_reco_20250702T223153Z_reco2.root.ext.json prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T063952Z_gen_001626_supernova_g4stage1_g4stage2_detsim_reco_20250702T223153Z_reco2.root.json reco2_hist.root