21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 426070.7@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 426070.7@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 8056 | |
| Stage ID | 1 | |
| User name | higuera@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-07-02 08:53:38 | |
| Site | US_Wisconsin | |
| Entry | HCCHTPC_US_Wisconsin_osg01_rhel7 | |
| Last heartbeat | 2025-07-02 16:11:34 | |
| From worker node | Hostname | e2475 |
| cpuinfo | AMD EPYC 7452 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 82800 (23 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-07-02 10:29:23 | |
| Input files | fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T122241Z_gen_004314_supernova_g4stage1_g4stage2_detsim_reco.root | |
| Jobscript | Exit code | 0 |
| Real time | 5h (19220s) | |
| CPU time | 5h (18790s = 97%) | |
| Max RSS bytes | 2567921664 (2448 MiB) | |
| Outputting started | 2025-07-02 15:49:45 | |
| Output files | fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T122241Z_gen_004314_supernova_g4stage1_g4stage2_detsim_reco_20250702T102927Z_reco2.root | |
| Finished | 2025-07-02 16:11:34 | |
| Saved logs | justin-logs:426070.7-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:24 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:24 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:24 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:24 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:24 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:24 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:24 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:24 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:24 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:24 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:24 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:24 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:24 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:24 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:24 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:24 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:24 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:24 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:24 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:24 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:25 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:25 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:25 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:25 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:25 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:25 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:25 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 10:46:25 CDT run: 5059 subRun: 0 event: 43140 Comparing two wires in the same plane: return failure %MSG 02-Jul-2025 10:49:39 CDT Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T122241Z_gen_004314_supernova_g4stage1_g4stage2_detsim_reco_20250702T102927Z_reco2.root" 02-Jul-2025 10:49:39 CDT Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/9e/ca/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T122241Z_gen_004314_supernova_g4stage1_g4stage2_detsim_reco.root" ======================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ======================================================================================================================================== Full event 1525.6 1906 2654.41 1795.08 364.876 10 ---------------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.00286142 0.0193581 0.0926408 0.00955844 0.0263028 10 reco:pandora:StandardPandora 1398.03 1742.54 2453.62 1636.67 335.35 10 reco:pandoraTrack:LArPandoraTrackCreation 0.000212521 0.0064383 0.0387451 0.00353219 0.0110185 10 reco:pandoraShower:LArPandoraModularShowerCreation 0.000226327 0.00228757 0.00915638 0.00116785 0.00269069 10 reco:pandoracalo:Calorimetry 0.000282292 0.00115858 0.00476862 0.000551459 0.00130801 10 reco:pandorapid:Chi2ParticleID 4.5395e-05 0.000164113 0.000416776 0.000132124 0.000120232 10 reco:linecluster:LineCluster 0.303472 0.367258 0.450367 0.357099 0.0467717 10 reco:trajcluster:TrajCluster 0.241873 0.316449 0.464917 0.273882 0.0791873 10 reco:pmtracktc:PMAlgTrackMaker 4.32708 5.34294 8.56495 4.77576 1.28131 10 reco:emtrkmichelid:EmTrackMichelId 121.478 156.564 232.389 142.689 31.7458 10 reco:solarflash:SolarOpFlash 0.554828 0.606843 0.782408 0.592977 0.0613556 10 [art]:TriggerResults:TriggerResultInserter 2.0709e-05 3.27127e-05 5.7669e-05 3.00715e-05 1.14405e-05 10 end_path:out1:RootOutput 7.043e-06 1.13062e-05 1.7693e-05 1.1156e-05 3.10548e-06 10 end_path:out1:RootOutput(write) 0.192227 0.234159 0.388235 0.21765 0.0535785 10 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 4081.57 MB Peak resident set size usage (VmHWM): 2567.92 MB ==================================================================================================== Art has completed and will exit with status 0. Moving on to metadata extractor ============OUTPUT FILE: prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T122241Z_gen_004314_supernova_g4stage1_g4stage2_detsim_reco_20250702T102927Z_reco2.root Extracted metadata checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T122241Z_gen_004314_supernova_g4stage1_g4stage2_detsim_reco.root MD conversion to MetaCat OK all-input-dids.txt debugprod.log jobscript.log justin-processed-pfns.txt old_md.json prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T122241Z_gen_004314_supernova_g4stage1_g4stage2_detsim_reco_20250702T102927Z_reco2.root prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T122241Z_gen_004314_supernova_g4stage1_g4stage2_detsim_reco_20250702T102927Z_reco2.root.ext.json prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250205T122241Z_gen_004314_supernova_g4stage1_g4stage2_detsim_reco_20250702T102927Z_reco2.root.json reco2_hist.root