21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 233985.38@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 233985.38@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 8057 | |
| Stage ID | 1 | |
| User name | epennacc@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-07-02 18:54:34 | |
| Site | UK_RAL-Tier1 | |
| Entry | LIGO_UK_RAL_arc_ce05 | |
| Last heartbeat | 2025-07-03 05:00:13 | |
| From worker node | Hostname | dune001-6570359.0-lcg2726.gridpp.rl.ac.uk |
| cpuinfo | AMD EPYC 9654 96-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 216000 (60 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | aborted | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-07-03 01:29:57 | |
| Input files | fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T104343Z_gen_001202_supernova_g4stage1_g4stage2_detsim_reco.root | |
| Outputting started | 2025-07-03 04:39:36 | |
| Output files | ||
| Finished | 2025-07-03 05:00:13 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:02 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 04:37:03 UTC run: 5043 subRun: 0 event: 12020 Comparing two wires in the same plane: return failure %MSG 03-Jul-2025 04:39:30 UTC Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T104343Z_gen_001202_supernova_g4stage1_g4stage2_detsim_reco_20250703T013003Z_reco2.root" 03-Jul-2025 04:39:30 UTC Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/4a/b1/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T104343Z_gen_001202_supernova_g4stage1_g4stage2_detsim_reco.root" ======================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ======================================================================================================================================== Full event 954.249 1115.26 1551.41 1091 157.765 10 ---------------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.00707713 0.03709 0.143464 0.0123826 0.0507114 10 reco:pandora:StandardPandora 838.002 975.574 1374.85 934.538 142.63 10 reco:pandoraTrack:LArPandoraTrackCreation 0.000296117 0.0177123 0.144601 0.00311337 0.0424501 10 reco:pandoraShower:LArPandoraModularShowerCreation 0.000266222 0.00300896 0.0110744 0.00125693 0.00351586 10 reco:pandoracalo:Calorimetry 0.000162324 0.00205133 0.0103155 0.000470931 0.00311098 10 reco:pandorapid:Chi2ParticleID 4.676e-05 0.000268368 0.00164073 0.000120832 0.00045977 10 reco:linecluster:LineCluster 1.12642 1.3026 2.19684 1.18766 0.311682 10 reco:trajcluster:TrajCluster 0.244992 0.381062 0.463134 0.387298 0.0703334 10 reco:pmtracktc:PMAlgTrackMaker 4.88174 6.66666 10.4371 6.21197 1.77277 10 reco:emtrkmichelid:EmTrackMichelId 102.455 129.638 165.588 121.044 22.2385 10 reco:solarflash:SolarOpFlash 1.2395 1.39123 1.72951 1.38701 0.147879 10 [art]:TriggerResults:TriggerResultInserter 2.9584e-05 4.52051e-05 8.9896e-05 3.8788e-05 1.76682e-05 10 end_path:out1:RootOutput 6.84e-06 1.738e-05 4.9384e-05 1.3736e-05 1.15967e-05 10 end_path:out1:RootOutput(write) 0.17945 0.247527 0.29985 0.26778 0.0449872 10 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 4087.93 MB Peak resident set size usage (VmHWM): 2505.31 MB ==================================================================================================== Art has completed and will exit with status 0. Moving on to metadata extractor ============OUTPUT FILE: prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T104343Z_gen_001202_supernova_g4stage1_g4stage2_detsim_reco_20250703T013003Z_reco2.root Extracted metadata checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T104343Z_gen_001202_supernova_g4stage1_g4stage2_detsim_reco.root MD conversion to MetaCat OK all-input-dids.txt debugprod.log jobscript.log justin-processed-pfns.txt old_md.json prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T104343Z_gen_001202_supernova_g4stage1_g4stage2_detsim_reco_20250703T013003Z_reco2.root prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T104343Z_gen_001202_supernova_g4stage1_g4stage2_detsim_reco_20250703T013003Z_reco2.root.ext.json prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250204T104343Z_gen_001202_supernova_g4stage1_g4stage2_detsim_reco_20250703T013003Z_reco2.root.json reco2_hist.root