21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 426035.140@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 426035.140@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 8053 | |
| Stage ID | 1 | |
| User name | higuera@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-07-02 07:12:53 | |
| Site | FR_CCIN2P3 | |
| Entry | DUNE_FR_CCIN2P3_cccondorce02 | |
| Last heartbeat | 2025-07-02 11:00:57 | |
| From worker node | Hostname | ccwcondor0027 |
| cpuinfo | AMD EPYC 9334 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 106200 (29 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | stalled | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-07-02 08:18:04 | |
| Input files | fardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250217T025833Z_gen_003585_supernova_g4stage1_g4stage2_detsim_reco.root | |
| Outputting started | 2025-07-02 11:00:57 | |
| Output files | ||
| Finished | 2025-07-02 12:02:38 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 02-Jul-2025 12:58:47 CEST run: 5185 subRun: 0 event: 35850 Comparing two wires in the same plane: return failure %MSG 02-Jul-2025 13:00:53 CEST Closed output file "prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250217T025833Z_gen_003585_supernova_g4stage1_g4stage2_detsim_reco_20250702T081810Z_reco2.root" 02-Jul-2025 13:00:53 CEST Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/fardet-vd/93/f5/prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250217T025833Z_gen_003585_supernova_g4stage1_g4stage2_detsim_reco.root" ======================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ======================================================================================================================================== Full event 856.168 961.224 1035.73 981.947 60.5768 10 ---------------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.00309108 0.0193959 0.0776886 0.00926585 0.0230844 10 reco:pandora:StandardPandora 728.846 848.503 931.739 874.332 64.0523 10 reco:pandoraTrack:LArPandoraTrackCreation 0.000226322 0.00594722 0.0511131 0.000461543 0.0150909 10 reco:pandoraShower:LArPandoraModularShowerCreation 0.000216658 0.00119112 0.00701973 0.000555507 0.00196673 10 reco:pandoracalo:Calorimetry 0.000182276 0.00133721 0.00497988 0.000355163 0.00152448 10 reco:pandorapid:Chi2ParticleID 4.0701e-05 0.000128994 0.000717706 7.08475e-05 0.000196974 10 reco:linecluster:LineCluster 0.279762 0.368316 0.482295 0.374086 0.061349 10 reco:trajcluster:TrajCluster 0.204173 0.285762 0.322933 0.292319 0.0335868 10 reco:pmtracktc:PMAlgTrackMaker 3.70407 6.21733 8.25227 6.38618 1.539 10 reco:emtrkmichelid:EmTrackMichelId 95.3804 104.982 125.452 99.9391 10.5249 10 reco:solarflash:SolarOpFlash 0.547149 0.622032 0.709313 0.615203 0.044574 10 [art]:TriggerResults:TriggerResultInserter 2.5628e-05 3.21446e-05 4.4267e-05 2.95245e-05 5.7192e-06 10 end_path:out1:RootOutput 4.077e-06 8.1114e-06 1.8909e-05 7.506e-06 3.89552e-06 10 end_path:out1:RootOutput(write) 0.201584 0.217659 0.238158 0.217067 0.0101843 10 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 4038.3 MB Peak resident set size usage (VmHWM): 2537.2 MB ==================================================================================================== Art has completed and will exit with status 0. Moving on to metadata extractor ============OUTPUT FILE: prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250217T025833Z_gen_003585_supernova_g4stage1_g4stage2_detsim_reco_20250702T081810Z_reco2.root Extracted metadata checking file====== fardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250217T025833Z_gen_003585_supernova_g4stage1_g4stage2_detsim_reco.root MD conversion to MetaCat OK all-input-dids.txt debugprod.log jobscript.log justin-processed-pfns.txt old_md.json prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250217T025833Z_gen_003585_supernova_g4stage1_g4stage2_detsim_reco_20250702T081810Z_reco2.root prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250217T025833Z_gen_003585_supernova_g4stage1_g4stage2_detsim_reco_20250702T081810Z_reco2.root.ext.json prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250217T025833Z_gen_003585_supernova_g4stage1_g4stage2_detsim_reco_20250702T081810Z_reco2.root.json reco2_hist.root