21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 234196.148@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 234196.148@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 8062 | |
| Stage ID | 1 | |
| User name | epennacc@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-07-03 02:49:49 | |
| Site | CZ_FZU | |
| Entry | Nova_CZ_FZU_osgce2 | |
| Last heartbeat | 2025-07-03 12:27:36 | |
| From worker node | Hostname | lupin10.farm.particle.cz |
| cpuinfo | AMD EPYC 7551 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4194304000 (4000 MiB) | |
| Wall seconds limit | 172800 (48 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | outputting_failed | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-07-03 07:39:46 | |
| Input files | fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T004926Z_gen_001182_supernova_g4stage1_g4stage2_detsim_reco.root | |
| Jobscript | Exit code | 0 |
| Real time | 4h (16809s) | |
| CPU time | 4h (16126s = 95%) | |
| Max RSS bytes | 2507010048 (2390 MiB) | |
| Outputting started | 2025-07-03 12:19:55 | |
| Output files | ||
| Finished | 2025-07-03 12:27:36 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
SG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:16 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:16 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:16 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG %MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 03-Jul-2025 14:17:17 CEST run: 5003 subRun: 0 event: 11820 Comparing two wires in the same plane: return failure %MSG 03-Jul-2025 14:19:51 CEST Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T004926Z_gen_001182_supernova_g4stage1_g4stage2_detsim_reco_20250703T074134Z_reco2.root" 03-Jul-2025 14:19:51 CEST Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/4d/2c/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T004926Z_gen_001182_supernova_g4stage1_g4stage2_detsim_reco.root" ======================================================================================================================================== TimeTracker printout (sec) Min Avg Max Median RMS nEvts ======================================================================================================================================== Full event 1597.22 1641.24 1689.51 1642.68 29.7678 10 ---------------------------------------------------------------------------------------------------------------------------------------- source:RootInput(read) 0.0039938 0.0289405 0.128624 0.00584789 0.0460072 10 reco:pandora:StandardPandora 1444.62 1486.78 1532.21 1485.91 28.1817 10 reco:pandoraTrack:LArPandoraTrackCreation 0.00026595 0.00583846 0.0390683 0.00220105 0.0112165 10 reco:pandoraShower:LArPandoraModularShowerCreation 0.000266301 0.00189263 0.0101671 0.00114443 0.00279745 10 reco:pandoracalo:Calorimetry 0.000393851 0.00171664 0.00430096 0.000473625 0.00158791 10 reco:pandorapid:Chi2ParticleID 6.12e-05 0.00021006 0.001167 0.000102266 0.000319835 10 reco:linecluster:LineCluster 1.03657 1.10524 1.48647 1.05687 0.129206 10 reco:trajcluster:TrajCluster 0.344394 0.379741 0.415062 0.378414 0.0179376 10 reco:pmtracktc:PMAlgTrackMaker 5.4703 6.55242 7.3759 6.5592 0.507661 10 reco:emtrkmichelid:EmTrackMichelId 136.48 144.708 155.428 144.937 5.46067 10 reco:solarflash:SolarOpFlash 1.33905 1.38429 1.56148 1.3658 0.0625268 10 [art]:TriggerResults:TriggerResultInserter 2.3071e-05 5.69132e-05 0.00027025 3.105e-05 7.21296e-05 10 end_path:out1:RootOutput 7.29e-06 1.1357e-05 2.989e-05 7.945e-06 7.10614e-06 10 end_path:out1:RootOutput(write) 0.2705 0.290183 0.319833 0.286128 0.0143167 10 ======================================================================================================================================== ==================================================================================================== MemoryTracker summary (base-10 MB units used) Peak virtual memory usage (VmPeak) : 4041.46 MB Peak resident set size usage (VmHWM): 2507.01 MB ==================================================================================================== Art has completed and will exit with status 0. Moving on to metadata extractor ============OUTPUT FILE: prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T004926Z_gen_001182_supernova_g4stage1_g4stage2_detsim_reco_20250703T074134Z_reco2.root Extracted metadata checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T004926Z_gen_001182_supernova_g4stage1_g4stage2_detsim_reco.root MD conversion to MetaCat OK all-input-dids.txt debugprod.log jobscript.log justin-processed-pfns.txt old_md.json prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T004926Z_gen_001182_supernova_g4stage1_g4stage2_detsim_reco_20250703T074134Z_reco2.root prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T004926Z_gen_001182_supernova_g4stage1_g4stage2_detsim_reco_20250703T074134Z_reco2.root.ext.json prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250131T004926Z_gen_001182_supernova_g4stage1_g4stage2_detsim_reco_20250703T074134Z_reco2.root.json reco2_hist.root