justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 426736.47@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID426736.47@justin-prod-sched01.dune.hep.ac.uk
Workflow ID8053
Stage ID1
User namehiguera@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-07-03 09:18:45
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2025-07-03 13:18:47
From worker nodeHostnamedune001-7055066.0-lcg2713.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-07-03 09:24:49
Input filesfardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241024T142648Z_gen_003656_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time3h (12857s)
CPU time3h (12622s = 98%)
Max RSS bytes2483630080 (2368 MiB)
Outputting started2025-07-03 12:59:07
Output filesfardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241024T142648Z_gen_003656_supernova_g4stage1_g4stage2_detsim_reco_20250703T092455Z_reco2.root
Finished2025-07-03 13:18:47
Saved logsjustin-logs:426736.47-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:16 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:16 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:16 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:16 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:16 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:16 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:16 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:16 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:16 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:16 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:16 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:16 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:16 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:16 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:16 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:16 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:16 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:17 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:17 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:17 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:17 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:17 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:17 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:17 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:17 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:17 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:17 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:56:17 UTC run: 3808 subRun: 0 event: 36560
Comparing two wires in the same plane: return failure
%MSG
03-Jul-2025 12:59:02 UTC  Closed output file "prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241024T142648Z_gen_003656_supernova_g4stage1_g4stage2_detsim_reco_20250703T092455Z_reco2.root"
03-Jul-2025 12:59:02 UTC  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/fardet-vd/4c/fc/prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241024T142648Z_gen_003656_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              996.982       1269.83       1673.04       1199.17       208.345        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00501595     0.0233482     0.0805285     0.0122161     0.0244899       10     
reco:pandora:StandardPandora                            885.669       1112.39       1503.93       1031.62       192.888        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000280762    0.0132596     0.0933541    0.00294704     0.0275363       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000256225   0.00191735    0.00865915    0.00108406    0.00243979       10     
reco:pandoracalo:Calorimetry                          0.000282435   0.00378196     0.0124105    0.000748535    0.0046245       10     
reco:pandorapid:Chi2ParticleID                        5.3881e-05    0.000197853    0.0009184    0.000118472   0.000245099      10     
reco:linecluster:LineCluster                           0.260343      0.328206      0.398119      0.321176      0.0416871       10     
reco:trajcluster:TrajCluster                           0.269075       0.33869      0.411918      0.335579      0.046108        10     
reco:pmtracktc:PMAlgTrackMaker                          4.90391       7.11532       8.58608       7.52023       1.21365        10     
reco:emtrkmichelid:EmTrackMichelId                      103.266       148.82        203.376       144.795       31.8518        10     
reco:solarflash:SolarOpFlash                           0.448305      0.561548      0.615793      0.584666      0.0568481       10     
[art]:TriggerResults:TriggerResultInserter            2.8252e-05    4.7983e-05    7.4752e-05    4.42065e-05   1.3878e-05       10     
end_path:out1:RootOutput                               4.577e-06    1.48193e-05   3.4762e-05    1.31945e-05   7.50748e-06      10     
end_path:out1:RootOutput(write)                        0.184426      0.236979      0.270266      0.242289      0.0245873       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4062.18 MB
  Peak resident set size usage (VmHWM): 2483.63 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241024T142648Z_gen_003656_supernova_g4stage1_g4stage2_detsim_reco_20250703T092455Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241024T142648Z_gen_003656_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
old_md.json
prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241024T142648Z_gen_003656_supernova_g4stage1_g4stage2_detsim_reco_20250703T092455Z_reco2.root
prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241024T142648Z_gen_003656_supernova_g4stage1_g4stage2_detsim_reco_20250703T092455Z_reco2.root.ext.json
prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241024T142648Z_gen_003656_supernova_g4stage1_g4stage2_detsim_reco_20250703T092455Z_reco2.root.json
reco2_hist.root
justIN time: 2025-08-15 00:07:03 UTC       justIN version: 01.03.02