justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 232872.21@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID232872.21@justin-prod-sched02.dune.hep.ac.uk
Workflow ID8036
Stage ID1
User nameepennacc@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-07-01 02:53:40
SiteUK_QMUL
EntryDUNE_UK_London_QMUL_arcce02
Last heartbeat2025-07-01 17:20:33
From worker nodeHostnamecn053.htc.esc.qmul
cpuinfoIntel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-07-01 10:28:51
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T203156Z_gen_002095_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time6h (22071s)
CPU time6h (21650s = 98%)
Max RSS bytes2582036480 (2462 MiB)
Outputting started2025-07-01 16:36:43
Output filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T203156Z_gen_002095_supernova_g4stage1_g4stage2_detsim_reco_20250701T102858Z_reco2.root
Finished2025-07-01 17:20:33
Saved logsjustin-logs:232872.21-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

e same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:15 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 17:32:16 BST run: 5026 subRun: 0 event: 20950
Comparing two wires in the same plane: return failure
%MSG
01-Jul-2025 17:36:37 BST  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T203156Z_gen_002095_supernova_g4stage1_g4stage2_detsim_reco_20250701T102858Z_reco2.root"
01-Jul-2025 17:36:37 BST  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/d6/b8/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T203156Z_gen_002095_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1781.93       2176.4        2843.02       2045.69       348.964        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00472886     0.028737       0.10916      0.0104918     0.0383959       10     
reco:pandora:StandardPandora                            1576.62       1901.5        2511.25       1759.26       310.29         10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000265781    0.012498      0.0923628    0.00515577     0.0267658       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000257123   0.00378127     0.027088     0.00101653    0.00782926       10     
reco:pandoracalo:Calorimetry                          0.000335467    0.0023119    0.00840184    0.000387919   0.00302026       10     
reco:pandorapid:Chi2ParticleID                        6.2596e-05    0.000448782   0.00365556    0.000106239   0.00106905       10     
reco:linecluster:LineCluster                            0.89542      0.970698       1.49451      0.915506       0.17508        10     
reco:trajcluster:TrajCluster                           0.266442       0.33274      0.682157      0.289098      0.118654        10     
reco:pmtracktc:PMAlgTrackMaker                          4.00547       5.31578       12.0786       4.49973       2.29093        10     
reco:emtrkmichelid:EmTrackMichelId                      198.677       266.819       326.626       258.844       46.8441        10     
reco:solarflash:SolarOpFlash                            1.00168       1.15745       1.52883       1.08348      0.167229        10     
[art]:TriggerResults:TriggerResultInserter            1.7947e-05    3.39844e-05   8.9111e-05    2.7358e-05    1.92032e-05      10     
end_path:out1:RootOutput                               5.636e-06    9.8412e-06    3.3687e-05    6.4635e-06    8.1173e-06       10     
end_path:out1:RootOutput(write)                        0.182715      0.251583      0.374541      0.211673      0.0676822       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4043.9 MB
  Peak resident set size usage (VmHWM): 2582.04 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T203156Z_gen_002095_supernova_g4stage1_g4stage2_detsim_reco_20250701T102858Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T203156Z_gen_002095_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
old_md.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T203156Z_gen_002095_supernova_g4stage1_g4stage2_detsim_reco_20250701T102858Z_reco2.root
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T203156Z_gen_002095_supernova_g4stage1_g4stage2_detsim_reco_20250701T102858Z_reco2.root.ext.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T203156Z_gen_002095_supernova_g4stage1_g4stage2_detsim_reco_20250701T102858Z_reco2.root.json
reco2_hist.root
justIN time: 2025-08-14 18:35:16 UTC       justIN version: 01.03.02