justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 233853.23@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID233853.23@justin-prod-sched02.dune.hep.ac.uk
Workflow ID8058
Stage ID1
User nameepennacc@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-07-02 13:47:28
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce514
Last heartbeat2025-07-02 20:31:03
From worker nodeHostnameb9p08p2248.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-07-02 17:37:12
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T225526Z_gen_002551_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time2h (10155s)
CPU time2h (9719s = 95%)
Max RSS bytes2511814656 (2395 MiB)
Outputting started2025-07-02 20:26:27
Output filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T225526Z_gen_002551_supernova_g4stage1_g4stage2_detsim_reco_20250702T173718Z_reco2.root
Finished2025-07-02 20:31:03
Saved logsjustin-logs:233853.23-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

SG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 22:24:29 CEST run: 4901 subRun: 0 event: 25510
Comparing two wires in the same plane: return failure
%MSG
02-Jul-2025 22:26:24 CEST  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T225526Z_gen_002551_supernova_g4stage1_g4stage2_detsim_reco_20250702T173718Z_reco2.root"
02-Jul-2025 22:26:24 CEST  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/fe/60/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T225526Z_gen_002551_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              948.804       987.134       1030.13       975.007       30.0097        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00363717     0.0321126     0.142094     0.00827834     0.0500584       10     
reco:pandora:StandardPandora                            835.256       864.533       913.753       852.702       27.6058        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000245834   0.00591919      0.0436      0.00195394     0.0125842       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000266325    0.0016013    0.00812501    0.000983171   0.00220476       10     
reco:pandoracalo:Calorimetry                          0.000235514   0.000847833    0.002174     0.000413146   0.000728841      10     
reco:pandorapid:Chi2ParticleID                        4.5861e-05    0.000160929   0.000780952   0.000103422   0.000208075      10     
reco:linecluster:LineCluster                           0.955479       1.06148       1.43253       1.00438      0.137865        10     
reco:trajcluster:TrajCluster                           0.210107      0.261225      0.327235      0.264301      0.035699        10     
reco:pmtracktc:PMAlgTrackMaker                          4.01278       5.13337       6.72502       5.02725      0.696717        10     
reco:emtrkmichelid:EmTrackMichelId                      103.17        114.67        124.352       116.466       6.31595        10     
reco:solarflash:SolarOpFlash                            1.06813       1.22306       1.57585       1.21029      0.154971        10     
[art]:TriggerResults:TriggerResultInserter            2.2361e-05    3.70057e-05   8.8311e-05    3.0391e-05    1.85133e-05      10     
end_path:out1:RootOutput                               5.69e-06     1.0325e-05     3.28e-05      7.685e-06    7.66616e-06      10     
end_path:out1:RootOutput(write)                        0.162764      0.211546      0.277471      0.209719      0.0361258       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4030.18 MB
  Peak resident set size usage (VmHWM): 2511.81 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T225526Z_gen_002551_supernova_g4stage1_g4stage2_detsim_reco_20250702T173718Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T225526Z_gen_002551_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
old_md.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T225526Z_gen_002551_supernova_g4stage1_g4stage2_detsim_reco_20250702T173718Z_reco2.root
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T225526Z_gen_002551_supernova_g4stage1_g4stage2_detsim_reco_20250702T173718Z_reco2.root.ext.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250125T225526Z_gen_002551_supernova_g4stage1_g4stage2_detsim_reco_20250702T173718Z_reco2.root.json
reco2_hist.root
justIN time: 2025-08-15 01:26:14 UTC       justIN version: 01.03.02