justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 233676.156@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID233676.156@justin-prod-sched02.dune.hep.ac.uk
Workflow ID8047
Stage ID1
User nameepennacc@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-07-02 07:10:31
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce02
Last heartbeat2025-07-02 11:58:48
From worker nodeHostnameccwcondor0552
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit106200 (29 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-07-02 07:47:51
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T084722Z_gen_002775_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (14854s)
CPU time3h (14124s = 95%)
Max RSS bytes2546573312 (2428 MiB)
Outputting started2025-07-02 11:55:26
Output filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T084722Z_gen_002775_supernova_g4stage1_g4stage2_detsim_reco_20250702T074759Z_reco2.root
Finished2025-07-02 11:58:48
Saved logsjustin-logs:233676.156-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

SG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:39 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:39 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:39 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:39 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:39 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:39 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:39 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:39 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:39 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:39 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:39 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:39 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:39 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:39 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:39 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:39 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:39 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:40 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:40 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:40 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:40 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:40 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:40 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:40 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:40 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:40 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:40 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 13:52:40 CEST run: 5021 subRun: 0 event: 27750
Comparing two wires in the same plane: return failure
%MSG
02-Jul-2025 13:55:22 CEST  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T084722Z_gen_002775_supernova_g4stage1_g4stage2_detsim_reco_20250702T074759Z_reco2.root"
02-Jul-2025 13:55:22 CEST  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/96/d8/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T084722Z_gen_002775_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1371.25       1451.19       1523.84       1442.05       48.5466        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00379966     0.0292392     0.118568      0.0088223     0.0433501       10     
reco:pandora:StandardPandora                            1214.18       1279.98       1348.06       1274.16       44.0492        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000333597    0.0084683     0.0576319    0.00389026     0.0164795       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000334869   0.00234974     0.0131765    0.00112679     0.0036331       10     
reco:pandoracalo:Calorimetry                          0.000308488   0.00108302    0.00404947    0.000368962   0.00137804       10     
reco:pandorapid:Chi2ParticleID                        7.4189e-05    0.000250563   0.00163368    9.5815e-05    0.000461231      10     
reco:linecluster:LineCluster                            1.02909       1.09178       1.47924       1.05216      0.129745        10     
reco:trajcluster:TrajCluster                           0.316613      0.355946       0.39276      0.363394      0.0248223       10     
reco:pmtracktc:PMAlgTrackMaker                          7.63363       9.05601       10.5228       8.82869      0.933113        10     
reco:emtrkmichelid:EmTrackMichelId                      145.905       159.04        171.18        159.816       6.62193        10     
reco:solarflash:SolarOpFlash                            1.29681       1.35912       1.54137       1.34679      0.0668631       10     
[art]:TriggerResults:TriggerResultInserter            2.6359e-05    4.16619e-05   0.000103303   3.64135e-05   2.13036e-05      10     
end_path:out1:RootOutput                               6.112e-06    1.0085e-05    3.7681e-05     7.049e-06    9.22844e-06      10     
end_path:out1:RootOutput(write)                        0.188831      0.258534      0.279867      0.262338      0.0250612       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4055.38 MB
  Peak resident set size usage (VmHWM): 2546.57 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T084722Z_gen_002775_supernova_g4stage1_g4stage2_detsim_reco_20250702T074759Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T084722Z_gen_002775_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
old_md.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T084722Z_gen_002775_supernova_g4stage1_g4stage2_detsim_reco_20250702T074759Z_reco2.root
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T084722Z_gen_002775_supernova_g4stage1_g4stage2_detsim_reco_20250702T074759Z_reco2.root.ext.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250202T084722Z_gen_002775_supernova_g4stage1_g4stage2_detsim_reco_20250702T074759Z_reco2.root.json
reco2_hist.root
justIN time: 2025-08-14 16:38:11 UTC       justIN version: 01.03.02