justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 233984.36@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID233984.36@justin-prod-sched02.dune.hep.ac.uk
Workflow ID8053
Stage ID1
User namehiguera@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-07-02 18:54:13
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce513
Last heartbeat2025-07-03 10:29:14
From worker nodeHostnameb9p08p2121.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-07-03 06:41:09
Input filesfardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T021804Z_gen_001407_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time3h (13495s)
CPU time3h (13072s = 96%)
Max RSS bytes2526715904 (2409 MiB)
Outputting started2025-07-03 10:26:05
Output filesfardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T021804Z_gen_001407_supernova_g4stage1_g4stage2_detsim_reco_20250703T064118Z_reco2.root
Finished2025-07-03 10:29:14
Saved logsjustin-logs:233984.36-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

G-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  03-Jul-2025 12:23:21 CEST run: 5166 subRun: 0 event: 14070
Comparing two wires in the same plane: return failure
%MSG
03-Jul-2025 12:25:59 CEST  Closed output file "prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T021804Z_gen_001407_supernova_g4stage1_g4stage2_detsim_reco_20250703T064118Z_reco2.root"
03-Jul-2025 12:25:59 CEST  Closed input file "root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/fardet-vd/5f/cc/prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T021804Z_gen_001407_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1213.8        1332.08       1567.74       1315.13       88.5134        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00286202     0.0282874     0.133192      0.0097282     0.0417257       10     
reco:pandora:StandardPandora                            1072.43       1171.04       1386.63       1151.11       80.3006        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000234235   0.00547786     0.0417742    0.00107091     0.0121794       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000227485   0.00175891    0.00773352    0.00105697     0.002269        10     
reco:pandoracalo:Calorimetry                          0.000263857   0.00138906    0.00371757    0.00117004    0.00114637       10     
reco:pandorapid:Chi2ParticleID                        4.2151e-05    0.000166386   0.000977954   8.1442e-05    0.000271463      10     
reco:linecluster:LineCluster                            0.42687      0.485597      0.688006      0.459743      0.0746027       10     
reco:trajcluster:TrajCluster                           0.232196      0.326973      0.364965      0.338353      0.0358242       10     
reco:pmtracktc:PMAlgTrackMaker                          6.02557       7.12714       8.07152       7.03217      0.687059        10     
reco:emtrkmichelid:EmTrackMichelId                      133.572       152.093       171.228       153.565       11.7824        10     
reco:solarflash:SolarOpFlash                           0.603037      0.731254      0.782081      0.758546      0.0573178       10     
[art]:TriggerResults:TriggerResultInserter            2.1391e-05    3.92962e-05   9.1732e-05    3.3476e-05    1.84387e-05      10     
end_path:out1:RootOutput                               7.81e-06     1.29243e-05   3.5461e-05    1.0185e-05    7.76995e-06      10     
end_path:out1:RootOutput(write)                        0.186325      0.239139      0.274491       0.24905      0.0321806       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4040.15 MB
  Peak resident set size usage (VmHWM): 2526.72 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T021804Z_gen_001407_supernova_g4stage1_g4stage2_detsim_reco_20250703T064118Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T021804Z_gen_001407_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
old_md.json
prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T021804Z_gen_001407_supernova_g4stage1_g4stage2_detsim_reco_20250703T064118Z_reco2.root
prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T021804Z_gen_001407_supernova_g4stage1_g4stage2_detsim_reco_20250703T064118Z_reco2.root.ext.json
prodmarley_nue_es_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250214T021804Z_gen_001407_supernova_g4stage1_g4stage2_detsim_reco_20250703T064118Z_reco2.root.json
reco2_hist.root
justIN time: 2025-08-15 08:08:02 UTC       justIN version: 01.03.02