justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 426042.129@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID426042.129@justin-prod-sched01.dune.hep.ac.uk
Workflow ID8057
Stage ID1
User nameepennacc@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-07-02 07:31:02
SiteBR_CBPF
EntryDUNE_BR_CBPF_ce01
Last heartbeat2025-07-02 15:37:12
From worker nodeHostnamewn47
cpuinfoIntel(R) Xeon(R) CPU E5-2640 v4 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-07-02 07:43:08
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250127T123350Z_gen_001819_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time7h (27923s)
CPU time7h (25717s = 92%)
Max RSS bytes2565890048 (2447 MiB)
Outputting started2025-07-02 15:28:33
Output filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250127T123350Z_gen_001819_supernova_g4stage1_g4stage2_detsim_reco_20250702T074410Z_reco2.root
Finished2025-07-02 15:37:12
Saved logsjustin-logs:426042.129-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:38 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:38 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:38 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:38 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:38 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:38 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:38 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:38 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:38 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:38 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:38 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:38 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:38 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:38 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:38 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:38 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:38 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:38 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:38 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:39 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:39 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:39 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:39 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:39 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:39 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:39 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:39 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  02-Jul-2025 12:23:39 -03 run: 4941 subRun: 0 event: 18190
Comparing two wires in the same plane: return failure
%MSG
02-Jul-2025 12:28:24 -03  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250127T123350Z_gen_001819_supernova_g4stage1_g4stage2_detsim_reco_20250702T074410Z_reco2.root"
02-Jul-2025 12:28:24 -03  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/13/45/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250127T123350Z_gen_001819_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2552.43       2619.81        2765         2595.32       59.5492        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00704877     0.0386134     0.159121      0.0107538     0.057292        10     
reco:pandora:StandardPandora                            2288.63       2340.45       2473.89       2319.89       53.9965        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000228633   0.00690075     0.0473382    0.00386472     0.0135962       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.00028934    0.00226309     0.0126399    0.00144161    0.00351839       10     
reco:pandoracalo:Calorimetry                          0.000302726   0.00173255    0.00384404    0.000694747    0.0014646       10     
reco:pandorapid:Chi2ParticleID                        6.0908e-05    0.000240711   0.00133482    0.000133081   0.000367135      10     
reco:linecluster:LineCluster                            1.41435       2.18492       2.80171       2.23792      0.514264        10     
reco:trajcluster:TrajCluster                           0.429854       0.50049      0.554531      0.497611      0.0311362       10     
reco:pmtracktc:PMAlgTrackMaker                          8.68895       9.90706       11.2592       10.0618      0.701706        10     
reco:emtrkmichelid:EmTrackMichelId                      250.376       263.736       278.768       262.001       7.71989        10     
reco:solarflash:SolarOpFlash                            1.95712       2.54371       2.94896       2.56937      0.269677        10     
[art]:TriggerResults:TriggerResultInserter            3.4801e-05    5.10113e-05   9.8695e-05     4.104e-05    2.13691e-05      10     
end_path:out1:RootOutput                               7.858e-06    1.37768e-05   2.6321e-05    9.1745e-06    6.76885e-06      10     
end_path:out1:RootOutput(write)                        0.415525      0.435601      0.468234      0.433082      0.0144571       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4042.89 MB
  Peak resident set size usage (VmHWM): 2565.89 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250127T123350Z_gen_001819_supernova_g4stage1_g4stage2_detsim_reco_20250702T074410Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250127T123350Z_gen_001819_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
old_md.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250127T123350Z_gen_001819_supernova_g4stage1_g4stage2_detsim_reco_20250702T074410Z_reco2.root
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250127T123350Z_gen_001819_supernova_g4stage1_g4stage2_detsim_reco_20250702T074410Z_reco2.root.ext.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250127T123350Z_gen_001819_supernova_g4stage1_g4stage2_detsim_reco_20250702T074410Z_reco2.root.json
reco2_hist.root
justIN time: 2025-08-14 18:21:29 UTC       justIN version: 01.03.02