justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 425396.166@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID425396.166@justin-prod-sched01.dune.hep.ac.uk
Workflow ID8045
Stage ID1
User namehiguera@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
GPUNo
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-07-01 05:12:55
SiteUK_QMUL
EntryDUNE_UK_London_QMUL_arcce03
Last heartbeat2025-07-01 13:44:54
From worker nodeHostnamecn028.htc.esc.qmul
cpuinfoIntel(R) Xeon(R) Gold 6248R CPU @ 3.00GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-07-01 05:33:02
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T203947Z_gen_003778_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time7h (26582s)
CPU time7h (26097s = 98%)
Max RSS bytes2572390400 (2453 MiB)
Outputting started2025-07-01 12:56:05
Output filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T203947Z_gen_003778_supernova_g4stage1_g4stage2_detsim_reco_20250701T053309Z_reco2.root
Finished2025-07-01 13:44:54
Saved logsjustin-logs:425396.166-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  01-Jul-2025 13:50:51 BST run: 4992 subRun: 0 event: 37780
Comparing two wires in the same plane: return failure
%MSG
01-Jul-2025 13:55:59 BST  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T203947Z_gen_003778_supernova_g4stage1_g4stage2_detsim_reco_20250701T053309Z_reco2.root"
01-Jul-2025 13:55:59 BST  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-vd/8c/11/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T203947Z_gen_003778_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2185.07       2622.77       2921.56       2672.32       225.085        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00432812     0.0308036      0.11874      0.0103106     0.0422381       10     
reco:pandora:StandardPandora                            1929.88       2287.61       2549.01       2348.39       198.809        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000307659    0.0140501     0.0956262    0.00669899     0.0273785       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000240532   0.00476026     0.0281273    0.00158816     0.0081569       10     
reco:pandoracalo:Calorimetry                          0.000277459   0.00255752    0.00800926    0.000698429   0.00314634       10     
reco:pandorapid:Chi2ParticleID                        6.5312e-05    0.000423034   0.00322226    9.2442e-05    0.000934214      10     
reco:linecluster:LineCluster                           0.984619       1.06261       1.49169       1.0174       0.145131        10     
reco:trajcluster:TrajCluster                            0.29676      0.443524      0.598767      0.445169      0.0849212       10     
reco:pmtracktc:PMAlgTrackMaker                          4.56451       8.73833       12.1908       8.94762       2.47861        10     
reco:emtrkmichelid:EmTrackMichelId                      239.889       323.194       365.825       341.064       45.2456        10     
reco:solarflash:SolarOpFlash                            1.08245       1.34447       1.61071       1.41207      0.159392        10     
[art]:TriggerResults:TriggerResultInserter            2.3562e-05    4.65423e-05   0.000165166   3.4232e-05    4.01121e-05      10     
end_path:out1:RootOutput                               6.193e-06    1.09972e-05   4.1509e-05    7.6945e-06    1.02023e-05      10     
end_path:out1:RootOutput(write)                        0.208723      0.327837      0.422116       0.34123      0.0682815       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 4038.04 MB
  Peak resident set size usage (VmHWM): 2572.39 MB
====================================================================================================
Art has completed and will exit with status 0.
Moving on to metadata extractor 
============OUTPUT FILE:  prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T203947Z_gen_003778_supernova_g4stage1_g4stage2_detsim_reco_20250701T053309Z_reco2.root
Extracted metadata
checking file====== fardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T203947Z_gen_003778_supernova_g4stage1_g4stage2_detsim_reco.root
MD conversion to MetaCat OK
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
old_md.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T203947Z_gen_003778_supernova_g4stage1_g4stage2_detsim_reco_20250701T053309Z_reco2.root
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T203947Z_gen_003778_supernova_g4stage1_g4stage2_detsim_reco_20250701T053309Z_reco2.root.ext.json
prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20250130T203947Z_gen_003778_supernova_g4stage1_g4stage2_detsim_reco_20250701T053309Z_reco2.root.json
reco2_hist.root
justIN time: 2025-08-14 16:40:21 UTC       justIN version: 01.03.02