justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 295473.1@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID295473.1@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4134
Stage ID1
User nameosbiston@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-19 02:06:03
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce01
Last heartbeat2024-11-19 16:45:40
From worker nodeHostnameccwcondor0540
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-19 10:49:15
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T221256Z_gen_001603_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time5h (21364s)
CPU time5h (20420s = 95%)
Outputting started2024-11-19 16:45:20
Output files
Finished2024-11-19 16:45:40
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-vd/5a/8f/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T221256Z_gen_001603_supernova_g4stage1_g4stage2_detsim_reco.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
Boundary wire vector sizes: 6810, 6726, 6717
minwire 0: 43
minwire 1: 0
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.151259, 
Output 1: 0.0925114, 0.136178, 0.235942, 0.535369, 
Output 2: 0.0476684, 0.151962, 0.761259, 0.0391096, 
Output 3: 0.97154, 0.0158526, 0.00371031, 0.00889681, 
Output 4: 0.570608, 0.394147, 0.0315275, 0.00371742, 
Output 5: 0.380576, 0.334447, 0.201965, 0.0830115, 
Output 6: 0.0387019, 0.0937816, 0.0876768, 0.77984, 

Begin processing the 8th record. run: 3799 subRun: 0 event: 16028 at 19-Nov-2024 15:57:30 CET
Boundary wire vector sizes: 6720, 6711, 6620
minwire 0: 38
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.111026, 
Output 1: 0.102075, 0.175596, 0.155286, 0.567042, 
Output 2: 0.0670113, 0.147411, 0.759785, 0.0257929, 
Output 3: 0.976587, 0.0175354, 0.00136006, 0.00451719, 
Output 4: 0.653875, 0.319765, 0.022701, 0.00365896, 
Output 5: 0.389536, 0.369096, 0.162915, 0.0784521, 
Output 6: 0.0662586, 0.131372, 0.107013, 0.695356, 

Begin processing the 9th record. run: 3799 subRun: 0 event: 16029 at 19-Nov-2024 16:33:12 CET
Boundary wire vector sizes: 6532, 6467, 6696
minwire 0: 44
minwire 1: 0
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2160, 2659
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0426959, 
Output 1: 0.0224129, 0.0639213, 0.0496575, 0.864008, 
Output 2: 0.049148, 0.229693, 0.696997, 0.0241611, 
Output 3: 0.915906, 0.0660756, 0.00887609, 0.00914238, 
Output 4: 0.939443, 0.0493779, 0.00824717, 0.00293243, 
Output 5: 0.412943, 0.452823, 0.117729, 0.0165053, 
Output 6: 0.00975324, 0.0406878, 0.0556535, 0.893905, 

Begin processing the 10th record. run: 3799 subRun: 0 event: 16030 at 19-Nov-2024 17:09:33 CET
Boundary wire vector sizes: 6674, 6571, 6553
minwire 0: 73
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2248, 2747
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0866261, 
Output 1: 0.0687529, 0.0723064, 0.164185, 0.694755, 
Output 2: 0.0501431, 0.116659, 0.819585, 0.0136129, 
Output 3: 0.974303, 0.018186, 0.00189036, 0.00562006, 
Output 4: 0.379382, 0.525293, 0.0810654, 0.0142597, 
Output 5: 0.623268, 0.312338, 0.0495604, 0.0148327, 
Output 6: 0.0343347, 0.0836729, 0.0794547, 0.802538, 

19-Nov-2024 17:45:18 CET  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T221256Z_gen_001603_supernova_g4stage1_g4stage2_detsim_reco_matt_2024-11-19T_104924Z.root"
19-Nov-2024 17:45:19 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-vd/5a/8f/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T221256Z_gen_001603_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2025.5        2122.98       2176.39       2145.13       50.0631        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00108925    0.00508959     0.0194424     0.0018262    0.00598707       10     
reco:pandora:StandardPandora                            2023.55       2120.81       2174.5        2143.19       50.3164        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000319172   0.00119912     0.004629     0.000363837   0.00132574       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000287443   0.000768208   0.00485334    0.000316292    0.0013618       10     
reco:pandoracalo:Calorimetry                          0.00251857     0.0353875     0.0634475     0.0331021     0.0147195       10     
reco:pandorapid:Chi2ParticleID                        7.9571e-05    0.000195391   0.00116765    8.58915e-05   0.000324173      10     
reco:cvnmap:CVNMapper                                  0.0703889     0.0922205     0.131388      0.0832121     0.0210064       10     
reco:cvneva:CVNEvaluator                                1.18434       1.47208       3.41588       1.24448      0.650673        10     
reco:energyrecnumu:EnergyReco                          0.0705368     0.0875554     0.131296      0.0772594     0.0190806       10     
reco:energyrecnue:EnergyReco                           0.0103097     0.0106652     0.0115028     0.0105308    0.000332749      10     
reco:energyrecnc:EnergyReco                            0.0104325     0.011988      0.0219067     0.0108063    0.00333374       10     
[art]:TriggerResults:TriggerResultInserter            1.8906e-05     2.961e-05    9.6552e-05    2.2087e-05    2.24802e-05      10     
end_path:out1:RootOutput                              1.2013e-05    1.99325e-05   5.5083e-05    1.31795e-05   1.3063e-05       10     
end_path:out1:RootOutput(write)                        0.396363      0.452039      0.571919      0.434391      0.0561285       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12978.8 MB
  Peak resident set size usage (VmHWM): 2621.49 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2024-11-24 04:41:01 UTC       justIN version: 01.01.09