justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297432.181@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID297432.181@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4146
Stage ID1
User nameosbiston@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-19 21:22:43
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep207
Last heartbeat2024-11-20 03:07:09
From worker nodeHostnameheplnc145.pp.rl.ac.uk
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-19 21:24:00
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T204854Z_gen_001922_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time5h (20562s)
CPU time5h (19606s = 95%)
Outputting started2024-11-20 03:06:42
Output files
Finished2024-11-20 03:07:09
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-vd/ba/66/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T204854Z_gen_001922_supernova_g4stage1_g4stage2_detsim_reco.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
minwire 0: 9
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 216, 715
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0830373, 
Output 1: 0.0490825, 0.0732706, 0.147636, 0.730011, 
Output 2: 0.0700802, 0.186891, 0.71957, 0.0234587, 
Output 3: 0.94866, 0.0444186, 0.00335368, 0.00356797, 
Output 4: 0.309912, 0.619002, 0.0657206, 0.00536646, 
Output 5: 0.59311, 0.335962, 0.0576248, 0.0133029, 
Output 6: 0.0400798, 0.121045, 0.104486, 0.734389, 

Begin processing the 8th record. run: 3799 subRun: 0 event: 19218 at 20-Nov-2024 01:17:19 GMT
Boundary wire vector sizes: 6657, 6570, 6523
minwire 0: 54
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.136879, 
Output 1: 0.0530005, 0.0478273, 0.178583, 0.720589, 
Output 2: 0.0784933, 0.203907, 0.670926, 0.0466743, 
Output 3: 0.953869, 0.0332843, 0.00517338, 0.00767304, 
Output 4: 0.229282, 0.707505, 0.0596984, 0.00351512, 
Output 5: 0.544886, 0.33088, 0.0969524, 0.0272808, 
Output 6: 0.0242313, 0.0697154, 0.0795566, 0.826497, 

Begin processing the 9th record. run: 3799 subRun: 0 event: 19219 at 20-Nov-2024 01:51:56 GMT
Boundary wire vector sizes: 6576, 6485, 6500
minwire 0: 30
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 278, 777
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0524275, 
Output 1: 0.0333332, 0.0566313, 0.0770913, 0.832944, 
Output 2: 0.0839527, 0.236911, 0.632601, 0.0465356, 
Output 3: 0.941931, 0.0316127, 0.00844888, 0.0180073, 
Output 4: 0.924809, 0.0610814, 0.0100825, 0.00402715, 
Output 5: 0.831927, 0.144552, 0.0185361, 0.00498516, 
Output 6: 0.00522218, 0.0202996, 0.0326179, 0.94186, 

Begin processing the 10th record. run: 3799 subRun: 0 event: 19220 at 20-Nov-2024 02:29:22 GMT
Boundary wire vector sizes: 6951, 6932, 6923
minwire 0: 23
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2306, 2805
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.144649, 
Output 1: 0.137333, 0.137602, 0.28322, 0.441846, 
Output 2: 0.0286652, 0.0685151, 0.893986, 0.00883387, 
Output 3: 0.970323, 0.0264508, 0.0013388, 0.00188693, 
Output 4: 0.413868, 0.511597, 0.063133, 0.0114021, 
Output 5: 0.169936, 0.405486, 0.302376, 0.122202, 
Output 6: 0.0931689, 0.209341, 0.136397, 0.561093, 

20-Nov-2024 03:06:41 GMT  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T204854Z_gen_001922_supernova_g4stage1_g4stage2_detsim_reco_matt_2024-11-19T_212404Z.root"
20-Nov-2024 03:06:41 GMT  Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-vd/ba/66/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T204854Z_gen_001922_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1925.71       2044.55       2241.71       2018.19       105.481        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000669052   0.00522969     0.023287     0.00110654    0.00811778       10     
reco:pandora:StandardPandora                            1921.62       2042.37       2239.75       2016.13       105.669        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000271231   0.00552462     0.0492623    0.000308001    0.014594        10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000272985   0.000786642   0.00511528    0.000313411   0.00144305       10     
reco:pandoracalo:Calorimetry                          0.00238263     0.0311501     0.0369212     0.0344104    0.00975574       10     
reco:pandorapid:Chi2ParticleID                        7.2948e-05    0.000198105   0.00117961    8.8983e-05    0.000327349      10     
reco:cvnmap:CVNMapper                                  0.0578675     0.0698826     0.0814609     0.0700119    0.00803053       10     
reco:cvneva:CVNEvaluator                               0.944437       1.49164       3.37908       1.33624      0.640151        10     
reco:energyrecnumu:EnergyReco                          0.109282      0.141098      0.157755      0.144659      0.0138246       10     
reco:energyrecnue:EnergyReco                           0.0107702     0.0116044     0.0120964     0.0116125    0.000343262      10     
reco:energyrecnc:EnergyReco                            0.0114178     0.011785       0.01254      0.0116391    0.000348277      10     
[art]:TriggerResults:TriggerResultInserter            1.7253e-05    3.09794e-05   0.000124865   1.99775e-05   3.1446e-05       10     
end_path:out1:RootOutput                               9.477e-06    1.34973e-05   3.9194e-05    1.05995e-05    8.595e-06       10     
end_path:out1:RootOutput(write)                        0.323316      0.406252      0.428027      0.416711      0.0305226       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21558.3 MB
  Peak resident set size usage (VmHWM): 2794.07 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2024-11-21 16:14:42 UTC       justIN version: 01.01.09