justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 297432.161@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID297432.161@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4146
Stage ID1
User nameosbiston@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-19 21:22:43
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep207
Last heartbeat2024-11-20 01:47:41
From worker nodeHostnameheplnc166.pp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-19 21:23:44
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T223714Z_gen_003368_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (15810s)
CPU time4h (15088s = 95%)
Outputting started2024-11-20 01:47:14
Output files
Finished2024-11-20 01:47:41
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-vd/b6/cf/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T223714Z_gen_003368_supernova_g4stage1_g4stage2_detsim_reco.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
Boundary wire vector sizes: 6689, 6575, 6541
minwire 0: 30
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.132908, 
Output 1: 0.0532351, 0.153593, 0.257489, 0.535683, 
Output 2: 0.0401276, 0.12749, 0.812947, 0.0194357, 
Output 3: 0.953617, 0.0399458, 0.00356344, 0.00287426, 
Output 4: 0.384021, 0.528887, 0.0782539, 0.00883751, 
Output 5: 0.356144, 0.389922, 0.197035, 0.0568985, 
Output 6: 0.0650918, 0.134804, 0.106025, 0.694079, 

Begin processing the 8th record. run: 3799 subRun: 0 event: 33678 at 20-Nov-2024 00:32:30 GMT
Boundary wire vector sizes: 6840, 6719, 6762
minwire 0: 31
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1002, 1501
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0885197, 
Output 1: 0.0576987, 0.0922219, 0.15489, 0.695189, 
Output 2: 0.0482904, 0.201218, 0.734522, 0.0159694, 
Output 3: 0.92509, 0.0635985, 0.00605392, 0.00525785, 
Output 4: 0.369645, 0.513893, 0.103643, 0.012819, 
Output 5: 0.513891, 0.420114, 0.0578501, 0.00814547, 
Output 6: 0.0270332, 0.0881492, 0.0938743, 0.790943, 

Begin processing the 9th record. run: 3799 subRun: 0 event: 33679 at 20-Nov-2024 00:57:43 GMT
Boundary wire vector sizes: 6708, 6645, 6707
minwire 0: 31
minwire 1: 0
minwire 2: 2
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.127063, 
Output 1: 0.0523342, 0.0402529, 0.13334, 0.774073, 
Output 2: 0.0402944, 0.112814, 0.828556, 0.0183352, 
Output 3: 0.98346, 0.00981371, 0.00134412, 0.00538262, 
Output 4: 0.359276, 0.580635, 0.0540638, 0.00602533, 
Output 5: 0.271317, 0.466374, 0.206816, 0.055493, 
Output 6: 0.0228021, 0.065931, 0.073744, 0.837523, 

Begin processing the 10th record. run: 3799 subRun: 0 event: 33680 at 20-Nov-2024 01:22:03 GMT
Boundary wire vector sizes: 6624, 6564, 6481
minwire 0: 35
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1643, 2142
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0812626, 
Output 1: 0.0514078, 0.077774, 0.101066, 0.769752, 
Output 2: 0.0467679, 0.241431, 0.683124, 0.0286776, 
Output 3: 0.955511, 0.027875, 0.00561737, 0.0109969, 
Output 4: 0.64046, 0.302791, 0.0497466, 0.00700248, 
Output 5: 0.655422, 0.275219, 0.0575182, 0.011841, 
Output 6: 0.0173557, 0.0447061, 0.0579529, 0.879985, 

20-Nov-2024 01:47:13 GMT  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T223714Z_gen_003368_supernova_g4stage1_g4stage2_detsim_reco_matt_2024-11-19T_212350Z.root"
20-Nov-2024 01:47:13 GMT  Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-vd/b6/cf/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T223714Z_gen_003368_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1453.25       1564.9        1725.14       1515.68       99.969         10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000989707   0.00832911     0.045954     0.00112054     0.0149016       10     
reco:pandora:StandardPandora                            1450.65       1562.12       1720.12       1513.26       99.4845        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000301001   0.00474841     0.0410727    0.000355683    0.0121235       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000261308   0.000884942   0.00537968    0.000372009   0.00150002       10     
reco:pandoracalo:Calorimetry                          0.00240892     0.0258136     0.0337882     0.0269736    0.00887959       10     
reco:pandorapid:Chi2ParticleID                        6.6294e-05    0.000206788   0.00122634     9.394e-05    0.000340173      10     
reco:cvnmap:CVNMapper                                  0.0765105     0.102766       0.28691      0.0835588     0.0615342       10     
reco:cvneva:CVNEvaluator                                1.1873        1.71774       3.73153       1.61433      0.690604        10     
reco:energyrecnumu:EnergyReco                          0.146828      0.362592       0.55091      0.335996      0.114907        10     
reco:energyrecnue:EnergyReco                          0.00878496     0.0119314     0.0135263     0.0119322    0.00123958       10     
reco:energyrecnc:EnergyReco                            0.0078066     0.012016      0.0138978     0.0123411    0.00156836       10     
[art]:TriggerResults:TriggerResultInserter             1.583e-05    3.9527e-05    0.000147335   2.4586e-05    3.87605e-05      10     
end_path:out1:RootOutput                              1.1792e-05    2.0845e-05    6.5693e-05    1.45475e-05   1.61155e-05      10     
end_path:out1:RootOutput(write)                        0.322887      0.530242      0.663649      0.525533      0.0849149       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 38741.4 MB
  Peak resident set size usage (VmHWM): 2706.6 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2024-11-21 16:32:22 UTC       justIN version: 01.01.09