justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 295402.2@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID295402.2@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4135
Stage ID1
User nameosbiston@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-19 01:36:43
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce01
Last heartbeat2024-11-19 07:56:46
From worker nodeHostnameccwcondor0656
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-19 03:05:56
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193304Z_gen_000214_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (17429s)
CPU time4h (16829s = 96%)
Outputting started2024-11-19 07:56:26
Output files
Finished2024-11-19 07:56:46
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-vd/a0/14/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193304Z_gen_000214_supernova_g4stage1_g4stage2_detsim_reco.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
Boundary wire vector sizes: 6861, 6812, 6710
minwire 0: 19
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1896, 2395
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0790834, 
Output 1: 0.0311242, 0.057335, 0.094558, 0.816983, 
Output 2: 0.15855, 0.313719, 0.471195, 0.056536, 
Output 3: 0.962022, 0.0318477, 0.00213692, 0.00399358, 
Output 4: 0.348227, 0.61074, 0.0389325, 0.00210001, 
Output 5: 0.915679, 0.0767376, 0.0056067, 0.00197646, 
Output 6: 0.00770053, 0.0321774, 0.0486994, 0.911423, 

Begin processing the 8th record. run: 3799 subRun: 0 event: 2138 at 19-Nov-2024 07:27:54 CET
Boundary wire vector sizes: 6469, 6441, 6433
minwire 0: 32
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 474, 973
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0747561, 
Output 1: 0.0659235, 0.0963154, 0.125437, 0.712324, 
Output 2: 0.0354929, 0.162909, 0.786203, 0.0153952, 
Output 3: 0.950479, 0.0388542, 0.00459034, 0.00607642, 
Output 4: 0.701951, 0.217659, 0.0628388, 0.0175516, 
Output 5: 0.660284, 0.260153, 0.0636009, 0.0159617, 
Output 6: 0.0225544, 0.0585185, 0.0674903, 0.851437, 

Begin processing the 9th record. run: 3799 subRun: 0 event: 2139 at 19-Nov-2024 07:57:02 CET
Boundary wire vector sizes: 6584, 6541, 6468
minwire 0: 40
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0841932, 
Output 1: 0.0525222, 0.0771343, 0.104472, 0.765872, 
Output 2: 0.0634547, 0.201544, 0.718987, 0.0160144, 
Output 3: 0.949755, 0.0447657, 0.00225961, 0.00321969, 
Output 4: 0.232961, 0.666433, 0.0924992, 0.00810597, 
Output 5: 0.535255, 0.389838, 0.0616672, 0.0132398, 
Output 6: 0.0404833, 0.134441, 0.126603, 0.698472, 

Begin processing the 10th record. run: 3799 subRun: 0 event: 2140 at 19-Nov-2024 08:26:33 CET
Boundary wire vector sizes: 6616, 6670, 6711
minwire 0: 10
minwire 1: 0
minwire 2: 2
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.079408, 
Output 1: 0.0499641, 0.0454786, 0.106041, 0.798516, 
Output 2: 0.0839125, 0.281339, 0.595975, 0.0387735, 
Output 3: 0.903808, 0.0749107, 0.01117, 0.0101119, 
Output 4: 0.3477, 0.550744, 0.0926142, 0.00894161, 
Output 5: 0.741663, 0.22415, 0.0284595, 0.0057277, 
Output 6: 0.0257156, 0.0884389, 0.0966388, 0.789207, 

19-Nov-2024 08:56:24 CET  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193304Z_gen_000214_supernova_g4stage1_g4stage2_detsim_reco_matt_2024-11-19T_030601Z.root"
19-Nov-2024 08:56:24 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-vd/a0/14/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193304Z_gen_000214_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1701.83       1732.26       1786.38       1723.91       25.8567        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000784037   0.00225125     0.0107121     0.0011437    0.00286235       10     
reco:pandora:StandardPandora                            1700.17       1730.27       1784.53       1721.11       25.8929        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000241605   0.00341404     0.029591     0.000308597   0.00874125       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000223912   0.00058898    0.00307143    0.000284206   0.000833672      10     
reco:pandoracalo:Calorimetry                          0.00132688     0.0205531     0.0287185     0.023011     0.00716981       10     
reco:pandorapid:Chi2ParticleID                         5.307e-05    0.000127433   0.000665986   7.2472e-05    0.000179648      10     
reco:cvnmap:CVNMapper                                  0.0435934     0.0583241     0.0744197     0.0583291    0.00862289       10     
reco:cvneva:CVNEvaluator                               0.966681       1.36158       3.13451       1.19245      0.595029        10     
reco:energyrecnumu:EnergyReco                          0.0642834     0.0786026     0.0912357     0.0791451     0.0089306       10     
reco:energyrecnue:EnergyReco                           0.0103248     0.0111213     0.0128587     0.0105672     0.0010026       10     
reco:energyrecnc:EnergyReco                            0.0101904     0.0115823     0.0179336     0.0104499    0.00230404       10     
[art]:TriggerResults:TriggerResultInserter            1.5981e-05    2.61273e-05   9.4007e-05    1.8635e-05    2.27065e-05      10     
end_path:out1:RootOutput                               8.566e-06    1.18533e-05   3.4485e-05     9.438e-06    7.55841e-06      10     
end_path:out1:RootOutput(write)                        0.361871      0.439056      0.507582       0.42566      0.0465022       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12966.4 MB
  Peak resident set size usage (VmHWM): 2783.42 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2024-11-24 04:43:09 UTC       justIN version: 01.01.09