justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 296476.2@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID296476.2@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4135
Stage ID1
User nameosbiston@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-19 08:39:57
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce01
Last heartbeat2024-11-20 01:12:06
From worker nodeHostnameccwcondor0606
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-19 20:42:44
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193158Z_gen_000044_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time4h (16136s)
CPU time4h (15474s = 95%)
Outputting started2024-11-20 01:11:41
Output files
Finished2024-11-20 01:12:06
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-vd/27/d9/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193158Z_gen_000044_supernova_g4stage1_g4stage2_detsim_reco.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
minwire 0: 17
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2069, 2568
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.118284, 
Output 1: 0.0945094, 0.0567826, 0.100965, 0.747743, 
Output 2: 0.0302419, 0.112175, 0.846746, 0.0108377, 
Output 3: 0.986884, 0.00761007, 0.000680934, 0.00482484, 
Output 4: 0.3035, 0.619521, 0.0686945, 0.00828414, 
Output 5: 0.287388, 0.43862, 0.204427, 0.0695656, 
Output 6: 0.0385946, 0.0952276, 0.0994959, 0.766682, 

Begin processing the 8th record. run: 3799 subRun: 0 event: 438 at 20-Nov-2024 00:59:43 CET
Boundary wire vector sizes: 6772, 6731, 6751
minwire 0: 53
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1838, 2337
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.091903, 
Output 1: 0.0731584, 0.0747622, 0.104322, 0.747758, 
Output 2: 0.0823484, 0.321872, 0.561569, 0.0342111, 
Output 3: 0.925332, 0.0383318, 0.00903531, 0.0273005, 
Output 4: 0.516533, 0.417734, 0.0582375, 0.00749613, 
Output 5: 0.640635, 0.330605, 0.0252628, 0.00349658, 
Output 6: 0.0136526, 0.0336284, 0.0532737, 0.899445, 

Begin processing the 9th record. run: 3799 subRun: 0 event: 439 at 20-Nov-2024 01:23:03 CET
Boundary wire vector sizes: 6539, 6473, 6479
minwire 0: 89
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0986097, 
Output 1: 0.10477, 0.128846, 0.114682, 0.651702, 
Output 2: 0.0494169, 0.164947, 0.775897, 0.0097386, 
Output 3: 0.976917, 0.021219, 0.0005548, 0.00130885, 
Output 4: 0.445685, 0.494131, 0.0536973, 0.00648723, 
Output 5: 0.400234, 0.482502, 0.0952959, 0.0219681, 
Output 6: 0.0394482, 0.112276, 0.109669, 0.738607, 

Begin processing the 10th record. run: 3799 subRun: 0 event: 440 at 20-Nov-2024 01:48:03 CET
Boundary wire vector sizes: 6691, 6583, 6712
minwire 0: 36
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2347, 2846
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.101885, 
Output 1: 0.0413543, 0.0731362, 0.0944849, 0.791025, 
Output 2: 0.0404719, 0.232129, 0.701326, 0.0260735, 
Output 3: 0.954415, 0.0252806, 0.00599228, 0.0143121, 
Output 4: 0.627011, 0.30032, 0.0621126, 0.0105567, 
Output 5: 0.496923, 0.384837, 0.100799, 0.0174418, 
Output 6: 0.0110082, 0.0315125, 0.0507985, 0.906681, 

20-Nov-2024 02:11:39 CET  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193158Z_gen_000044_supernova_g4stage1_g4stage2_detsim_reco_matt_2024-11-19T_204252Z.root"
20-Nov-2024 02:11:39 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-vd/27/d9/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193158Z_gen_000044_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1396.74       1600.34       1863.68       1585.43       159.871        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000804836   0.00936163     0.0269948    0.00120103     0.0108104       10     
reco:pandora:StandardPandora                            1394.87       1598.17       1858.8        1583.61       159.362        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000237865   0.00718227     0.0676355    0.000326938    0.0201555       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000232155   0.000726989   0.00466524    0.000292868   0.00131303       10     
reco:pandoracalo:Calorimetry                          0.00187454     0.0377941     0.0651243     0.0382593     0.0154242       10     
reco:pandorapid:Chi2ParticleID                        6.1325e-05    0.000165757   0.000895708   8.35915e-05   0.000243686      10     
reco:cvnmap:CVNMapper                                  0.0511894     0.0653252     0.0845658     0.0631758    0.00944181       10     
reco:cvneva:CVNEvaluator                                1.1708        1.53292       4.07317       1.26777      0.847812        10     
reco:energyrecnumu:EnergyReco                          0.0584714     0.0819147     0.150004      0.0713527     0.0274926       10     
reco:energyrecnue:EnergyReco                          0.00925754     0.0109197     0.021937     0.00958495    0.00369954       10     
reco:energyrecnc:EnergyReco                           0.00924958    0.00957027     0.0101293    0.00948015    0.000262609      10     
[art]:TriggerResults:TriggerResultInserter            1.4778e-05    3.05751e-05   9.7161e-05    2.39045e-05   2.28013e-05      10     
end_path:out1:RootOutput                               7.634e-06    1.36005e-05   3.3594e-05    1.0815e-05    7.89428e-06      10     
end_path:out1:RootOutput(write)                        0.396313      0.416693      0.465895      0.406368      0.023294        10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 19412.5 MB
  Peak resident set size usage (VmHWM): 2748.94 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2024-11-24 04:24:52 UTC       justIN version: 01.01.09