justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 295473.3@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID295473.3@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4134
Stage ID1
User nameosbiston@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-19 02:06:03
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce01
Last heartbeat2024-11-19 16:46:39
From worker nodeHostnameccwcondor0540
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2097152000 (2000 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-19 10:49:44
Input filesfardet-vd:prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193238Z_gen_000140_supernova_g4stage1_g4stage2_detsim_reco.root
JobscriptExit code0
Real time5h (21395s)
CPU time5h (20462s = 95%)
Outputting started2024-11-19 16:46:20
Output files
Finished2024-11-19 16:46:39
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-vd/0a/2b/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193238Z_gen_000140_supernova_g4stage1_g4stage2_detsim_reco.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
minwire 0: 13
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2117, 2616
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.104109, 
Output 1: 0.0796805, 0.0719471, 0.0841448, 0.764228, 
Output 2: 0.0590329, 0.30886, 0.611586, 0.0205212, 
Output 3: 0.970933, 0.0164942, 0.0022977, 0.0102756, 
Output 4: 0.437472, 0.493568, 0.0627725, 0.00618783, 
Output 5: 0.529993, 0.432101, 0.034008, 0.0038979, 
Output 6: 0.0116712, 0.0347187, 0.0563286, 0.897282, 

Begin processing the 8th record. run: 3799 subRun: 0 event: 1398 at 19-Nov-2024 15:58:53 CET
Boundary wire vector sizes: 6745, 6756, 6658
minwire 0: 22
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.108568, 
Output 1: 0.306407, 0.0776379, 0.219113, 0.396842, 
Output 2: 0.0321082, 0.0648422, 0.895706, 0.00734305, 
Output 3: 0.969897, 0.0264602, 0.00119308, 0.00244949, 
Output 4: 0.576926, 0.375516, 0.0377411, 0.00981752, 
Output 5: 0.236698, 0.450871, 0.218876, 0.093555, 
Output 6: 0.0881158, 0.207488, 0.132585, 0.571812, 

Begin processing the 9th record. run: 3799 subRun: 0 event: 1399 at 19-Nov-2024 16:34:47 CET
Boundary wire vector sizes: 6644, 6591, 6573
minwire 0: 31
minwire 1: 0
minwire 2: 1
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1875, 2374
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.120889, 
Output 1: 0.0584116, 0.0442525, 0.0473109, 0.850025, 
Output 2: 0.0874278, 0.350513, 0.54022, 0.0218395, 
Output 3: 0.980631, 0.0157517, 0.000750646, 0.00286624, 
Output 4: 0.285705, 0.629603, 0.0790206, 0.0056718, 
Output 5: 0.493126, 0.456821, 0.0440635, 0.00598969, 
Output 6: 0.0193673, 0.0648052, 0.094262, 0.821566, 

Begin processing the 10th record. run: 3799 subRun: 0 event: 1400 at 19-Nov-2024 17:10:55 CET
Boundary wire vector sizes: 6653, 6653, 6691
minwire 0: 65
minwire 1: 0
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 1589, 2088
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.127957, 
Output 1: 0.0726281, 0.0848125, 0.133834, 0.708725, 
Output 2: 0.059292, 0.188952, 0.723591, 0.0281642, 
Output 3: 0.966694, 0.0268081, 0.00238766, 0.00411023, 
Output 4: 0.435912, 0.499475, 0.0583328, 0.00627988, 
Output 5: 0.384082, 0.398265, 0.168213, 0.0494399, 
Output 6: 0.0461634, 0.114999, 0.11027, 0.728567, 

19-Nov-2024 17:46:19 CET  Closed output file "prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193238Z_gen_000140_supernova_g4stage1_g4stage2_detsim_reco_matt_2024-11-19T_104949Z.root"
19-Nov-2024 17:46:19 CET  Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-vd/0a/2b/prodmarley_nue_cc_flat_radiological_decay0_dunevd10kt_1x8x14_3view_30deg_20241023T193238Z_gen_000140_supernova_g4stage1_g4stage2_detsim_reco.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2046.44       2128.07       2168.74       2148.73       40.1765        10     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000955935   0.00622586     0.0258182    0.00140193    0.00822993       10     
reco:pandora:StandardPandora                            2044.69       2126.01       2166.93       2146.91       40.3598        10     
reco:pandoraTrack:LArPandoraTrackCreation             0.000258398   0.00461325     0.0434474    0.000311423    0.0129447       10     
reco:pandoraShower:LArPandoraModularShowerCreation    0.000256304   0.000594379    0.0033209    0.000302491   0.000909149      10     
reco:pandoracalo:Calorimetry                          0.00144962     0.0298195      0.03564      0.0329991    0.00967157       10     
reco:pandorapid:Chi2ParticleID                        6.6987e-05    0.000138279   0.000711702   7.48065e-05   0.000191179      10     
reco:cvnmap:CVNMapper                                  0.0655243     0.0756043     0.104728      0.0728398     0.0101283       10     
reco:cvneva:CVNEvaluator                                1.12473       1.43739       3.31461       1.20972       0.63239        10     
reco:energyrecnumu:EnergyReco                          0.0624789     0.0810353      0.1114       0.0777362     0.015004        10     
reco:energyrecnue:EnergyReco                          0.00971267     0.0107209     0.0115387     0.0106934    0.000455635      10     
reco:energyrecnc:EnergyReco                            0.0103227     0.0105752     0.0108804     0.010582     0.000163717      10     
[art]:TriggerResults:TriggerResultInserter            1.4157e-05    2.75501e-05   0.000105279   1.97875e-05   2.59979e-05      10     
end_path:out1:RootOutput                               8.997e-06    1.28032e-05   3.4415e-05    1.0375e-05    7.2913e-06       10     
end_path:out1:RootOutput(write)                        0.363902      0.410581      0.472595      0.406654      0.0264326       10     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 12968.8 MB
  Peak resident set size usage (VmHWM): 2676.28 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2024-11-24 04:47:21 UTC       justIN version: 01.01.09