justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 61258.131@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID61258.131@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2901
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-08-23 21:10:54
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-08-24 01:54:36
From worker nodeHostnamewn2206301.tier2.hep.manchester.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 5118 CPU @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-23 21:12:26
Input filesfardet-hd:nue_dune10kt_1x2x6_1416_70_20230826T223329Z_gen_g4_detsim_hitreco__20240221T171123Z_reco2.root
JobscriptExit code0
Real time4h (16882s)
CPU time4h (16300s = 96%)
Outputting started2024-08-24 01:53:56
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/02901/1/Validation_nue_dune10kt_1x2x6_1416_70_20230826T223329Z_gen_g4_detsim_hitreco__20240221T171123Z_reco2.root
Finished2024-08-24 01:54:36
Saved logsjustin-logs:61258.131-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

DUCTS=/exp/dune/app/users/ismerio/env-testreco/localProducts_larsoft_v09_91_02_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune/testproducts:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/exp/dune/app/users/ismerio/env-testreco/localProducts_larsoft_v09_91_02_e26_prof

local product directory is /exp/dune/app/users/ismerio/env-testreco/localProducts_larsoft_v09_91_02_e26_prof
----------- this block should be empty ------------------
WARNING: Unable to open file /exp/dune/app/users/ismerio/env-testreco/localProducts_larsoft_v09_91_02_e26_prof.
---------------------------------------------------------
Art output set to nue_dune10kt_1x2x6_1416_70_20230826T223329Z_gen_g4_detsim_hitreco__20240221T171123Z_reco2_reco_data_2024-08-23T_211247Z.root
Contents of /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/c5fe39c11c378ea944c1ce1c47f8dbacb94669f9:
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
localProducts_larsoft_v09_91_02_e26_prof
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
lar exit code 0
=== Start last 100 lines of lar log file ===

Event 7100 track shower separation:
Shower initial tracks are:
  0
  45
Track tracks are:
  1
  6
  9
  10
  15
  25
  30
  32
  36
  59
  61
  65
  69
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  24-Aug-2024 02:53:34 BST run: 1416 subRun: 1 event: 7100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  24-Aug-2024 02:53:34 BST run: 1416 subRun: 1 event: 7100
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 1544, 1372, 1405
minwire 0: 2042
minwire 1: 219
minwire 2: 2335
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.104709, 
Output 1: 0.00452567, 0.886557, 0.0920666, 0.016851, 
Output 2: 0.00825204, 0.645905, 0.170443, 0.1754, 
Output 3: 0.0123175, 0.066448, 0.486165, 0.43507, 
Output 4: 0.985042, 0.0133404, 0.0010082, 0.000608965, 
Output 5: 0.98782, 0.0111587, 0.000893699, 0.000127577, 
Output 6: 0.0550085, 0.112363, 0.148749, 0.683878, 

642
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2302!
24-Aug-2024 02:53:46 BST  Closed output file "nue_dune10kt_1x2x6_1416_70_20230826T223329Z_gen_g4_detsim_hitreco__20240221T171123Z_reco2_reco_data_2024-08-23T_211247Z.root"
24-Aug-2024 02:53:46 BST  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/c1/c7/nue_dune10kt_1x2x6_1416_70_20230826T223329Z_gen_g4_detsim_hitreco__20240221T171123Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.503388       166.027       2610.43       82.4109       331.377        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0424329     0.097311      0.262459      0.0860998     0.0425105       100    
reco:linecluster:LineCluster                           0.0823296      2.11428       58.714       0.315605       8.93449        100    
reco:trajcluster:TrajCluster                           0.025624       11.3577       257.608      0.809232       39.4631        100    
reco:pandora:StandardPandora                           0.0562353      11.0793       345.534       3.42787       36.8632        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000239663    0.0399501     0.746322       0.01742      0.0897158       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000300182    0.0372835     0.325569      0.0210871     0.0499742       100    
reco:pandoracalo:Calorimetry                          0.000178803    0.155122       7.36191      0.0259288     0.751648        100    
reco:pandorapid:Chi2ParticleID                        6.2647e-05    0.000441809   0.00301594    0.000373046   0.000382233      100    
reco:trkshowersplit:TrackShowerHits                   9.9658e-05     0.127162       2.82189      0.022448      0.371779        100    
reco:pmtrack:PMAlgTrackMaker                          0.00168649      17.2273       272.661       5.84869       39.6614        100    
reco:pmtrackcalo:Calorimetry                          0.000117436    0.0908766      2.28139      0.0204133      0.2811         100    
reco:pmtrackpid:Chi2ParticleID                        4.2664e-05    0.00140372     0.012079     0.00102276    0.00171549       100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000353546     14.8365       437.203       4.40614       47.6147        100    
reco:pmtrajfitcalo:Calorimetry                        0.000124098     0.16308       6.78285      0.0295948     0.705513        100    
reco:pmtrajfitpid:Chi2ParticleID                      5.0863e-05    0.000572441   0.00287613    0.000463088   0.000442827      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00224256      22.1142       391.544       6.92215       53.0577        100    
reco:pmtracktccalo:Calorimetry                        0.000146131    0.0525269      1.11232      0.0188655     0.129984        100    
reco:pmtracktcpid:Chi2ParticleID                      5.4265e-05    0.00113725    0.00655375    0.000914028   0.00100981       100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000318248     10.3061       184.189       4.95593       21.9161        100    
reco:pmtrajfittccalo:Calorimetry                      0.000112865     0.12494       3.17913      0.0257573     0.383171        100    
reco:pmtrajfittcpid:Chi2ParticleID                    5.2469e-05    0.00160756     0.0103193    0.00106086    0.00180066       100    
reco:blurredcluster:BlurredClustering                 0.00028018      3.35589       23.0405       2.06894       3.85648        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000170282     60.9157       592.334       38.3766       86.3502        100    
reco:emshower:EMShower                                0.000242939    0.127209      0.706785      0.0682356     0.149095        100    
reco:cvnmap:CVNMapper                                 2.8623e-05     0.0808594     0.222311      0.0851747     0.0388449       100    
reco:cvneva:CVNEvaluator                              1.8759e-05      2.02248       6.69822       2.17205      0.792653        100    
reco:energyrecnumu:EnergyReco                         0.000411773    0.443287       11.3911      0.0512407      1.46913        100    
reco:energyrecnue:EnergyReco                          0.000191518    0.0120905     0.198236      0.0045549     0.0260678       100    
reco:energyrecnc:EnergyReco                           0.00238547     0.0157521     0.200752     0.00841153     0.0257786       100    
reco:energyrecnumurange:EnergyReco                    0.000321898    0.397546       8.17864      0.0384055      1.24356        100    
reco:energyrecnumumcs:EnergyReco                      0.00252949      0.42489       9.57915      0.0450403      1.3729         100    
reco:opdec:Deconvolution                               0.0393167     0.586873       1.00221      0.602759      0.190812        100    
reco:ophitspe:OpHitFinderDeco                           0.15311       6.56806       10.9529       6.88122       2.19411        100    
reco:opflash:OpFlashFinder                            0.000305777   0.00334948    0.00902806    0.00333848    0.00140709       100    
reco:rns:RandomNumberSaver                            2.1767e-05    6.42375e-05   0.000674516   5.6394e-05    6.36862e-05      100    
[art]:TriggerResults:TriggerResultInserter            1.2114e-05    2.26027e-05   7.3349e-05    2.0094e-05    8.38752e-06      100    
end_path:out1:RootOutput                               2.798e-06     8.532e-06    3.2835e-05    8.0555e-06    3.42358e-06      100    
end_path:out1:RootOutput(write)                        0.0150499      1.14077       3.23218       1.07821      0.559009        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 10927.5 MB
  Peak resident set size usage (VmHWM): 2811.34 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_nue_dune10kt_1x2x6_1416_70_20230826T223329Z_gen_g4_detsim_hitreco__20240221T171123Z_reco2.root
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
nue_dune10kt_1x2x6_1416_70_20230826T223329Z_gen_g4_detsim_hitreco__20240221T171123Z_reco2_reco_2024-08-23T_211247Z.log
nue_dune10kt_1x2x6_1416_70_20230826T223329Z_gen_g4_detsim_hitreco__20240221T171123Z_reco2_reco_data_2024-08-23T_211247Z.root
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
localProducts_larsoft_v09_91_02_e26_prof
justIN time: 2024-11-17 08:25:47 UTC       justIN version: 01.01.09