justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 61258.188@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID61258.188@justin-prod-sched02.dune.hep.ac.uk
Workflow ID2901
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-08-23 21:10:58
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-08-24 01:46:55
From worker nodeHostnamewn1206250.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-23 21:12:53
Input filesfardet-hd:nue_dune10kt_1x2x6_1115_918_20230827T164115Z_gen_g4_detsim_hitreco__20240221T171534Z_reco2.root
JobscriptExit code0
Real time4h (16371s)
CPU time4h (15676s = 95%)
Outputting started2024-08-24 01:45:54
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/02901/1/Validation_nue_dune10kt_1x2x6_1115_918_20230827T164115Z_gen_g4_detsim_hitreco__20240221T171534Z_reco2.root
Finished2024-08-24 01:46:55
Saved logsjustin-logs:61258.188-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

9_91_02_e26_prof

PRODUCTS=/exp/dune/app/users/ismerio/env-testreco/localProducts_larsoft_v09_91_02_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune/testproducts:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/exp/dune/app/users/ismerio/env-testreco/localProducts_larsoft_v09_91_02_e26_prof

local product directory is /exp/dune/app/users/ismerio/env-testreco/localProducts_larsoft_v09_91_02_e26_prof
----------- this block should be empty ------------------
WARNING: Unable to open file /exp/dune/app/users/ismerio/env-testreco/localProducts_larsoft_v09_91_02_e26_prof.
---------------------------------------------------------
Art output set to nue_dune10kt_1x2x6_1115_918_20230827T164115Z_gen_g4_detsim_hitreco__20240221T171534Z_reco2_reco_data_2024-08-23T_211304Z.root
Contents of /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/c5fe39c11c378ea944c1ce1c47f8dbacb94669f9:
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
localProducts_larsoft_v09_91_02_e26_prof
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
lar exit code 0
=== Start last 100 lines of lar log file ===
  162
  164
  170
  172
  198
  207
  208
  218
  242
  249
  250
  256
  264
  267
  268
  271
  272
  273
  274
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  24-Aug-2024 02:45:28 BST run: 1115 subRun: 1 event: 91900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  24-Aug-2024 02:45:28 BST run: 1115 subRun: 1 event: 91900
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 6622, 6316, 3797
minwire 0: 1271
minwire 1: 463
minwire 2: 1455
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0766908, 
Output 1: 0.00796569, 0.961667, 0.0213018, 0.00906556, 
Output 2: 0.00199129, 0.0317016, 0.965869, 0.000438588, 
Output 3: 0.963619, 0.0349233, 0.000631854, 0.000825643, 
Output 4: 0.0486152, 0.896161, 0.0542605, 0.000963511, 
Output 5: 0.0321618, 0.293564, 0.504748, 0.169526, 
Output 6: 0.0621086, 0.6471, 0.209368, 0.0814239, 

916
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 3309!
24-Aug-2024 02:45:42 BST  Closed output file "nue_dune10kt_1x2x6_1115_918_20230827T164115Z_gen_g4_detsim_hitreco__20240221T171534Z_reco2_reco_data_2024-08-23T_211304Z.root"
24-Aug-2024 02:45:42 BST  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/6e/37/nue_dune10kt_1x2x6_1115_918_20230827T164115Z_gen_g4_detsim_hitreco__20240221T171534Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.531837       161.136       3695.5        52.4098       432.575        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0185809     0.119553      0.519615      0.0852646     0.0785366       100    
reco:linecluster:LineCluster                           0.0762016      2.16172       63.5165      0.305639       8.37339        100    
reco:trajcluster:TrajCluster                           0.026455       13.574        361.314      0.468045       51.9108        100    
reco:pandora:StandardPandora                           0.0546583      15.5714       414.46        2.41521       60.5751        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.00019588     0.0277575     0.407411      0.0119407     0.0552785       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000282644    0.0271748     0.191423      0.0170311     0.0323906       100    
reco:pandoracalo:Calorimetry                          0.000117452    0.133949       3.68475      0.0173169     0.497899        100    
reco:pandorapid:Chi2ParticleID                        6.4221e-05    0.000364778   0.00233776    0.000287688   0.000308549      100    
reco:trkshowersplit:TrackShowerHits                   0.000189127    0.137222       3.2698       0.0161695     0.436982        100    
reco:pmtrack:PMAlgTrackMaker                          0.00309017      16.9806       259.626       4.0607        40.0049        100    
reco:pmtrackcalo:Calorimetry                          0.000167205    0.0831602      2.12669      0.0117752     0.267063        100    
reco:pmtrackpid:Chi2ParticleID                        5.6656e-05     0.001274     0.00979216    0.000765049   0.00152672       100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000364007     29.1883       2029.43       3.7298        201.669        100    
reco:pmtrajfitcalo:Calorimetry                        0.000116179    0.127202       3.18585      0.020026      0.425141        100    
reco:pmtrajfitpid:Chi2ParticleID                      4.9523e-05    0.000498413   0.00242422    0.000401598   0.000378082      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00205316      21.1999       337.765       4.89916       48.4702        100    
reco:pmtracktccalo:Calorimetry                        0.000126279    0.0441319     0.804262      0.0111727     0.109224        100    
reco:pmtracktcpid:Chi2ParticleID                      7.5342e-05    0.00105697     0.0070321    0.000675204   0.00112995       100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000320104     9.31508       130.473       3.21096       19.8734        100    
reco:pmtrajfittccalo:Calorimetry                      0.000121359    0.0953161      1.91259      0.0162028     0.268635        100    
reco:pmtrajfittcpid:Chi2ParticleID                    4.6698e-05    0.00140914    0.00862564    0.000841759   0.00159238       100    
reco:blurredcluster:BlurredClustering                 0.000284607     2.61132       20.2181       1.82271       3.00275        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000176022     42.6927       387.889       22.1068       59.7761        100    
reco:emshower:EMShower                                0.000268808    0.0991428     0.496503      0.0702989     0.106191        100    
reco:cvnmap:CVNMapper                                 2.8213e-05     0.0262611     0.108458      0.0222205     0.0150003       100    
reco:cvneva:CVNEvaluator                               2.602e-05      1.55047       3.77759       1.65658      0.472061        100    
reco:energyrecnumu:EnergyReco                         0.00389218     0.164795       2.10477      0.0298033     0.328508        100    
reco:energyrecnue:EnergyReco                          0.000369577    0.0103448     0.226345     0.00333486     0.0284799       100    
reco:energyrecnc:EnergyReco                           0.00342601     0.0144876     0.231443      0.0068776     0.0291109       100    
reco:energyrecnumurange:EnergyReco                    0.000525772    0.158231       2.22945      0.0170971     0.338144        100    
reco:energyrecnumumcs:EnergyReco                      0.00159553     0.160615       2.22108      0.0246864     0.336619        100    
reco:opdec:Deconvolution                               0.0450966     0.489677       1.14739      0.481107      0.194356        100    
reco:ophitspe:OpHitFinderDeco                          0.159413       3.4365        5.88412       3.59122       1.08418        100    
reco:opflash:OpFlashFinder                            0.000305627    0.0025419    0.00486254    0.00256654    0.000809152      100    
reco:rns:RandomNumberSaver                            2.0659e-05    3.4235e-05    0.000291129   3.0949e-05    2.65236e-05      100    
[art]:TriggerResults:TriggerResultInserter            1.2373e-05    1.83012e-05   4.3002e-05    1.76135e-05   4.42958e-06      100    
end_path:out1:RootOutput                               3.306e-06    4.27377e-06    1.609e-05     4.123e-06    1.24661e-06      100    
end_path:out1:RootOutput(write)                        0.0193346     0.924325       2.71526      0.818148      0.466862        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21793.1 MB
  Peak resident set size usage (VmHWM): 2921.44 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_nue_dune10kt_1x2x6_1115_918_20230827T164115Z_gen_g4_detsim_hitreco__20240221T171534Z_reco2.root
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
nue_dune10kt_1x2x6_1115_918_20230827T164115Z_gen_g4_detsim_hitreco__20240221T171534Z_reco2_reco_2024-08-23T_211304Z.log
nue_dune10kt_1x2x6_1115_918_20230827T164115Z_gen_g4_detsim_hitreco__20240221T171534Z_reco2_reco_data_2024-08-23T_211304Z.root
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
localProducts_larsoft_v09_91_02_e26_prof
justIN time: 2024-11-17 08:18:21 UTC       justIN version: 01.01.09