justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 246481.8@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID246481.8@justin-prod-sched01.dune.hep.ac.uk
Workflow ID2901
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-08-23 23:08:05
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-08-24 01:50:34
From worker nodeHostnamewn2204240.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7513 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-23 23:09:33
Input filesfardet-hd:nue_dune10kt_1x2x6_1423_520_20230827T134111Z_gen_g4_detsim_hitreco__20240221T031057Z_reco2.root
JobscriptExit code0
Real time2h (9620s)
CPU time2h (9197s = 95%)
Outputting started2024-08-24 01:50:03
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/02901/1/Validation_nue_dune10kt_1x2x6_1423_520_20230827T134111Z_gen_g4_detsim_hitreco__20240221T031057Z_reco2.root
Finished2024-08-24 01:50:34
Saved logsjustin-logs:246481.8-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

lock should be empty ------------------
WARNING: Unable to open file /exp/dune/app/users/ismerio/env-testreco/localProducts_larsoft_v09_91_02_e26_prof.
---------------------------------------------------------
Art output set to nue_dune10kt_1x2x6_1423_520_20230827T134111Z_gen_g4_detsim_hitreco__20240221T031057Z_reco2_reco_data_2024-08-23T_230942Z.root
Contents of /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/c5fe39c11c378ea944c1ce1c47f8dbacb94669f9:
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
localProducts_larsoft_v09_91_02_e26_prof
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
lar exit code 0
=== Start last 100 lines of lar log file ===
Shower initial tracks are:
Track tracks are:
  0
  7
  11
  15
  18
  23
  29
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  24-Aug-2024 02:49:46 BST run: 1423 subRun: 1 event: 52100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  24-Aug-2024 02:49:46 BST run: 1423 subRun: 1 event: 52100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  24-Aug-2024 02:49:46 BST run: 1423 subRun: 1 event: 52100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  24-Aug-2024 02:49:46 BST run: 1423 subRun: 1 event: 52100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  24-Aug-2024 02:49:46 BST run: 1423 subRun: 1 event: 52100
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 614, 663, 595
minwire 0: 1535
minwire 1: 651
minwire 2: 1663
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2258, 2757
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0147156, 
Output 1: 0.0482617, 0.0311303, 0.0177868, 0.902821, 
Output 2: 0.0517725, 0.149727, 0.797284, 0.00121675, 
Output 3: 0.323791, 0.58572, 0.0735689, 0.0169201, 
Output 4: 0.118151, 0.261543, 0.465384, 0.154922, 
Output 5: 0.0810783, 0.265382, 0.492437, 0.161103, 
Output 6: 0.273561, 0.347336, 0.179551, 0.199552, 

580
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1978!
24-Aug-2024 02:49:52 BST  Closed output file "nue_dune10kt_1x2x6_1423_520_20230827T134111Z_gen_g4_detsim_hitreco__20240221T031057Z_reco2_reco_data_2024-08-23T_230942Z.root"
24-Aug-2024 02:49:52 BST  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/7d/2d/nue_dune10kt_1x2x6_1423_520_20230827T134111Z_gen_g4_detsim_hitreco__20240221T031057Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3.17651       93.8351       2013.22       35.0849       223.872        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0305463     0.112324      0.555424      0.0780955     0.0861798       100    
reco:linecluster:LineCluster                           0.119172       1.40364       46.5928      0.242891       5.38303        100    
reco:trajcluster:TrajCluster                           0.0322532      5.90778       218.896      0.280961       23.959         100    
reco:pandora:StandardPandora                            1.07686       10.6971       638.734       1.74631       63.6889        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000201519    0.021808      0.457497     0.00727786     0.0540485       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000213471    0.0223978     0.150616      0.0112943     0.0279994       100    
reco:pandoracalo:Calorimetry                          0.000124865    0.0837561      2.34425      0.013259      0.265615        100    
reco:pandorapid:Chi2ParticleID                        4.3843e-05    0.000321423   0.00271484    0.000245772   0.000319912      100    
reco:trkshowersplit:TrackShowerHits                   0.000233088     0.10481       3.10815      0.0119256     0.344882        100    
reco:pmtrack:PMAlgTrackMaker                          0.00174334      11.9273       302.03        2.64729       33.3525        100    
reco:pmtrackcalo:Calorimetry                          0.00010132     0.051691       1.10925      0.0101456     0.137388        100    
reco:pmtrackpid:Chi2ParticleID                        4.5786e-05    0.000947446   0.00847636    0.000575077   0.00117302       100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000288382     7.30082       144.081       2.59621       16.9969        100    
reco:pmtrajfitcalo:Calorimetry                        9.6612e-05     0.0881411      2.61714      0.0153929     0.291793        100    
reco:pmtrajfitpid:Chi2ParticleID                      4.0226e-05    0.000387266   0.00314606    0.000304036   0.000356279      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00153897      15.2463       311.418       3.18225       39.228         100    
reco:pmtracktccalo:Calorimetry                        0.000105158    0.0310262     0.604299     0.00849498     0.0737617       100    
reco:pmtracktcpid:Chi2ParticleID                      4.3221e-05    0.000770931    0.0035953    0.000530532   0.000745314      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000315383     5.98644       62.6867       2.39721       10.8412        100    
reco:pmtrajfittccalo:Calorimetry                      9.8556e-05     0.0586245      1.15699      0.0117776     0.156211        100    
reco:pmtrajfittcpid:Chi2ParticleID                    4.3281e-05    0.000956086   0.00601459    0.000599833    0.0010845       100    
reco:blurredcluster:BlurredClustering                  0.0273857      2.05964       10.9091       1.5724        2.04383        100    
reco:emtrkmichelid:EmTrackMichelId                     0.322828       26.9732       251.504       14.7474       38.7322        100    
reco:emshower:EMShower                                0.000241915    0.0674994     0.437093      0.0342679     0.0856799       100    
reco:cvnmap:CVNMapper                                 2.7101e-05     0.0307898      0.18311      0.0310939     0.0211212       100    
reco:cvneva:CVNEvaluator                              1.6801e-05      1.1725        3.24605       1.2658       0.394291        100    
reco:energyrecnumu:EnergyReco                         0.000800365    0.147652       1.85183      0.0156887     0.344338        100    
reco:energyrecnue:EnergyReco                          0.000185419   0.00708529     0.153707     0.00232652     0.0179617       100    
reco:energyrecnc:EnergyReco                           0.00166117     0.0102006     0.157982     0.00526287     0.0184521       100    
reco:energyrecnumurange:EnergyReco                    0.000445838    0.141634       1.83054      0.0100835     0.340091        100    
reco:energyrecnumumcs:EnergyReco                      0.00160416     0.144236       1.83445      0.0121426     0.344348        100    
reco:opdec:Deconvolution                               0.0854316      0.37945      0.726062      0.381488      0.112521        100    
reco:ophitspe:OpHitFinderDeco                          0.418204       2.96407       4.79398       3.11262      0.935952        100    
reco:opflash:OpFlashFinder                            0.000464413   0.00207948    0.00699372    0.00211165    0.00084771       100    
reco:rns:RandomNumberSaver                            2.0378e-05    5.22618e-05   0.000419739   4.6652e-05    4.54852e-05      100    
[art]:TriggerResults:TriggerResultInserter            1.0019e-05    1.94388e-05   0.000215205   1.59145e-05   2.09138e-05      100    
end_path:out1:RootOutput                               2.765e-06    7.36084e-06   2.8264e-05    7.0535e-06    3.48953e-06      100    
end_path:out1:RootOutput(write)                        0.0279179      0.68515       1.89209      0.660911      0.300513        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21849.9 MB
  Peak resident set size usage (VmHWM): 2986.73 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_nue_dune10kt_1x2x6_1423_520_20230827T134111Z_gen_g4_detsim_hitreco__20240221T031057Z_reco2.root
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
nue_dune10kt_1x2x6_1423_520_20230827T134111Z_gen_g4_detsim_hitreco__20240221T031057Z_reco2_reco_2024-08-23T_230942Z.log
nue_dune10kt_1x2x6_1423_520_20230827T134111Z_gen_g4_detsim_hitreco__20240221T031057Z_reco2_reco_data_2024-08-23T_230942Z.root
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
localProducts_larsoft_v09_91_02_e26_prof
justIN time: 2024-11-17 08:52:05 UTC       justIN version: 01.01.09