justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 246470.2@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID246470.2@justin-prod-sched01.dune.hep.ac.uk
Workflow ID2901
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-08-23 22:04:03
SiteUS_UChicago
EntryEngage_US_MWT2_uiuc_condce_mcore
Last heartbeat2024-08-24 01:26:56
From worker nodeHostnamemwt2-c176.campuscluster.illinois.edu
cpuinfoIntel(R) Xeon(R) Gold 6248 CPU @ 2.50GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit86400 (24 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-23 23:21:12
Input filesfardet-hd:nue_dune10kt_1x2x6_1426_941_20230827T194148Z_gen_g4_detsim_hitreco__20240221T074305Z_reco2.root
JobscriptExit code0
Real time2h (7505s)
CPU time1h (6936s = 92%)
Outputting started2024-08-24 01:26:31
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/02901/1/Validation_nue_dune10kt_1x2x6_1426_941_20230827T194148Z_gen_g4_detsim_hitreco__20240221T074305Z_reco2.root
Finished2024-08-24 01:26:56
Saved logsjustin-logs:246470.2-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

rsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/exp/dune/app/users/ismerio/env-testreco/localProducts_larsoft_v09_91_02_e26_prof

local product directory is /exp/dune/app/users/ismerio/env-testreco/localProducts_larsoft_v09_91_02_e26_prof
----------- this block should be empty ------------------
WARNING: Unable to open file /exp/dune/app/users/ismerio/env-testreco/localProducts_larsoft_v09_91_02_e26_prof.
---------------------------------------------------------
Art output set to nue_dune10kt_1x2x6_1426_941_20230827T194148Z_gen_g4_detsim_hitreco__20240221T074305Z_reco2_reco_data_2024-08-23T_232209Z.root
Contents of /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/c5fe39c11c378ea944c1ce1c47f8dbacb94669f9:
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
localProducts_larsoft_v09_91_02_e26_prof
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
lar exit code 0
=== Start last 100 lines of lar log file ===
      46

Event 94200 track shower separation:
Shower initial tracks are:
  20
  26
Track tracks are:
  17
  22
  24
  27
  34
  38
  40
  43
  45
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Aug-2024 20:25:43 CDT run: 1426 subRun: 1 event: 94200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Aug-2024 20:25:43 CDT run: 1426 subRun: 1 event: 94200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Aug-2024 20:25:43 CDT run: 1426 subRun: 1 event: 94200
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 815, 847, 838
minwire 0: 734
minwire 1: 1580
minwire 2: 607
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.00858595, 
Output 1: 0.00186983, 0.992891, 0.00103981, 0.004199, 
Output 2: 0.0363821, 0.866969, 0.0402267, 0.0564221, 
Output 3: 0.0379709, 0.0724962, 0.345929, 0.543604, 
Output 4: 0.989745, 0.00926522, 0.000643813, 0.000346387, 
Output 5: 0.999028, 0.000951385, 1.33358e-05, 6.96033e-06, 
Output 6: 0.124431, 0.167595, 0.137704, 0.57027, 

685
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2466!
23-Aug-2024 20:26:03 CDT  Closed output file "nue_dune10kt_1x2x6_1426_941_20230827T194148Z_gen_g4_detsim_hitreco__20240221T074305Z_reco2_reco_data_2024-08-23T_232209Z.root"
23-Aug-2024 20:26:03 CDT  Closed input file "root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/fardet-hd/8f/6c/nue_dune10kt_1x2x6_1426_941_20230827T194148Z_gen_g4_detsim_hitreco__20240221T074305Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              3.69874       69.966        764.039       40.923        117.003        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.052407      0.116147      0.330769      0.104969      0.0435114       100    
reco:linecluster:LineCluster                           0.232205      0.934117       33.4642      0.311933       3.52468        100    
reco:trajcluster:TrajCluster                           0.0745017      5.56773       158.445      0.433943       21.7009        100    
reco:pandora:StandardPandora                            1.2046        3.74105       52.8457       1.73486       7.9434         100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000178213    0.0158762     0.211872     0.00863455     0.0298401       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000224055    0.0149249     0.0780756    0.00908004     0.0156363       100    
reco:pandoracalo:Calorimetry                          0.000116293    0.060404       1.51468      0.0132512     0.209069        100    
reco:pandorapid:Chi2ParticleID                        4.5183e-05    0.000258652   0.00199713    0.000209147   0.000213373      100    
reco:trkshowersplit:TrackShowerHits                   0.000242506    0.0518004      1.02322      0.0101223     0.153012        100    
reco:pmtrack:PMAlgTrackMaker                          0.00152827      5.92637       101.936       2.38153       13.8934        100    
reco:pmtrackcalo:Calorimetry                          9.8081e-05     0.0350471     0.605326     0.00881661     0.0951398       100    
reco:pmtrackpid:Chi2ParticleID                        3.6337e-05    0.000656452   0.00387466    0.000477127   0.000705729      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000252916     4.32551       61.6239       2.02985       8.37353        100    
reco:pmtrajfitcalo:Calorimetry                        7.6434e-05     0.0618867      1.4281       0.015188      0.203698        100    
reco:pmtrajfitpid:Chi2ParticleID                      3.5383e-05    0.000314371   0.00169995    0.000269096   0.000209104      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00129713      7.67535       112.224       2.5492        17.5694        100    
reco:pmtracktccalo:Calorimetry                        9.0387e-05     0.022119      0.252637     0.00812875     0.0494592       100    
reco:pmtracktcpid:Chi2ParticleID                      3.6229e-05    0.000571549   0.00262912    0.000476175   0.000530921      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000270383     3.39815       35.7947       2.00341       5.66192        100    
reco:pmtrajfittccalo:Calorimetry                      9.9503e-05     0.0437792     0.793874      0.011994      0.117078        100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.7894e-05    0.000733566   0.00432833    0.000559938   0.000771277      100    
reco:blurredcluster:BlurredClustering                  0.044007       1.98934       10.3842       1.43792       1.78531        100    
reco:emtrkmichelid:EmTrackMichelId                     0.340092       30.6615       213.498        21.24        39.2287        100    
reco:emshower:EMShower                                0.000276629    0.0517737     0.378639      0.0306328     0.0632027       100    
reco:cvnmap:CVNMapper                                  2.578e-05     0.0597104     0.143983      0.0590518     0.0262275       100    
reco:cvneva:CVNEvaluator                              1.7767e-05     0.748506       11.5375      0.669639       1.09734        100    
reco:energyrecnumu:EnergyReco                         0.000381448    0.0831017     0.989121      0.019682      0.166457        100    
reco:energyrecnue:EnergyReco                          0.000154351   0.00502197     0.0684455    0.00235129     0.0101401       100    
reco:energyrecnc:EnergyReco                           0.00204493    0.00722406     0.0723371    0.00436234     0.0104198       100    
reco:energyrecnumurange:EnergyReco                    0.000258586    0.0710316     0.949044     0.00967228     0.157573        100    
reco:energyrecnumumcs:EnergyReco                      0.00200131     0.0720835     0.954456      0.0122235     0.156785        100    
reco:opdec:Deconvolution                               0.122137      0.490782       1.24006      0.495142      0.150798        100    
reco:ophitspe:OpHitFinderDeco                          0.424687       3.13388       4.50907       3.30047      0.851847        100    
reco:opflash:OpFlashFinder                            0.000351079   0.00184381     0.0039497    0.00189273    0.000548985      100    
reco:rns:RandomNumberSaver                            2.0631e-05    4.24439e-05   0.000290757   4.0142e-05    2.70728e-05      100    
[art]:TriggerResults:TriggerResultInserter            1.1767e-05    1.61849e-05   4.1764e-05    1.54515e-05   4.02491e-06      100    
end_path:out1:RootOutput                               2.464e-06    5.32863e-06   1.6205e-05    5.0475e-06    2.20056e-06      100    
end_path:out1:RootOutput(write)                        0.0167407     0.595242       1.40478      0.588631      0.218184        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 15300.4 MB
  Peak resident set size usage (VmHWM): 2574.8 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_nue_dune10kt_1x2x6_1426_941_20230827T194148Z_gen_g4_detsim_hitreco__20240221T074305Z_reco2.root
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
nue_dune10kt_1x2x6_1426_941_20230827T194148Z_gen_g4_detsim_hitreco__20240221T074305Z_reco2_reco_2024-08-23T_232209Z.log
nue_dune10kt_1x2x6_1426_941_20230827T194148Z_gen_g4_detsim_hitreco__20240221T074305Z_reco2_reco_data_2024-08-23T_232209Z.root
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
localProducts_larsoft_v09_91_02_e26_prof
justIN time: 2024-11-17 08:22:39 UTC       justIN version: 01.01.09