justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 246470.44@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID246470.44@justin-prod-sched01.dune.hep.ac.uk
Workflow ID2901
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-08-23 22:04:05
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2024-08-24 02:01:07
From worker nodeHostnamedunegli-4156453-0-fnpc17130.fnal.gov
cpuinfoIntel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-08-23 23:20:25
Input filesfardet-hd:nue_dune10kt_1x2x6_1426_975_20230827T194246Z_gen_g4_detsim_hitreco__20240221T031614Z_reco2.root
JobscriptExit code0
Real time2h (9618s)
CPU time2h (9144s = 95%)
Outputting started2024-08-24 02:00:51
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/02901/1/Validation_nue_dune10kt_1x2x6_1426_975_20230827T194246Z_gen_g4_detsim_hitreco__20240221T031614Z_reco2.root
Finished2024-08-24 02:01:07
Saved logsjustin-logs:246470.44-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ismerio/env-testreco
MRB_SOURCE=/exp/dune/app/users/ismerio/env-testreco/srcs
MRB_BUILDDIR=/exp/dune/app/users/ismerio/env-testreco/build_slf7.x86_64
MRB_INSTALL=/exp/dune/app/users/ismerio/env-testreco/localProducts_larsoft_v09_91_02_e26_prof

PRODUCTS=/exp/dune/app/users/ismerio/env-testreco/localProducts_larsoft_v09_91_02_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune/testproducts:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/exp/dune/app/users/ismerio/env-testreco/localProducts_larsoft_v09_91_02_e26_prof

local product directory is /exp/dune/app/users/ismerio/env-testreco/localProducts_larsoft_v09_91_02_e26_prof
----------- this block should be empty ------------------
WARNING: Unable to open file /exp/dune/app/users/ismerio/env-testreco/localProducts_larsoft_v09_91_02_e26_prof.
---------------------------------------------------------
Art output set to nue_dune10kt_1x2x6_1426_975_20230827T194246Z_gen_g4_detsim_hitreco__20240221T031614Z_reco2_reco_data_2024-08-23T_232043Z.root
Contents of /cvmfs/fifeuser2.opensciencegrid.org/sw/dune/c5fe39c11c378ea944c1ce1c47f8dbacb94669f9:
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
localProducts_larsoft_v09_91_02_e26_prof
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
lar exit code 0
=== Start last 100 lines of lar log file ===
      17
      18
      20
      22
      25
      26
      27
      28
      29
      30
      24
      19

Event 97600 track shower separation:
Shower initial tracks are:
  0
  4
Track tracks are:
  5
  8
  12
  13
  15
  21
  23
Boundary wire vector sizes: 740, 528, 594
minwire 0: 1374
minwire 1: 491
minwire 2: 1068
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0234872, 
Output 1: 0.00421353, 0.987268, 0.00663942, 0.00187926, 
Output 2: 0.972081, 0.00638743, 0.00437898, 0.0171522, 
Output 3: 0.12591, 0.866899, 0.00717476, 1.69564e-05, 
Output 4: 0.994277, 0.00521256, 0.000115781, 0.000394828, 
Output 5: 0.991768, 0.00715003, 9.63197e-05, 0.000985608, 
Output 6: 0.116121, 0.81093, 0.0627629, 0.0101861, 

665
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2565!
24-Aug-2024 02:00:42 UTC  Closed output file "nue_dune10kt_1x2x6_1426_975_20230827T194246Z_gen_g4_detsim_hitreco__20240221T031614Z_reco2_reco_data_2024-08-23T_232043Z.root"
24-Aug-2024 02:00:42 UTC  Closed input file "root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/fardet-hd/ba/8a/nue_dune10kt_1x2x6_1426_975_20230827T194246Z_gen_g4_detsim_hitreco__20240221T031614Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              1.20857       92.2125       787.707       60.862        114.405        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0579508     0.124861      0.252277      0.112701      0.0413953       100    
reco:linecluster:LineCluster                           0.164374      0.734572       8.77124      0.360861       1.39094        100    
reco:trajcluster:TrajCluster                           0.0827858      4.20794       78.3665      0.646224       11.8148        100    
reco:pandora:StandardPandora                           0.101487       6.26187       232.844       2.40601       23.2414        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000218184    0.0235825     0.211426      0.0142708     0.0352138       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000292757    0.0257455     0.155716      0.0156489     0.0294614       100    
reco:pandoracalo:Calorimetry                          0.000161518    0.0659959      1.14122      0.0197565     0.155847        100    
reco:pandorapid:Chi2ParticleID                        5.8324e-05    0.000376959   0.00336448    0.00032375    0.000342961      100    
reco:trkshowersplit:TrackShowerHits                    9.015e-05     0.0624083     0.978172      0.0182513      0.14723        100    
reco:pmtrack:PMAlgTrackMaker                          0.00234344      8.94348       96.7297       4.10427       14.9225        100    
reco:pmtrackcalo:Calorimetry                          0.000162016    0.0449427     0.539104      0.0144165     0.0926366       100    
reco:pmtrackpid:Chi2ParticleID                         5.929e-05    0.000984978   0.00481626    0.00074703    0.000853193      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000351814     5.89148       43.1026       3.34953       7.30768        100    
reco:pmtrajfitcalo:Calorimetry                        0.000133873    0.0677233      1.2046       0.0225841     0.160448        100    
reco:pmtrajfitpid:Chi2ParticleID                      4.7602e-05    0.000423161   0.00137319    0.000389816   0.000221946      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00205933      11.1799       131.904       4.68245       19.586         100    
reco:pmtracktccalo:Calorimetry                        0.000137108    0.026713      0.285361      0.0123229     0.0465626       100    
reco:pmtracktcpid:Chi2ParticleID                      5.8137e-05    0.000788366   0.00307383    0.00064341    0.000577407      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000321081     4.8622        31.6766       3.04213       5.8919         100    
reco:pmtrajfittccalo:Calorimetry                      0.00013549     0.0491693     0.652688      0.0178557     0.0994538       100    
reco:pmtrajfittcpid:Chi2ParticleID                    4.9336e-05    0.00098173    0.00434034    0.000756736   0.000789546      100    
reco:blurredcluster:BlurredClustering                 0.000299854     2.56231       9.46987       2.00776       1.98517        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000191979     38.8688       193.126       29.546        37.3807        100    
reco:emshower:EMShower                                0.000288677    0.0859607     0.431934      0.0641997     0.0869753       100    
reco:cvnmap:CVNMapper                                 3.2175e-05     0.0826722     0.150168      0.0926165     0.0308752       100    
reco:cvneva:CVNEvaluator                              2.4145e-05      1.25196       4.88467       1.34429      0.488291        100    
reco:energyrecnumu:EnergyReco                         0.00356902     0.182597       3.18118      0.0326313     0.481825        100    
reco:energyrecnue:EnergyReco                          0.000350459   0.00611785     0.0491097    0.00350419    0.00916542       100    
reco:energyrecnc:EnergyReco                           0.00257779    0.00885394     0.0520532    0.00630516    0.00933049       100    
reco:energyrecnumurange:EnergyReco                    0.000517377    0.174843       3.19092      0.0224455      0.48312        100    
reco:energyrecnumumcs:EnergyReco                      0.00273309     0.177326       3.17581      0.0262981     0.481925        100    
reco:opdec:Deconvolution                               0.102321      0.608423       1.13645      0.617961       0.16908        100    
reco:ophitspe:OpHitFinderDeco                          0.248692       4.80493       8.4521        4.9028        1.63176        100    
reco:opflash:OpFlashFinder                            0.000167573   0.00247146    0.00711231    0.00242473    0.000884335      100    
reco:rns:RandomNumberSaver                            2.6249e-05    5.34181e-05   0.000534723   4.98795e-05   4.92663e-05      100    
[art]:TriggerResults:TriggerResultInserter            1.2619e-05    1.84244e-05   6.3882e-05    1.7577e-05    5.66017e-06      100    
end_path:out1:RootOutput                               2.971e-06    6.80981e-06   3.0229e-05    6.9215e-06    2.7322e-06       100    
end_path:out1:RootOutput(write)                        0.0122185      0.81625       2.13122       0.77811      0.341656        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 14090.1 MB
  Peak resident set size usage (VmHWM): 2761.39 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_nue_dune10kt_1x2x6_1426_975_20230827T194246Z_gen_g4_detsim_hitreco__20240221T031614Z_reco2.root
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
nue_dune10kt_1x2x6_1426_975_20230827T194246Z_gen_g4_detsim_hitreco__20240221T031614Z_reco2_reco_2024-08-23T_232043Z.log
nue_dune10kt_1x2x6_1426_975_20230827T194246Z_gen_g4_detsim_hitreco__20240221T031614Z_reco2_reco_data_2024-08-23T_232043Z.root
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
localProducts_larsoft_v09_91_02_e26_prof
justIN time: 2024-11-17 08:30:29 UTC       justIN version: 01.01.09