justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 284678.0@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID284678.0@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3919
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-05 19:51:24
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce04_mcore_op_duneonly
Last heartbeat2024-11-06 11:46:15
From worker nodeHostnamedunegli-4212283-0-fnpc23023.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit172800 (48 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-06 10:55:52
Input filesfardet-hd:nutau_dune10kt_1x2x6_1110_239_20230827T023428Z_gen_g4_detsim_hitreco__20240220T160720Z_reco2.root
JobscriptExit code0
Real time50m (3012s)
CPU time49m (2969s = 98%)
Outputting started2024-11-06 11:46:06
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/03919/1/Validation_ccnc_nutau_dune10kt_1x2x6_1110_239_20230827T023428Z_gen_g4_detsim_hitreco__20240220T160720Z_reco2.root
Finished2024-11-06 11:46:15
Saved logsjustin-logs:284678.0-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

k:  PMAlgTrajFitter:pmtrajfittc@BeginModule  06-Nov-2024 11:45:22 UTC run: 1110 subRun: 1 event: 24000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  06-Nov-2024 11:45:22 UTC run: 1110 subRun: 1 event: 24000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  06-Nov-2024 11:45:22 UTC run: 1110 subRun: 1 event: 24000
Comparing two wires in the same plane: return failure
%MSG

  Shower cones:
      7
      20
      23
      101
      114
      10
      34
      40
      45
      47
      91
      74
      15
      26
      38
      25
      18
      21
      27
      28
      29
      33
      54
      55
      77
      81
      85
      35
      30
      56
      94
      78
      95
      96
      24
      68

Event 24000 track shower separation:
Shower initial tracks are:
  0
  1
  8
  39
  51
  107
  111
Track tracks are:
  2
  6
  17
  19
  22
  31
  36
  41
  42
  48
  49
  57
  60
  61
  63
  67
  72
  73
  75
  79
  82
  83
  84
  88
  89
  90
  93
  97
  98
  99
  100
  102
  103
  104
  105
  106
  109
  110
  112
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  06-Nov-2024 11:46:01 UTC run: 1110 subRun: 1 event: 24000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  06-Nov-2024 11:46:01 UTC run: 1110 subRun: 1 event: 24000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  06-Nov-2024 11:46:01 UTC run: 1110 subRun: 1 event: 24000
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 2921, 3179, 2848
minwire 0: 272
minwire 1: 837
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary: 
Output 0: 0.0837824, 
Output 1: 0.00100786, 0.0127684, 0.157105, 0.829118, 
Output 2: 0.0210515, 0.0749268, 0.902204, 0.00181744, 
Output 3: 0.512609, 0.45905, 0.0227445, 0.00559652, 
Output 4: 0.0363427, 0.278559, 0.540376, 0.144723, 
Output 5: 0.134525, 0.534965, 0.311589, 0.0189201, 
Output 6: 0.494063, 0.407783, 0.0737027, 0.0244508, 

785
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2980!
06-Nov-2024 11:46:05 UTC  Closed output file "nutau_dune10kt_1x2x6_1110_239_20230827T023428Z_gen_g4_detsim_hitreco__20240220T160720Z_reco2_reco_data_2024-11-06T_105557Z.root"
06-Nov-2024 11:46:05 UTC  Closed input file "root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/fardet-hd/d8/fd/nutau_dune10kt_1x2x6_1110_239_20230827T023428Z_gen_g4_detsim_hitreco__20240220T160720Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.0578035      29.5111       264.75        10.8865       42.883         100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00142309     0.0134973     0.0553586     0.0145844    0.00971366       100    
reco:linecluster:LineCluster                          0.00283621     0.082107      0.932888      0.0267018     0.161894        100    
reco:trajcluster:TrajCluster                          0.00123241     0.881641       16.8453      0.0321285      2.56227        100    
reco:pandora:StandardPandora                          0.00709679      1.73833       25.9118      0.756254       3.38177        100    
reco:pandoraTrack:LArPandoraTrackCreation             9.2847e-05     0.0082436     0.0968229    0.00234033     0.0146477       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000118497    0.0148875     0.216622      0.0054605     0.0262856       100    
reco:pandoracalo:Calorimetry                          7.1457e-05     0.0159021     0.196965     0.00180538     0.0344798       100    
reco:pandorapid:Chi2ParticleID                        2.7903e-05    0.00014456    0.000676014   0.000117981   0.000102402      100    
reco:trkshowersplit:TrackShowerHits                   3.4365e-05     0.0251352     0.434646     0.00171827     0.0629513       100    
reco:pmtrack:PMAlgTrackMaker                          0.000780845     2.94571       32.958       0.626166       5.34505        100    
reco:pmtrackcalo:Calorimetry                          5.2871e-05     0.0182449     0.386978      0.0014672     0.0469632       100    
reco:pmtrackpid:Chi2ParticleID                         2.095e-05    0.000298081   0.00216385    0.000133255   0.000375346      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000124458     1.93463       20.8827      0.409228       3.14116        100    
reco:pmtrajfitcalo:Calorimetry                        4.5407e-05     0.0171395     0.217601     0.00210275     0.0368055       100    
reco:pmtrajfitpid:Chi2ParticleID                      1.9387e-05    0.000169568   0.000770806   0.000118546   0.000149151      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000623504     3.78563       44.1027      0.566832       7.30956        100    
reco:pmtracktccalo:Calorimetry                        4.8623e-05     0.0117912     0.194718      0.0016396     0.0256471       100    
reco:pmtracktcpid:Chi2ParticleID                      1.9147e-05    0.000273324   0.00167091    0.00014357    0.000308217      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000114289     2.01561       18.1742      0.525286       3.13202        100    
reco:pmtrajfittccalo:Calorimetry                      4.5817e-05     0.0164453     0.252295     0.00186032     0.0357859       100    
reco:pmtrajfittcpid:Chi2ParticleID                    1.8606e-05    0.000333593   0.00208922    0.00015119    0.000405375      100    
reco:blurredcluster:BlurredClustering                 0.00010474      1.26746       5.7149       0.825733       1.24133        100    
reco:emtrkmichelid:EmTrackMichelId                     6.777e-05      12.2518       95.6881       4.61486       17.0081        100    
reco:emshower:EMShower                                9.0293e-05     0.0221795     0.154824     0.00487094     0.0354288       100    
reco:cvnmap:CVNMapper                                 1.3106e-05     0.0151641     0.0481443     0.0127188     0.0103557       100    
reco:cvneva:CVNEvaluator                               1.074e-05     0.620836       1.79984      0.683293      0.244928        100    
reco:energyrecnumu:EnergyReco                         0.000202097    0.0911173      1.41713     0.00842931     0.203097        100    
reco:energyrecnue:EnergyReco                          9.3329e-05    0.00253846     0.034168     0.000614441   0.00482041       100    
reco:energyrecnc:EnergyReco                           0.00118923    0.00387099     0.0362464    0.00188069    0.00500927       100    
reco:energyrecnumurange:EnergyReco                    9.7016e-05     0.0879134      1.41058     0.00466384     0.202211        100    
reco:energyrecnumumcs:EnergyReco                      0.00120557     0.0888257      1.40568     0.00614157     0.202091        100    
reco:opdec:Deconvolution                              0.00401577     0.134222       0.2269       0.137981      0.0454856       100    
reco:ophitspe:OpHitFinderDeco                          0.0192243      1.09252       1.69834       1.12166      0.374717        100    
reco:opflash:OpFlashFinder                            8.3039e-05    0.000925509   0.00241391    0.000916314   0.000374529      100    
reco:rns:RandomNumberSaver                            1.0741e-05    2.04552e-05   0.000183932   1.91815e-05   1.70209e-05      100    
[art]:TriggerResults:TriggerResultInserter             6.182e-06    8.07152e-06   2.5889e-05    7.4795e-06    2.19081e-06      100    
end_path:out1:RootOutput                               1.893e-06    3.75587e-06   1.2123e-05     3.326e-06    1.56998e-06      100    
end_path:out1:RootOutput(write)                       0.00541464     0.304681      0.807745      0.284756      0.139224        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21630.2 MB
  Peak resident set size usage (VmHWM): 2781.58 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_nutau_dune10kt_1x2x6_1110_239_20230827T023428Z_gen_g4_detsim_hitreco__20240220T160720Z_reco2.root
all-input-dids.txt
debugprod.log
jobscript.log
justin-processed-pfns.txt
nutau_dune10kt_1x2x6_1110_239_20230827T023428Z_gen_g4_detsim_hitreco__20240220T160720Z_reco2_reco_2024-11-06T_105557Z.log
nutau_dune10kt_1x2x6_1110_239_20230827T023428Z_gen_g4_detsim_hitreco__20240220T160720Z_reco2_reco_data_2024-11-06T_105557Z.root
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
work
justIN time: 2024-11-17 10:50:19 UTC       justIN version: 01.01.09