justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301485.134@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301485.134@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:54:06
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2024-11-22 23:54:17
From worker nodeHostnameb9p07p1853.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:11:00
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74257901_70_20231122T061043Z_gen_g4_detsim_hitreco__20240507T171821Z_reco2.root
JobscriptExit code0
Real time41m (2518s)
CPU time41m (2478s = 98%)
Outputting started2024-11-22 23:52:59
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74257901_70_20231122T061043Z_gen_g4_detsim_hitreco__20240507T171821Z_reco2.root
Finished2024-11-22 23:54:17
Saved logsjustin-logs:301485.134-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ex determination failure: 0, 199
Classifier summary: 
Output 0: 0.000589561, 0.999048, 0.000362445, 
Output 1: 0.105772, 0.893093, 0.00112043, 1.53662e-05, 
Output 2: 0.999546, 0.000453709, 

396
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1211!
Begin processing the 100th record. run: 74257901 subRun: 1 event: 7100 at 23-Nov-2024 00:52:53 CET
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
> Running Algorithm: Alg0003, LArNeutrinoEventValidation
---RAW-MATCHING-OUTPUT--------------------------------------------------------------------------
Failure in algorithm Alg0003, LArNeutrinoEventValidation, STATUS_CODE_NOT_INITIALIZED
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  23-Nov-2024 00:52:54 CET run: 74257901 subRun: 1 event: 7100
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfit@BeginModule  23-Nov-2024 00:52:54 CET run: 74257901 subRun: 1 event: 7100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfit@BeginModule  23-Nov-2024 00:52:54 CET run: 74257901 subRun: 1 event: 7100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:52:54 CET run: 74257901 subRun: 1 event: 7100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:52:54 CET run: 74257901 subRun: 1 event: 7100
Comparing two wires in the same plane: return failure
%MSG
237
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 547!
23-Nov-2024 00:52:57 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74257901_70_20231122T061043Z_gen_g4_detsim_hitreco__20240507T171821Z_reco2_reco_data_2024-11-22T_231106Z.root"
23-Nov-2024 00:52:57 CET  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/c8/ab/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74257901_70_20231122T061043Z_gen_g4_detsim_hitreco__20240507T171821Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              0.83745       22.6501       329.59        8.98763       41.1264        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0169535     0.0414698     0.0923015     0.0420424     0.0136806       100    
reco:linecluster:LineCluster                           0.108587      0.264063       4.37459      0.171148      0.490516        100    
reco:trajcluster:TrajCluster                           0.0478123     0.394148       10.1363      0.0581224      1.23857        100    
reco:pandora:StandardPandora                           0.0570409      1.82156       32.8012       1.28766       3.20848        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000126342   0.00536375     0.104452     0.00142262     0.0122405       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000194183    0.0108817     0.163113     0.00273186     0.0215802       100    
reco:pandoracalo:Calorimetry                          0.000105712    0.0135939     0.339065     0.000893267    0.0419926       100    
reco:pandorapid:Chi2ParticleID                         4.215e-05    0.000201247   0.00246209    0.000135712   0.000281952      100    
reco:trkshowersplit:TrackShowerHits                   0.000116421    0.0157554     0.399326     0.000579838    0.0499636       100    
reco:pmtrack:PMAlgTrackMaker                          0.000985963     1.72385       40.8298      0.152816       4.76597        100    
reco:pmtrackcalo:Calorimetry                           5.88e-05     0.00758959      0.17361     0.000949072    0.0221665       100    
reco:pmtrackpid:Chi2ParticleID                         2.36e-05     0.000279086   0.00304861    0.000145852   0.000401727      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000156452     1.58463       30.2167      0.254277       3.8109         100    
reco:pmtrajfitcalo:Calorimetry                        5.4681e-05     0.0145854     0.408797     0.00147106     0.0485718       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.2811e-05    0.000197896   0.000971073   0.000156617   0.000154019      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000786641     2.05823       54.6814       0.18163       6.3295         100    
reco:pmtracktccalo:Calorimetry                        5.6851e-05    0.00678674     0.155483     0.00108444     0.0213683       100    
reco:pmtracktcpid:Chi2ParticleID                      2.2771e-05    0.000267388   0.00264026    0.000158222   0.000375521      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000131852     1.45543       32.1658      0.246462       3.78129        100    
reco:pmtrajfittccalo:Calorimetry                      5.3241e-05     0.0123958     0.422835     0.00116971     0.0466425       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.2421e-05    0.000351953   0.00431349    0.000183168   0.00057286       100    
reco:blurredcluster:BlurredClustering                 0.000117321    0.985022       8.95494      0.626293       1.31046        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000154692     8.94848       106.55        2.36252       16.5861        100    
reco:emshower:EMShower                                0.000213383    0.0283069     0.244751     0.00368685     0.0467871       100    
reco:cvnmap:CVNMapper                                 2.2681e-05     0.0111773     0.0351226     0.0141777    0.00864015       100    
reco:cvneva:CVNEvaluator                               1.624e-05     0.671821       1.17291      0.918356      0.459077        100    
reco:energyrecnumu:EnergyReco                         0.000381505    0.0325848     0.848846     0.00386568     0.115989        100    
reco:energyrecnue:EnergyReco                          0.000146372   0.00188233     0.0305309    0.000541817   0.00396631       100    
reco:energyrecnc:EnergyReco                           0.00145865    0.00448433     0.0357897    0.00327187    0.00455553       100    
reco:energyrecnumurange:EnergyReco                    0.000149371    0.0322841      1.04763     0.00257536     0.130155        100    
reco:energyrecnumumcs:EnergyReco                      0.000893432    0.0318549     0.947488      0.0034153     0.119894        100    
reco:opdec:Deconvolution                               0.0904509     0.290667      0.813944       0.28289      0.117177        100    
reco:ophitspe:OpHitFinderDeco                          0.369437       1.93666       3.50331       1.96442      0.785464        100    
reco:opflash:OpFlashFinder                            0.000350515   0.00167515    0.00552311    0.00167147    0.000737426      100    
reco:rns:RandomNumberSaver                             2.197e-05    4.74679e-05   0.000325664   4.4341e-05    3.00365e-05      100    
reco:anglereconue:NuAngularReco                       0.000183613   0.00138422     0.0193255    0.000545062   0.00247545       100    
reco:anglereconumu:NuAngularReco                      7.8521e-05    0.00103733     0.0188882    0.000270239   0.00240198       100    
reco:anglereconuepfps:NuAngularReco                   0.000146392   0.00125892     0.0203723    0.000441231    0.0025817       100    
reco:anglereconumupfps:NuAngularReco                  0.000128322   0.00114426     0.0197179    0.000330415   0.00256727       100    
[art]:TriggerResults:TriggerResultInserter             9.06e-06     1.47382e-05    4.793e-05    1.3805e-05    4.67972e-06      100    
end_path:out1:RootOutput                               3.91e-06     8.26965e-06    2.403e-05     7.33e-06     3.99376e-06      100    
end_path:out1:RootOutput(write)                        0.0224406     0.234542      0.754644      0.247976       0.15207        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21725.3 MB
  Peak resident set size usage (VmHWM): 2293.06 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74257901_70_20231122T061043Z_gen_g4_detsim_hitreco__20240507T171821Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74257901_70_20231122T061043Z_gen_g4_detsim_hitreco__20240507T171821Z_reco2_reco_2024-11-22T_231106Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74257901_70_20231122T061043Z_gen_g4_detsim_hitreco__20240507T171821Z_reco2_reco_data_2024-11-22T_231106Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 14:04:01 UTC       justIN version: 01.01.09