justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301491.188@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301491.188@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:09:01
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2024-11-22 23:54:03
From worker nodeHostnamedune001-2994385.0-lcg2720.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:24:58
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6402377_562_20231202T110240Z_gen_g4_detsim_hitreco__20240507T210940Z_reco2.root
JobscriptExit code0
Real time26m (1598s)
CPU time29m (1766s = 110%)
Outputting started2024-11-22 23:51:36
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6402377_562_20231202T110240Z_gen_g4_detsim_hitreco__20240507T210940Z_reco2.root
Finished2024-11-22 23:54:03
Saved logsjustin-logs:301491.188-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:51:31 UTC run: 6402377 subRun: 1 event: 56300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:51:31 UTC run: 6402377 subRun: 1 event: 56300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:51:31 UTC run: 6402377 subRun: 1 event: 56300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:51:34 UTC run: 6402377 subRun: 1 event: 56300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:51:34 UTC run: 6402377 subRun: 1 event: 56300
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 41, 38, 29
minwire 0: 1795
minwire 1: 612
minwire 2: 1925
Used alternate method to get min and max wires due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 198, 397
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.993664, 0.000776723, 0.00555963, 
Output 1: 0.816404, 0.17824, 0.00498739, 0.000368233, 
Output 2: 0.995836, 0.00416399, 

404
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1208!
22-Nov-2024 23:51:36 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6402377_562_20231202T110240Z_gen_g4_detsim_hitreco__20240507T210940Z_reco2_reco_data_2024-11-22T_232502Z.root"
22-Nov-2024 23:51:36 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/77/26/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6402377_562_20231202T110240Z_gen_g4_detsim_hitreco__20240507T210940Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.793446       14.9376       111.579       7.81612       18.7986        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0149601     0.100843      0.303678      0.0873698     0.0577973       100    
reco:linecluster:LineCluster                           0.0402031     0.242447      0.918569       0.21486      0.156233        100    
reco:trajcluster:TrajCluster                          0.000622859    0.278088       6.65985      0.103711      0.735452        100    
reco:pandora:StandardPandora                           0.216408       1.36179       5.63041       1.21103      0.617221        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000110055   0.00356916       0.028      0.00143969    0.00537224       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000145219    0.0114269      0.32076     0.00199885     0.038225        100    
reco:pandoracalo:Calorimetry                          8.1864e-05    0.00706099     0.113467     0.000860903    0.0166918       100    
reco:pandorapid:Chi2ParticleID                        3.0847e-05    0.000125833   0.000907237   0.000104533   0.000107136      100    
reco:trkshowersplit:TrackShowerHits                   8.8343e-05    0.00825928     0.160312     0.000620906    0.0221537       100    
reco:pmtrack:PMAlgTrackMaker                          0.000874008    0.995087       12.9633      0.184988       2.06521        100    
reco:pmtrackcalo:Calorimetry                          4.9905e-05    0.00415949     0.0482522    0.000950398   0.00914922       100    
reco:pmtrackpid:Chi2ParticleID                         1.966e-05    0.000187017   0.000964925   0.000133311   0.000191043      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.00015241     0.906597       10.2642      0.242747       1.62226        100    
reco:pmtrajfitcalo:Calorimetry                        4.2394e-05    0.00710203     0.0797902    0.00148654     0.0154202       100    
reco:pmtrajfitpid:Chi2ParticleID                      1.8167e-05    0.000145872   0.000590791   0.000124333   0.000102775      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000724883     1.32811       27.1192      0.220139       3.36725        100    
reco:pmtracktccalo:Calorimetry                        4.7932e-05    0.00366827     0.0541961    0.000939697   0.00840279       100    
reco:pmtracktcpid:Chi2ParticleID                      1.8658e-05    0.000186201   0.00104152    0.000137817   0.000172411      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000109595    0.778137       6.05141      0.248181       1.24807        100    
reco:pmtrajfittccalo:Calorimetry                       3.943e-05    0.00521276     0.0518041    0.00128843     0.010186        100    
reco:pmtrajfittcpid:Chi2ParticleID                    1.6245e-05    0.000234457   0.00111063    0.000144102   0.00023703       100    
reco:blurredcluster:BlurredClustering                 0.000216736    0.799546       4.51176      0.423945      0.936025        100    
reco:emtrkmichelid:EmTrackMichelId                    7.5855e-05      5.79254       37.0386       2.2928        8.46139        100    
reco:emshower:EMShower                                0.00011224     0.0189573      0.12053      0.0058641     0.0265389       100    
reco:cvnmap:CVNMapper                                 1.2249e-05    0.00573114     0.0338984    0.00400394    0.00699457       100    
reco:cvneva:CVNEvaluator                               1.353e-05     0.437445      0.842524      0.546591      0.274891        100    
reco:energyrecnumu:EnergyReco                         0.000231799    0.0322451      1.21104     0.00550423     0.129335        100    
reco:energyrecnue:EnergyReco                          8.4908e-05    0.00107138    0.00664051    0.000443143   0.00152023       100    
reco:energyrecnc:EnergyReco                           0.00119129    0.00253233    0.00895417    0.00199396    0.00169672       100    
reco:energyrecnumurange:EnergyReco                    0.000129686    0.0284131      1.18305     0.00136454     0.126753        100    
reco:energyrecnumumcs:EnergyReco                      0.000625303    0.0288665      1.16742     0.00222767     0.124681        100    
reco:opdec:Deconvolution                               0.063667      0.273318      0.574339      0.275698      0.119713        100    
reco:ophitspe:OpHitFinderDeco                          0.134598       1.29341       2.79357       1.28516      0.621954        100    
reco:opflash:OpFlashFinder                            8.0652e-05     0.0010962    0.00293791    0.00104609    0.000473086      100    
reco:rns:RandomNumberSaver                            1.7757e-05    2.68315e-05   0.000212159   2.28545e-05   1.9826e-05       100    
reco:anglereconue:NuAngularReco                       0.000138238   0.000807407   0.00581221    0.000335586   0.00113474       100    
reco:anglereconumu:NuAngularReco                      4.5358e-05    0.000625273   0.00559729    0.000182846   0.00106942       100    
reco:anglereconuepfps:NuAngularReco                   9.0997e-05    0.000722324   0.00554126    0.000266197   0.00107038       100    
reco:anglereconumupfps:NuAngularReco                  6.2765e-05    0.000663233    0.0054236    0.000213101   0.00107975       100    
[art]:TriggerResults:TriggerResultInserter             8.342e-06    1.11168e-05   3.5934e-05    1.0771e-05    3.29174e-06      100    
end_path:out1:RootOutput                               2.914e-06    4.17453e-06   2.8503e-05    3.6155e-06    2.73663e-06      100    
end_path:out1:RootOutput(write)                       0.00927474     0.175568      0.469964      0.170739      0.101859        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40335.9 MB
  Peak resident set size usage (VmHWM): 2528.6 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6402377_562_20231202T110240Z_gen_g4_detsim_hitreco__20240507T210940Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6402377_562_20231202T110240Z_gen_g4_detsim_hitreco__20240507T210940Z_reco2_reco_2024-11-22T_232502Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6402377_562_20231202T110240Z_gen_g4_detsim_hitreco__20240507T210940Z_reco2_reco_data_2024-11-22T_232502Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 04:05:12 UTC       justIN version: 01.01.09