justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108511.14@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108511.14@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:09:40
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce4
Last heartbeat2024-11-22 23:25:28
From worker nodeHostnamen257.dur.scotgrid.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 22:30:05
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419482_47_20231203T163513Z_gen_g4_detsim_hitreco__20240509T215714Z_reco2.root
JobscriptExit code0
Real time52m (3168s)
CPU time46m (2805s = 88%)
Outputting started2024-11-22 23:22:54
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419482_47_20231203T163513Z_gen_g4_detsim_hitreco__20240509T215714Z_reco2.root
Finished2024-11-22 23:25:28
Saved logsjustin-logs:108511.14-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

e  22-Nov-2024 23:22:46 GMT run: 6419482 subRun: 1 event: 4800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:22:46 GMT run: 6419482 subRun: 1 event: 4800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:22:46 GMT run: 6419482 subRun: 1 event: 4800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:22:46 GMT run: 6419482 subRun: 1 event: 4800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:22:46 GMT run: 6419482 subRun: 1 event: 4800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:22:46 GMT run: 6419482 subRun: 1 event: 4800
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:22:46 GMT run: 6419482 subRun: 1 event: 4800
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 133, 111, 88
minwire 0: 2048
minwire 1: 428
minwire 2: 1940
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.145575, 0.0287487, 0.825676, 
Output 1: 0.54783, 0.446036, 0.00594648, 0.000187065, 
Output 2: 0.456519, 0.543481, 

366
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1040!
22-Nov-2024 23:22:53 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419482_47_20231203T163513Z_gen_g4_detsim_hitreco__20240509T215714Z_reco2_reco_data_2024-11-22T_223010Z.root"
22-Nov-2024 23:22:53 GMT  Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/ed/64/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419482_47_20231203T163513Z_gen_g4_detsim_hitreco__20240509T215714Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.933637       27.927        572.748       8.55091       72.4907        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0178261     0.0399684     0.0874229     0.0369598     0.0130491       100    
reco:linecluster:LineCluster                            0.17458      0.408505       10.0902      0.184734       1.18053        100    
reco:trajcluster:TrajCluster                           0.0510372     0.833623       36.9873      0.0574043      4.21022        100    
reco:pandora:StandardPandora                           0.0640547      2.57865       48.9228       1.27942       6.72916        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000143112   0.00585667     0.139117     0.00116485     0.0174174       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000206523    0.0106918     0.107759     0.00212572     0.0211479       100    
reco:pandoracalo:Calorimetry                          0.000114267    0.0240572     0.895013     0.000774867    0.106973        100    
reco:pandorapid:Chi2ParticleID                        4.5126e-05    0.00017738    0.00191296    0.000133403   0.000210356      100    
reco:trkshowersplit:TrackShowerHits                   0.00011571     0.0268295      0.99229     0.000589645    0.127222        100    
reco:pmtrack:PMAlgTrackMaker                          0.00138759      2.70093       83.4647      0.147994       10.0519        100    
reco:pmtrackcalo:Calorimetry                          8.0021e-05     0.0119851     0.482487     0.000740653    0.0564582       100    
reco:pmtrackpid:Chi2ParticleID                        3.3203e-05    0.000288983   0.00415302    0.000149509   0.000555952      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000214929     2.15084       70.382       0.195472       8.45343        100    
reco:pmtrajfitcalo:Calorimetry                         7.891e-05     0.0251451     0.953236     0.00119905     0.112116        100    
reco:pmtrajfitpid:Chi2ParticleID                      3.2612e-05    0.000194658   0.00109598    0.000155595   0.000166423      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00112621      3.27819       103.697      0.182632       12.7824        100    
reco:pmtracktccalo:Calorimetry                        7.8128e-05    0.00760141     0.228066     0.000836435    0.027629        100    
reco:pmtracktcpid:Chi2ParticleID                      3.5577e-05    0.000269963   0.00307756    0.000149979   0.000417585      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000188748     1.5573        33.155       0.191811       4.61193        100    
reco:pmtrajfittccalo:Calorimetry                       7.885e-05     0.0153645     0.521609      0.001039      0.0627268       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.2382e-05    0.000364615   0.00415377    0.000180072   0.000648915      100    
reco:blurredcluster:BlurredClustering                 7.2898e-05      1.00412       8.87963      0.552005       1.43615        100    
reco:emtrkmichelid:EmTrackMichelId                     0.0288354      9.71901       161.928       2.24794       23.2112        100    
reco:emshower:EMShower                                0.000275593    0.0314766     0.457929     0.00521325     0.0619857       100    
reco:cvnmap:CVNMapper                                 2.4897e-05     0.0106599     0.0489501    0.00997342     0.0100613       100    
reco:cvneva:CVNEvaluator                              1.9066e-05     0.688532       1.24879      0.909501      0.439239        100    
reco:energyrecnumu:EnergyReco                         0.00037905     0.0711454      2.14482     0.00437287     0.289129        100    
reco:energyrecnue:EnergyReco                          0.000181655   0.00232474     0.049459     0.00052095    0.00623413       100    
reco:energyrecnc:EnergyReco                           0.00231247    0.00502969     0.0505051     0.003102     0.00651084       100    
reco:energyrecnumurange:EnergyReco                    0.000186885    0.065232       2.21596     0.00283411     0.274823        100    
reco:energyrecnumumcs:EnergyReco                      0.000851458    0.063323       2.17863     0.00321396     0.262335        100    
reco:opdec:Deconvolution                               0.0818091     0.284306      0.514006      0.283657      0.0945607       100    
reco:ophitspe:OpHitFinderDeco                          0.471524       2.04695       4.23097       1.99859      0.837241        100    
reco:opflash:OpFlashFinder                            0.00043673    0.00152474    0.00663798    0.00142651    0.000781874      100    
reco:rns:RandomNumberSaver                            1.9738e-05    4.54651e-05   0.000550827   4.0647e-05    5.22302e-05      100    
reco:anglereconue:NuAngularReco                       0.000182377   0.00159277     0.0448177    0.000432516   0.00502552       100    
reco:anglereconumu:NuAngularReco                      8.8238e-05    0.00130687     0.0412763    0.000236619   0.00470492       100    
reco:anglereconuepfps:NuAngularReco                   0.000151688   0.00150721     0.0459426    0.000379471   0.00511139       100    
reco:anglereconumupfps:NuAngularReco                  0.000127413   0.00138095     0.0410198    0.000296363   0.00469061       100    
[art]:TriggerResults:TriggerResultInserter             9.749e-06    1.5274e-05    5.9643e-05    1.39065e-05   5.93699e-06      100    
end_path:out1:RootOutput                               2.655e-06    5.91821e-06   2.1581e-05     6.002e-06    2.41713e-06      100    
end_path:out1:RootOutput(write)                        0.0233217     0.248392       1.24059      0.257181      0.185181        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 38423 MB
  Peak resident set size usage (VmHWM): 2363.18 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419482_47_20231203T163513Z_gen_g4_detsim_hitreco__20240509T215714Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419482_47_20231203T163513Z_gen_g4_detsim_hitreco__20240509T215714Z_reco2_reco_2024-11-22T_223010Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6419482_47_20231203T163513Z_gen_g4_detsim_hitreco__20240509T215714Z_reco2_reco_data_2024-11-22T_223010Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 11:40:19 UTC       justIN version: 01.01.09