justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 87173.0@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID87173.0@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3836
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-10-26 06:13:33
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce01
Last heartbeat2024-10-26 07:02:27
From worker nodeHostnamedune001-3378028.0-lcg2711.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-26 06:14:45
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50581281_590_20231204T052049Z_gen_g4_detsim_hitreco__20240509T213321Z_reco2.root
JobscriptExit code0
Real time47m (2834s)
CPU time41m (2468s = 87%)
Outputting started2024-10-26 07:02:00
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/03836/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50581281_590_20231204T052049Z_gen_g4_detsim_hitreco__20240509T213321Z_reco2.root
Finished2024-10-26 07:02:27
Saved logsjustin-logs:87173.0-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

51 UTC run: 50581281 subRun: 1 event: 59100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 07:01:51 UTC run: 50581281 subRun: 1 event: 59100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 07:01:51 UTC run: 50581281 subRun: 1 event: 59100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 07:01:51 UTC run: 50581281 subRun: 1 event: 59100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 07:01:51 UTC run: 50581281 subRun: 1 event: 59100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  26-Oct-2024 07:01:51 UTC run: 50581281 subRun: 1 event: 59100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  26-Oct-2024 07:01:55 UTC run: 50581281 subRun: 1 event: 59100
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 188, 295, 194
minwire 0: 670
minwire 1: 2328
minwire 2: 327
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.000369326, 0.99927, 0.000360711, 
Output 1: 0.00320596, 0.711337, 0.282759, 0.00269773, 
Output 2: 0.978307, 0.0216933, 

462
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1513!
26-Oct-2024 07:01:58 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50581281_590_20231204T052049Z_gen_g4_detsim_hitreco__20240509T213321Z_reco2_reco_data_2024-10-26T_061452Z.root"
26-Oct-2024 07:01:58 UTC  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/fc/f9/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50581281_590_20231204T052049Z_gen_g4_detsim_hitreco__20240509T213321Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2.54941       25.4411       274.254       10.1511       48.1509        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0276876     0.0561123     0.154027       0.05592      0.0198291       100    
reco:linecluster:LineCluster                           0.250306      0.341049       3.34528      0.273546      0.339016        100    
reco:trajcluster:TrajCluster                           0.0804665     0.633878       14.134       0.0980118      2.14462        100    
reco:pandora:StandardPandora                            1.07904       2.27727       50.0667       1.34993       5.08871        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000161144   0.00548106     0.0744781    0.00190586     0.011485        100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000235105    0.016247      0.433906     0.00322092     0.0519396       100    
reco:pandoracalo:Calorimetry                          0.000130738    0.0140736     0.227072     0.00134778     0.0405556       100    
reco:pandorapid:Chi2ParticleID                        4.5759e-05    0.000183708   0.00143691    0.000153021   0.00015937       100    
reco:trkshowersplit:TrackShowerHits                   0.00012632     0.0193017     0.398533     0.000796141    0.0653738       100    
reco:pmtrack:PMAlgTrackMaker                          0.00123555      2.05268       30.4416      0.200853       5.53028        100    
reco:pmtrackcalo:Calorimetry                          6.2314e-05    0.00975592     0.210899     0.00102446     0.0315044       100    
reco:pmtrackpid:Chi2ParticleID                        2.8183e-05    0.000298762    0.0022534    0.000164774   0.000433319      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.00017902      2.21855       63.8013      0.363872       7.11066        100    
reco:pmtrajfitcalo:Calorimetry                        6.4277e-05     0.0163596      0.28094     0.00192301     0.0457908       100    
reco:pmtrajfitpid:Chi2ParticleID                      3.0125e-05    0.000263347    0.0050296    0.000179776   0.000509734      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00108319      2.78261       58.3164      0.282617       8.86606        100    
reco:pmtracktccalo:Calorimetry                         5.947e-05    0.00764007     0.196154     0.00112226     0.0244513       100    
reco:pmtracktcpid:Chi2ParticleID                      2.7001e-05    0.000289789   0.00225533    0.000173617   0.000386305      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000187844     1.61933       23.4671      0.391027       4.02282        100    
reco:pmtrajfittccalo:Calorimetry                      5.5804e-05     0.0125329     0.276762     0.00147718     0.0400101       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.3966e-05    0.000359078   0.00273764    0.000204254   0.000523807      100    
reco:blurredcluster:BlurredClustering                  0.0137877     0.951929       7.06767       0.57127       1.22295        100    
reco:emtrkmichelid:EmTrackMichelId                      0.22081       8.97169       101.908       2.92695       17.1738        100    
reco:emshower:EMShower                                0.000334925    0.0314277     0.227545     0.00766203     0.0504064       100    
reco:cvnmap:CVNMapper                                 2.2884e-05     0.0163428     0.0482152     0.0194661     0.0118618       100    
reco:cvneva:CVNEvaluator                              1.7066e-05     0.766963       1.94401      0.919228      0.448254        100    
reco:energyrecnumu:EnergyReco                         0.000400314    0.0267194     0.430756     0.00849423     0.0579347       100    
reco:energyrecnue:EnergyReco                          0.000125289   0.00201592     0.0283832    0.000595664   0.00436828       100    
reco:energyrecnc:EnergyReco                           0.00135213    0.00427336     0.032441     0.00288586     0.0044831       100    
reco:energyrecnumurange:EnergyReco                    0.000183987    0.0219862     0.425484     0.00261285     0.0570145       100    
reco:energyrecnumumcs:EnergyReco                      0.00131759     0.0234709     0.420975     0.00357034     0.0560783       100    
reco:opdec:Deconvolution                               0.124319      0.350939       0.67775      0.344069      0.0954813       100    
reco:ophitspe:OpHitFinderDeco                          0.388623       1.91771       3.5579        1.83598      0.743448        100    
reco:opflash:OpFlashFinder                            0.000412393   0.00194632     0.0101103    0.00182093    0.00114769       100    
reco:rns:RandomNumberSaver                             2.641e-05    5.96661e-05   0.00033786    6.0306e-05    3.15944e-05      100    
reco:anglereconue:NuAngularReco                       0.000176456    0.0016266     0.0258228    0.000646976   0.00351045       100    
reco:anglereconumu:NuAngularReco                      5.9349e-05    0.00125048     0.024201     0.000291164   0.00339353       100    
reco:anglereconuepfps:NuAngularReco                   0.000109925   0.00139478     0.0243041    0.000454781   0.00338868       100    
reco:anglereconumupfps:NuAngularReco                  8.4598e-05     0.0012805     0.0241191    0.000335507    0.0034509       100    
[art]:TriggerResults:TriggerResultInserter            1.0756e-05    1.71785e-05   5.1928e-05    1.6304e-05    5.24205e-06      100    
end_path:out1:RootOutput                               3.476e-06    5.67096e-06   3.5374e-05     4.261e-06    4.27146e-06      100    
end_path:out1:RootOutput(write)                        0.0225558     0.261091      0.959051      0.257677      0.163638        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40308.7 MB
  Peak resident set size usage (VmHWM): 2528.8 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50581281_590_20231204T052049Z_gen_g4_detsim_hitreco__20240509T213321Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50581281_590_20231204T052049Z_gen_g4_detsim_hitreco__20240509T213321Z_reco2_reco_2024-10-26T_061452Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50581281_590_20231204T052049Z_gen_g4_detsim_hitreco__20240509T213321Z_reco2_reco_data_2024-10-26T_061452Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
work
justIN time: 2024-11-17 09:50:33 UTC       justIN version: 01.01.09