justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108550.115@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108550.115@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:15:23
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-11-23 00:17:57
From worker nodeHostnamedune001-3354964.0-lcg2716.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:33:16
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515284_433_20231201T115541Z_gen_g4_detsim_hitreco__20240507T185802Z_reco2.root
JobscriptExit code0
Real time36m (2173s)
CPU time37m (2251s = 103%)
Outputting started2024-11-23 00:09:29
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515284_433_20231201T115541Z_gen_g4_detsim_hitreco__20240507T185802Z_reco2.root
Finished2024-11-23 00:17:57
Saved logsjustin-logs:108550.115-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

eginModule  23-Nov-2024 00:09:03 UTC run: 50515284 subRun: 1 event: 43400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:09:03 UTC run: 50515284 subRun: 1 event: 43400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:09:03 UTC run: 50515284 subRun: 1 event: 43400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:09:24 UTC run: 50515284 subRun: 1 event: 43400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:09:24 UTC run: 50515284 subRun: 1 event: 43400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:09:24 UTC run: 50515284 subRun: 1 event: 43400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:09:24 UTC run: 50515284 subRun: 1 event: 43400
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 1250, 849, 1201
minwire 0: 2153
minwire 1: 51
minwire 2: 2511
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0510259, 0.0784447, 0.870529, 
Output 1: 0.31256, 0.599593, 0.0783975, 0.00944928, 
Output 2: 0.642062, 0.357938, 

471
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1424!
23-Nov-2024 00:09:28 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515284_433_20231201T115541Z_gen_g4_detsim_hitreco__20240507T185802Z_reco2_reco_data_2024-11-22T_233319Z.root"
23-Nov-2024 00:09:28 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/80/9f/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515284_433_20231201T115541Z_gen_g4_detsim_hitreco__20240507T185802Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.587085       20.3554       307.32        8.32209       38.2498        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00163565     0.105568      0.292598      0.101674      0.051266        100    
reco:linecluster:LineCluster                           0.0242546     0.493228       14.2148      0.325594       1.40756        100    
reco:trajcluster:TrajCluster                          0.000880189    0.608166       22.6601      0.159971       2.40315        100    
reco:pandora:StandardPandora                           0.0950686      1.66306       12.1501       1.31327       1.48257        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000157728   0.00474691     0.0519194    0.00157576    0.00870472       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.00021158     0.0118861     0.295238      0.0026839     0.0323833       100    
reco:pandoracalo:Calorimetry                          0.000109816    0.0126809     0.309621     0.00094707     0.0393172       100    
reco:pandorapid:Chi2ParticleID                        3.5633e-05    0.000161935   0.00222485    0.000113682   0.000223158      100    
reco:trkshowersplit:TrackShowerHits                   7.5444e-05     0.0149343      0.42586     0.000597052    0.052267        100    
reco:pmtrack:PMAlgTrackMaker                          0.00140988      1.85402       58.1347      0.157074       6.42447        100    
reco:pmtrackcalo:Calorimetry                           7.248e-05    0.00545183     0.0963895    0.000905622    0.0137966       100    
reco:pmtrackpid:Chi2ParticleID                        2.7952e-05    0.00022582    0.00123487    0.000130292   0.000257817      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000196707     1.29304       20.5516      0.217354       2.96524        100    
reco:pmtrajfitcalo:Calorimetry                        6.4257e-05     0.0139501     0.451965     0.00130572     0.0503145       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.7601e-05    0.000171822   0.000850104   0.000135785   0.000131184      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00102364      2.6074        77.6142      0.218665       8.88807        100    
reco:pmtracktccalo:Calorimetry                        6.8694e-05    0.00409766     0.0726617    0.00089085    0.00989839       100    
reco:pmtracktcpid:Chi2ParticleID                      2.7681e-05    0.000203622   0.000941882   0.000138158   0.000195788      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000169716     1.18464       21.608        0.26459       2.69946        100    
reco:pmtrajfittccalo:Calorimetry                      6.4467e-05    0.00820523     0.153365     0.00106712     0.0221737       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.5548e-05    0.00028189    0.00202836    0.000160477   0.000365387      100    
reco:blurredcluster:BlurredClustering                 0.000249136    0.669807       4.7503       0.408781       0.80332        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000116656     6.94208       72.0057       1.97501       12.2632        100    
reco:emshower:EMShower                                0.000173883    0.0176656     0.251843     0.00173129     0.0379811       100    
reco:cvnmap:CVNMapper                                 1.9319e-05     0.0061406     0.0346758    0.00422701     0.0072003       100    
reco:cvneva:CVNEvaluator                              1.4812e-05     0.525436      0.924986      0.589773      0.324725        100    
reco:energyrecnumu:EnergyReco                         0.000345843    0.0372867      1.37058     0.00595609     0.146531        100    
reco:energyrecnue:EnergyReco                          0.000104588   0.00137409     0.0181657    0.000442894   0.00275202       100    
reco:energyrecnc:EnergyReco                           0.00122484    0.00320187     0.0222431    0.00240569    0.00307024       100    
reco:energyrecnumurange:EnergyReco                     0.0001919     0.033751       1.35402     0.00218002     0.145516        100    
reco:energyrecnumumcs:EnergyReco                      0.000868802    0.0345901      1.32473     0.00269515     0.142559        100    
reco:opdec:Deconvolution                               0.0407098     0.324408      0.664067      0.319465      0.125443        100    
reco:ophitspe:OpHitFinderDeco                          0.264309       1.64971       3.01765       1.65707      0.661804        100    
reco:opflash:OpFlashFinder                            0.000261595   0.00130087    0.00389791    0.00121427    0.000588623      100    
reco:rns:RandomNumberSaver                            1.8648e-05    2.93385e-05   0.000236768   2.50975e-05   2.21938e-05      100    
reco:anglereconue:NuAngularReco                       0.000140242   0.00118417     0.0166547    0.000368061   0.00252365       100    
reco:anglereconumu:NuAngularReco                      4.5539e-05    0.000969407    0.0153167    0.000194744    0.0024235       100    
reco:anglereconuepfps:NuAngularReco                   9.3361e-05     0.0010752     0.0145687    0.000309107   0.00237524       100    
reco:anglereconumupfps:NuAngularReco                  6.1283e-05    0.00100853      0.01513     0.000241149   0.00240661       100    
[art]:TriggerResults:TriggerResultInserter             7.982e-06    1.15039e-05   3.6335e-05    1.1027e-05    3.19036e-06      100    
end_path:out1:RootOutput                               2.714e-06    4.04709e-06   1.5904e-05    3.5955e-06    1.51498e-06      100    
end_path:out1:RootOutput(write)                        0.018821      0.216475       0.72412      0.216756      0.139189        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40302 MB
  Peak resident set size usage (VmHWM): 2497.72 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515284_433_20231201T115541Z_gen_g4_detsim_hitreco__20240507T185802Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515284_433_20231201T115541Z_gen_g4_detsim_hitreco__20240507T185802Z_reco2_reco_2024-11-22T_233319Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515284_433_20231201T115541Z_gen_g4_detsim_hitreco__20240507T185802Z_reco2_reco_data_2024-11-22T_233319Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 15:46:50 UTC       justIN version: 01.01.09