justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301488.13@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301488.13@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:59:11
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-11-22 23:44:36
From worker nodeHostnamedune001-3354926.0-lcg2726.gridpp.rl.ac.uk
cpuinfoAMD EPYC 9654 96-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:14:28
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515285_35_20231201T120548Z_gen_g4_detsim_hitreco__20240507T190113Z_reco2.root
JobscriptExit code0
Real time26m (1584s)
CPU time27m (1641s = 103%)
Outputting started2024-11-22 23:40:53
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515285_35_20231201T120548Z_gen_g4_detsim_hitreco__20240507T190113Z_reco2.root
Finished2024-11-22 23:44:36
Saved logsjustin-logs:301488.13-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:40:35 UTC run: 50515285 subRun: 1 event: 3600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:40:47 UTC run: 50515285 subRun: 1 event: 3600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:40:47 UTC run: 50515285 subRun: 1 event: 3600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:40:47 UTC run: 50515285 subRun: 1 event: 3600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:40:47 UTC run: 50515285 subRun: 1 event: 3600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:40:47 UTC run: 50515285 subRun: 1 event: 3600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  22-Nov-2024 23:40:47 UTC run: 50515285 subRun: 1 event: 3600
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 488, 910, 674
minwire 0: 1270
minwire 1: 1611
minwire 2: 862
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0506286, 0.0498932, 0.899478, 
Output 1: 0.7785, 0.184082, 0.0283836, 0.00903385, 
Output 2: 0.618352, 0.381648, 

697
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2761!
22-Nov-2024 23:40:52 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515285_35_20231201T120548Z_gen_g4_detsim_hitreco__20240507T190113Z_reco2_reco_data_2024-11-22T_231433Z.root"
22-Nov-2024 23:40:52 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/f7/25/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515285_35_20231201T120548Z_gen_g4_detsim_hitreco__20240507T190113Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.965977       14.5441       122.064       8.58415       16.8061        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00217321     0.108465      0.458632      0.0891065     0.0731821       100    
reco:linecluster:LineCluster                          0.00594369     0.235752        1.945       0.167766      0.235335        100    
reco:trajcluster:TrajCluster                          0.000877314    0.168252       3.23612      0.0728092     0.384683        100    
reco:pandora:StandardPandora                           0.0465996      1.44523       7.7185        1.31372      0.774929        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000140552   0.00375663     0.0354176    0.00168465    0.00535463       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000193462   0.00699429     0.0564457    0.00260868     0.0114221       100    
reco:pandoracalo:Calorimetry                          0.000110587   0.00544958     0.0796275    0.000933098    0.0124175       100    
reco:pandorapid:Chi2ParticleID                        4.3296e-05    0.000169405   0.00314785    0.000132585   0.000308202      100    
reco:trkshowersplit:TrackShowerHits                   6.0361e-05    0.00636332      0.1184      0.000624944    0.0165327       100    
reco:pmtrack:PMAlgTrackMaker                          0.00138897     0.910878       15.4329      0.177612       2.02393        100    
reco:pmtrackcalo:Calorimetry                          7.4963e-05    0.00289342     0.0280902    0.000913429   0.00505744       100    
reco:pmtrackpid:Chi2ParticleID                        2.5569e-05    0.000206907   0.00111148     0.0001554    0.00018563       100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000201524    0.886246       11.1893      0.273489       1.59735        100    
reco:pmtrajfitcalo:Calorimetry                        6.4357e-05    0.00615589     0.137669     0.00158757     0.0156642       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.7322e-05    0.000179131   0.000482489   0.000173562   0.000104435      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00126446      1.00599       18.0721      0.209494       2.27907        100    
reco:pmtracktccalo:Calorimetry                        7.1218e-05    0.00264968     0.0282795    0.00101921    0.00434233       100    
reco:pmtracktcpid:Chi2ParticleID                      2.7892e-05    0.00021002    0.00100677    0.000172094   0.000175899      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000169336    0.835254       12.5913      0.311037       1.54678        100    
reco:pmtrajfittccalo:Calorimetry                      5.7577e-05    0.00437759     0.0696656    0.00120029    0.00908213       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.4477e-05    0.000261895   0.00141507    0.000194008   0.000259174      100    
reco:blurredcluster:BlurredClustering                 0.000200723    0.659835       4.35131      0.302274      0.822902        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000101192     5.4069        44.6617       2.20005       7.2332         100    
reco:emshower:EMShower                                0.000184879    0.0195056     0.281844     0.00295312     0.0362995       100    
reco:cvnmap:CVNMapper                                 1.7757e-05    0.00630945     0.034425     0.00434067    0.00715388       100    
reco:cvneva:CVNEvaluator                              1.4802e-05     0.597299       1.07719       0.75618       0.35429        100    
reco:energyrecnumu:EnergyReco                         0.000419544    0.020196      0.409517     0.00722858     0.0558691       100    
reco:energyrecnue:EnergyReco                          0.000151229   0.00117731     0.0111762    0.000577662   0.00149481       100    
reco:energyrecnc:EnergyReco                           0.00134719    0.00305019     0.0115483    0.00264342    0.00146782       100    
reco:energyrecnumurange:EnergyReco                    0.000223027    0.0159217     0.423976     0.00240265     0.0559646       100    
reco:energyrecnumumcs:EnergyReco                      0.00113659     0.0174641     0.420546     0.00297403     0.0561787       100    
reco:opdec:Deconvolution                               0.0450741     0.314726      0.916227      0.283655      0.161368        100    
reco:ophitspe:OpHitFinderDeco                          0.169339       1.62788       3.21562       1.60531      0.651772        100    
reco:opflash:OpFlashFinder                            0.000321675   0.00135278    0.00734062    0.00129898    0.000748767      100    
reco:rns:RandomNumberSaver                             1.996e-05    3.49922e-05   0.000508227   2.73465e-05   4.81832e-05      100    
reco:anglereconue:NuAngularReco                       0.000191038   0.000806052    0.010481     0.000404931   0.00129271       100    
reco:anglereconumu:NuAngularReco                       7.293e-05    0.000588789   0.00701699    0.000215745   0.00103589       100    
reco:anglereconuepfps:NuAngularReco                   0.000134793   0.000722842    0.011196     0.000326809   0.00133196       100    
reco:anglereconumupfps:NuAngularReco                  0.000103967   0.000641294   0.00727846    0.000287349   0.00105453       100    
[art]:TriggerResults:TriggerResultInserter             9.634e-06    1.44934e-05   0.000109375   1.26595e-05   1.0254e-05       100    
end_path:out1:RootOutput                               3.616e-06    5.24929e-06   3.4532e-05     4.336e-06    4.28515e-06      100    
end_path:out1:RootOutput(write)                        0.0225219     0.211783      0.558546      0.227639       0.1085         100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 40024.2 MB
  Peak resident set size usage (VmHWM): 2233.87 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515285_35_20231201T120548Z_gen_g4_detsim_hitreco__20240507T190113Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515285_35_20231201T120548Z_gen_g4_detsim_hitreco__20240507T190113Z_reco2_reco_2024-11-22T_231433Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50515285_35_20231201T120548Z_gen_g4_detsim_hitreco__20240507T190113Z_reco2_reco_data_2024-11-22T_231433Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 15:59:24 UTC       justIN version: 01.01.09