justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301491.135@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301491.135@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:09:00
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2024-11-23 00:18:42
From worker nodeHostnameb9p08p7686.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:23:38
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_1133_20231204T140440Z_gen_g4_detsim_hitreco__20240509T215319Z_reco2.root
JobscriptExit code0
Real time46m (2804s)
CPU time36m (2189s = 78%)
Outputting started2024-11-23 00:10:22
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_1133_20231204T140440Z_gen_g4_detsim_hitreco__20240509T215319Z_reco2.root
Finished2024-11-23 00:18:42
Saved logsjustin-logs:301491.135-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

10:12 CET run: 74517882 subRun: 1 event: 113400
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:10:12 CET run: 74517882 subRun: 1 event: 113400
Track empty.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:10:12 CET run: 74517882 subRun: 1 event: 113400
TuneFullTree failed.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:10:12 CET run: 74517882 subRun: 1 event: 113400
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:10:12 CET run: 74517882 subRun: 1 event: 113400
Track empty.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:10:12 CET run: 74517882 subRun: 1 event: 113400
TuneFullTree failed.
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 01:10:15 CET run: 74517882 subRun: 1 event: 113400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 01:10:15 CET run: 74517882 subRun: 1 event: 113400
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 131, 152, 123
minwire 0: 1254
minwire 1: 1672
minwire 2: 1030
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.399253, 0.59863, 0.00211637, 
Output 1: 0.89752, 0.0951482, 0.00623417, 0.0010978, 
Output 2: 0.964987, 0.0350128, 

619
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2179!
23-Nov-2024 01:10:21 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_1133_20231204T140440Z_gen_g4_detsim_hitreco__20240509T215319Z_reco2_reco_data_2024-11-22T_233224Z.root"
23-Nov-2024 01:10:21 CET  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/97/de/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_1133_20231204T140440Z_gen_g4_detsim_hitreco__20240509T215319Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.632111       19.8909       116.456       9.88592       23.183         100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0173799     0.0462606     0.272911      0.0435078     0.0274685       100    
reco:linecluster:LineCluster                            0.12803      0.205911      0.927718      0.174187      0.0990608       100    
reco:trajcluster:TrajCluster                           0.0474784     0.232893       2.31741      0.0621327     0.424518        100    
reco:pandora:StandardPandora                           0.0900054      2.37568       90.4412       1.31999       8.87194        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000145081   0.00404143     0.0263785    0.00169012    0.00558698       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000203322    0.014922      0.474996      0.0035215     0.0522996       100    
reco:pandoracalo:Calorimetry                          0.00012236    0.00822945     0.127211     0.00136102     0.0184954       100    
reco:pandorapid:Chi2ParticleID                         4.134e-05    0.000168788   0.000741764   0.000146476   0.000105641      100    
reco:trkshowersplit:TrackShowerHits                   0.000153341   0.00827834     0.0934961    0.000844635    0.0173881       100    
reco:pmtrack:PMAlgTrackMaker                          0.00109876      1.34557       12.845       0.194693       2.66803        100    
reco:pmtrackcalo:Calorimetry                          6.4221e-05    0.00512063     0.115399     0.000996025    0.0134808       100    
reco:pmtrackpid:Chi2ParticleID                         2.449e-05    0.000238015   0.00137615    0.000161835   0.000244777      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000188811     1.25208       10.1377      0.378627       2.17839        100    
reco:pmtrajfitcalo:Calorimetry                         5.993e-05    0.00840451     0.126129     0.00159111     0.0175988       100    
reco:pmtrajfitpid:Chi2ParticleID                       2.277e-05    0.000186532   0.000574093   0.000149181   0.000121212      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000838644     1.69612       21.6177      0.260465       3.66045        100    
reco:pmtracktccalo:Calorimetry                        6.1131e-05    0.00383577     0.0554862    0.00102482    0.00811483       100    
reco:pmtracktcpid:Chi2ParticleID                       2.515e-05    0.000226855   0.00137199    0.000156066   0.000213192      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000187341    0.972268       7.69894      0.302452       1.52204        100    
reco:pmtrajfittccalo:Calorimetry                       7.893e-05    0.00599803     0.0710575    0.00117266     0.0118865       100    
reco:pmtrajfittcpid:Chi2ParticleID                     3.394e-05    0.000297139   0.00167239    0.000170486   0.000334459      100    
reco:blurredcluster:BlurredClustering                 0.000138031    0.842336       6.65274      0.466186       1.05251        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000136151     7.40855       48.1272       3.00348       10.1168        100    
reco:emshower:EMShower                                0.000186851    0.0275133     0.404877     0.00702049     0.0498301       100    
reco:cvnmap:CVNMapper                                 2.4901e-05     0.0118056     0.0312084     0.0142422    0.00727851       100    
reco:cvneva:CVNEvaluator                               1.785e-05     0.767053       1.24077      0.949329      0.427306        100    
reco:energyrecnumu:EnergyReco                         0.000317032    0.0140061     0.173826     0.00496662     0.0273556       100    
reco:energyrecnue:EnergyReco                          0.000138491    0.0014136    0.00896933    0.000521163   0.00183205       100    
reco:energyrecnc:EnergyReco                           0.00175818    0.00398843     0.0119543    0.00340847    0.00211845       100    
reco:energyrecnumurange:EnergyReco                    0.000138421    0.0119766     0.160629     0.00314396     0.0260096       100    
reco:energyrecnumumcs:EnergyReco                      0.00169597     0.0136574     0.156495     0.00417129     0.0256656       100    
reco:opdec:Deconvolution                               0.0759852     0.286438      0.490293      0.292115      0.0907575       100    
reco:ophitspe:OpHitFinderDeco                           0.14392       2.06552       4.15123       1.99087       0.89538        100    
reco:opflash:OpFlashFinder                            0.000189011   0.00153397    0.00446871     0.0014846    0.000655735      100    
reco:rns:RandomNumberSaver                             1.994e-05    4.47283e-05   0.000335342    4.068e-05    3.05296e-05      100    
reco:anglereconue:NuAngularReco                       0.000164631   0.000975154   0.00871473    0.000478142   0.00134319       100    
reco:anglereconumu:NuAngularReco                       7.467e-05    0.000723195   0.00840507    0.000219067   0.00127036       100    
reco:anglereconuepfps:NuAngularReco                   0.000119511   0.000881844   0.00844037    0.000393072   0.00127073       100    
reco:anglereconumupfps:NuAngularReco                   9.743e-05    0.000770734   0.00837238    0.000290692   0.00125374       100    
[art]:TriggerResults:TriggerResultInserter             8.89e-06     1.3708e-05      5.2e-05     1.3195e-05    5.31563e-06      100    
end_path:out1:RootOutput                               3.61e-06     8.22349e-06    2.702e-05     8.09e-06     2.3728e-06       100    
end_path:out1:RootOutput(write)                        0.0121746      0.24281      0.632365      0.265426      0.128505        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21474.2 MB
  Peak resident set size usage (VmHWM): 2005.97 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_1133_20231204T140440Z_gen_g4_detsim_hitreco__20240509T215319Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_1133_20231204T140440Z_gen_g4_detsim_hitreco__20240509T215319Z_reco2_reco_2024-11-22T_233224Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_74517882_1133_20231204T140440Z_gen_g4_detsim_hitreco__20240509T215319Z_reco2_reco_data_2024-11-22T_233224Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 14:41:55 UTC       justIN version: 01.01.09