justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301452.151@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301452.151@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:40:19
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2024-11-22 23:57:35
From worker nodeHostnameb9p08p3221.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:10:47
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6492237_214_20231208T054132Z_gen_g4_detsim_hitreco__20240510T045031Z_reco2.root
JobscriptExit code0
Real time42m (2529s)
CPU time39m (2398s = 94%)
Outputting started2024-11-22 23:52:56
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6492237_214_20231208T054132Z_gen_g4_detsim_hitreco__20240510T045031Z_reco2.root
Finished2024-11-22 23:57:35
Saved logsjustin-logs:301452.151-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

geDist2 calculation.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:52:28 CET run: 6492237 subRun: 1 event: 21500
Track empty.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:52:28 CET run: 6492237 subRun: 1 event: 21500
TuneFullTree failed.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:52:28 CET run: 6492237 subRun: 1 event: 21500
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:52:28 CET run: 6492237 subRun: 1 event: 21500
Track empty.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:52:28 CET run: 6492237 subRun: 1 event: 21500
TuneFullTree failed.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:52:28 CET run: 6492237 subRun: 1 event: 21500
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:52:28 CET run: 6492237 subRun: 1 event: 21500
Track empty.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:52:28 CET run: 6492237 subRun: 1 event: 21500
TuneFullTree failed.
%MSG
Boundary wire vector sizes: 1269, 1362, 1099
minwire 0: 347
minwire 1: 2258
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0509447, 0.0376375, 0.911418, 
Output 1: 0.602268, 0.309402, 0.0710891, 0.0172407, 
Output 2: 0.338768, 0.661232, 

628
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2323!
23-Nov-2024 00:52:55 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6492237_214_20231208T054132Z_gen_g4_detsim_hitreco__20240510T045031Z_reco2_reco_data_2024-11-22T_231052Z.root"
23-Nov-2024 00:52:55 CET  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/fc/90/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6492237_214_20231208T054132Z_gen_g4_detsim_hitreco__20240510T045031Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.697842       21.7875       218.856       9.24901       36.7227        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0166664     0.054861      0.474478      0.0427427     0.0648114       100    
reco:linecluster:LineCluster                           0.0952992     0.244351       2.12969      0.165561      0.280251        100    
reco:trajcluster:TrajCluster                           0.0479151     0.365775       8.34049      0.0579263      1.24372        100    
reco:pandora:StandardPandora                           0.0596335      1.89537       30.5899       1.27401       3.20436        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000144721   0.00454671     0.0638786    0.00133856    0.00911443       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000219702    0.0212748     0.469589     0.00291325     0.0689492       100    
reco:pandoracalo:Calorimetry                          0.000125711    0.012913      0.295335     0.000845617    0.0401943       100    
reco:pandorapid:Chi2ParticleID                         4.088e-05    0.000159692    0.001327     0.000115606   0.000154412      100    
reco:trkshowersplit:TrackShowerHits                   9.5831e-05     0.0139111     0.287583     0.00060198     0.0470479       100    
reco:pmtrack:PMAlgTrackMaker                          0.000980388     1.67507       29.236       0.190815       4.41945        100    
reco:pmtrackcalo:Calorimetry                          6.2351e-05    0.00822666     0.208954     0.000713136    0.0265388       100    
reco:pmtrackpid:Chi2ParticleID                         2.535e-05    0.000249843   0.00221747    0.000128141   0.000381472      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000180941     1.36086       14.0099      0.224618       2.72339        100    
reco:pmtrajfitcalo:Calorimetry                        6.7331e-05     0.012494      0.258674     0.00136702     0.0373209       100    
reco:pmtrajfitpid:Chi2ParticleID                       3.185e-05    0.000169988   0.000667655   0.000142312   0.00012261       100    
reco:pmtracktc:PMAlgTrackMaker                        0.00106218      2.06322       36.6507      0.149101       5.80551        100    
reco:pmtracktccalo:Calorimetry                         6.126e-05    0.00695841     0.179311     0.000720011    0.0214866       100    
reco:pmtracktcpid:Chi2ParticleID                      2.7451e-05    0.000239093   0.00224339    0.000129841   0.000324911      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000197441     1.20582       16.5809      0.235438       2.56946        100    
reco:pmtrajfittccalo:Calorimetry                       7.989e-05     0.010257      0.202961     0.000976313    0.0319539       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.3631e-05    0.000312699   0.00267953    0.000159852   0.000460735      100    
reco:blurredcluster:BlurredClustering                 0.000121021    0.945942       8.00026      0.483086       1.31896        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000163521     8.81261       96.8297       2.35448       16.6041        100    
reco:emshower:EMShower                                0.000227732    0.0264106     0.271729     0.00306311     0.0473541       100    
reco:cvnmap:CVNMapper                                  2.77e-05      0.0123641     0.0442727     0.0116743     0.0109568       100    
reco:cvneva:CVNEvaluator                               1.634e-05     0.687982       4.31049      0.812684      0.618157        100    
reco:energyrecnumu:EnergyReco                         0.000314202    0.021813      0.447711     0.00402486     0.0590295       100    
reco:energyrecnue:EnergyReco                          0.000122191   0.00160233      0.02335     0.000556525   0.00307664       100    
reco:energyrecnc:EnergyReco                           0.00153196     0.0037736     0.0269771    0.00300071    0.00329218       100    
reco:energyrecnumurange:EnergyReco                    0.000160091    0.0196313     0.379509     0.00268335     0.0556562       100    
reco:energyrecnumumcs:EnergyReco                      0.00145376     0.0201876     0.364077     0.00329386     0.0538048       100    
reco:opdec:Deconvolution                               0.0630353     0.257612      0.431875      0.258063      0.0783559       100    
reco:ophitspe:OpHitFinderDeco                          0.301139       1.78152       3.88802       1.64559      0.821025        100    
reco:opflash:OpFlashFinder                            0.000288553   0.00152193    0.00566505    0.00142801    0.000821746      100    
reco:rns:RandomNumberSaver                             1.998e-05    4.90179e-05   0.000418233   4.54455e-05   3.87577e-05      100    
reco:anglereconue:NuAngularReco                       0.000161922   0.00115345     0.013107     0.000435624   0.00209352       100    
reco:anglereconumu:NuAngularReco                       7.588e-05    0.000866086    0.0117979    0.000249682    0.0018225       100    
reco:anglereconuepfps:NuAngularReco                   0.000121511   0.00102361     0.0122436    0.000384038   0.00189388       100    
reco:anglereconumupfps:NuAngularReco                  9.4241e-05    0.000946163    0.0124239    0.000309792   0.00191855       100    
[art]:TriggerResults:TriggerResultInserter             8.42e-06     1.42626e-05     5.7e-05     1.3705e-05    5.62878e-06      100    
end_path:out1:RootOutput                               2.83e-06     7.15839e-06   2.3501e-05    6.8155e-06    3.28161e-06      100    
end_path:out1:RootOutput(write)                        0.0193058     0.231441      0.758789       0.24063      0.152068        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21643.1 MB
  Peak resident set size usage (VmHWM): 2258.67 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6492237_214_20231208T054132Z_gen_g4_detsim_hitreco__20240510T045031Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6492237_214_20231208T054132Z_gen_g4_detsim_hitreco__20240510T045031Z_reco2_reco_2024-11-22T_231052Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6492237_214_20231208T054132Z_gen_g4_detsim_hitreco__20240510T045031Z_reco2_reco_data_2024-11-22T_231052Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 13:55:51 UTC       justIN version: 01.01.09