justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301487.14@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301487.14@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:57:53
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2024-11-23 00:04:29
From worker nodeHostnameb9p12p1803.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:11:45
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50609765_90_20231207T050656Z_gen_g4_detsim_hitreco__20240510T024716Z_reco2.root
JobscriptExit code0
Real time48m (2895s)
CPU time46m (2787s = 96%)
Outputting started2024-11-23 00:00:01
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50609765_90_20231207T050656Z_gen_g4_detsim_hitreco__20240510T024716Z_reco2.root
Finished2024-11-23 00:04:29
Saved logsjustin-logs:301487.14-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

geDist2 calculation.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:59:32 CET run: 50609765 subRun: 1 event: 9100
Track empty.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:59:32 CET run: 50609765 subRun: 1 event: 9100
TuneFullTree failed.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:59:32 CET run: 50609765 subRun: 1 event: 9100
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:59:32 CET run: 50609765 subRun: 1 event: 9100
Track empty.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:59:32 CET run: 50609765 subRun: 1 event: 9100
TuneFullTree failed.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:59:32 CET run: 50609765 subRun: 1 event: 9100
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:59:32 CET run: 50609765 subRun: 1 event: 9100
Track empty.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:59:32 CET run: 50609765 subRun: 1 event: 9100
TuneFullTree failed.
%MSG
Boundary wire vector sizes: 1769, 683, 1350
minwire 0: 1176
minwire 1: 554
minwire 2: 1412
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0164636, 0.00264121, 0.980895, 
Output 1: 0.206685, 0.60308, 0.150555, 0.039679, 
Output 2: 0.200208, 0.799792, 

628
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2211!
23-Nov-2024 01:00:00 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50609765_90_20231207T050656Z_gen_g4_detsim_hitreco__20240510T024716Z_reco2_reco_data_2024-11-22T_231150Z.root"
23-Nov-2024 01:00:00 CET  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/ba/97/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50609765_90_20231207T050656Z_gen_g4_detsim_hitreco__20240510T024716Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.562048       26.3575       339.234       8.68494       50.8072        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0171223     0.0474488      0.36585      0.0417007     0.0387664       100    
reco:linecluster:LineCluster                           0.0955499     0.283569       4.96902      0.182514      0.513192        100    
reco:trajcluster:TrajCluster                           0.0478586     0.694416       19.4415      0.0559125      2.52528        100    
reco:pandora:StandardPandora                           0.0736102      2.40381       29.7259       1.32321       4.69237        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000163972   0.00584981     0.103141     0.00124346     0.0135591       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000208823    0.0171096     0.355058     0.00251765     0.0470682       100    
reco:pandoracalo:Calorimetry                          0.000138932    0.0190284     0.630742     0.000854601    0.0705959       100    
reco:pandorapid:Chi2ParticleID                         4.59e-05     0.000177816   0.00144575    0.000133837   0.00017435       100    
reco:trkshowersplit:TrackShowerHits                   0.000106871    0.0202152     0.412277     0.000668654    0.0648445       100    
reco:pmtrack:PMAlgTrackMaker                          0.00112729      2.47898       37.3426      0.100118       6.24278        100    
reco:pmtrackcalo:Calorimetry                          6.5251e-05     0.0105299     0.322937     0.000957536    0.0375336       100    
reco:pmtrackpid:Chi2ParticleID                         2.78e-05     0.000290317   0.00330768    0.000141002   0.000488631      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000184342     2.19038       46.2335      0.260916       6.35778        100    
reco:pmtrajfitcalo:Calorimetry                        6.7091e-05     0.0196452     0.730307     0.000937296    0.0800086       100    
reco:pmtrajfitpid:Chi2ParticleID                       2.903e-05    0.000195869   0.000940692   0.000136407   0.00016591       100    
reco:pmtracktc:PMAlgTrackMaker                        0.00086116      3.09248       65.8208      0.165177       9.47503        100    
reco:pmtracktccalo:Calorimetry                         6.361e-05    0.00769944     0.239326     0.000826255    0.0261876       100    
reco:pmtracktcpid:Chi2ParticleID                      2.4871e-05    0.000248401   0.00232108    0.000145372   0.000341305      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000156932     1.44234       27.7415      0.180127       3.65952        100    
reco:pmtrajfittccalo:Calorimetry                       6.417e-05     0.0119187     0.287781     0.000990667    0.0372049       100    
reco:pmtrajfittcpid:Chi2ParticleID                     2.671e-05    0.000310666   0.00237797    0.000157037   0.000421924      100    
reco:blurredcluster:BlurredClustering                 0.000128452     1.05731       8.78006      0.418369       1.56464        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000144052     9.38997       115.76        2.19408       17.9136        100    
reco:emshower:EMShower                                0.000193822    0.0228533     0.241122     0.00527641     0.038366        100    
reco:cvnmap:CVNMapper                                  2.747e-05     0.0104105     0.0624286     0.0131104     0.0104286       100    
reco:cvneva:CVNEvaluator                               2.029e-05     0.633096       1.25844      0.910971      0.514803        100    
reco:energyrecnumu:EnergyReco                         0.000453435    0.0336576     0.565941     0.00387036     0.0978593       100    
reco:energyrecnue:EnergyReco                          0.000137562   0.00200427     0.0310449    0.000567582    0.0039482       100    
reco:energyrecnc:EnergyReco                           0.00171307    0.00447116     0.0369752    0.00330237    0.00426338       100    
reco:energyrecnumurange:EnergyReco                    0.000183412    0.030743       0.55232     0.00282182     0.0935707       100    
reco:energyrecnumumcs:EnergyReco                      0.00130839     0.0324257     0.545278     0.00350943     0.0922257       100    
reco:opdec:Deconvolution                               0.0710837     0.278582      0.672697      0.283266      0.104705        100    
reco:ophitspe:OpHitFinderDeco                          0.144539       1.87742       4.27034       1.82189      0.899485        100    
reco:opflash:OpFlashFinder                            0.000152942   0.00154552    0.00386495     0.0015042    0.000670143      100    
reco:rns:RandomNumberSaver                            2.3221e-05    4.79864e-05   0.000311783   4.47005e-05   2.8401e-05       100    
reco:anglereconue:NuAngularReco                       0.000155582   0.00156684     0.025878     0.000465561   0.00335554       100    
reco:anglereconumu:NuAngularReco                      8.9662e-05    0.00125137     0.0235148    0.000209777   0.00314913       100    
reco:anglereconuepfps:NuAngularReco                   0.000128592   0.00144877     0.0243246    0.000381435   0.00320573       100    
reco:anglereconumupfps:NuAngularReco                  0.000105842   0.00132159     0.0243203    0.000304224   0.00320173       100    
[art]:TriggerResults:TriggerResultInserter             8.73e-06     1.40753e-05   3.9231e-05    1.3615e-05    4.72525e-06      100    
end_path:out1:RootOutput                               3.34e-06     9.38507e-06   2.4901e-05    9.3805e-06    2.56353e-06      100    
end_path:out1:RootOutput(write)                        0.0105934     0.228538       1.17387      0.233859      0.191709        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21679.3 MB
  Peak resident set size usage (VmHWM): 2221.02 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50609765_90_20231207T050656Z_gen_g4_detsim_hitreco__20240510T024716Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50609765_90_20231207T050656Z_gen_g4_detsim_hitreco__20240510T024716Z_reco2_reco_2024-11-22T_231150Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50609765_90_20231207T050656Z_gen_g4_detsim_hitreco__20240510T024716Z_reco2_reco_data_2024-11-22T_231150Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 13:58:37 UTC       justIN version: 01.01.09