justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 91685.3@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID91685.3@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3932
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-06 02:50:47
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-11-06 07:32:33
From worker nodeHostnamewn1205081.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-06 02:52:43
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6464269_714_20231207T034113Z_gen_g4_detsim_hitreco__20240510T042247Z_reco2.root
JobscriptExit code0
Real time4h (16754s)
CPU time4h (15879s = 94%)
Outputting started2024-11-06 07:31:58
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/03932/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6464269_714_20231207T034113Z_gen_g4_detsim_hitreco__20240510T042247Z_reco2.root
Finished2024-11-06 07:32:33
Saved logsjustin-logs:91685.3-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

0
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  06-Nov-2024 07:31:40 GMT run: 6464269 subRun: 1 event: 71500
Track empty.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  06-Nov-2024 07:31:40 GMT run: 6464269 subRun: 1 event: 71500
TuneFullTree failed.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  06-Nov-2024 07:31:40 GMT run: 6464269 subRun: 1 event: 71500
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  06-Nov-2024 07:31:40 GMT run: 6464269 subRun: 1 event: 71500
Track empty.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  06-Nov-2024 07:31:40 GMT run: 6464269 subRun: 1 event: 71500
TuneFullTree failed.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  06-Nov-2024 07:31:40 GMT run: 6464269 subRun: 1 event: 71500
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  06-Nov-2024 07:31:40 GMT run: 6464269 subRun: 1 event: 71500
Track empty.
%MSG
%MSG-e pma::Track3D:  PMAlgTrajFitter:pmtrajfittc@BeginModule  06-Nov-2024 07:31:40 GMT run: 6464269 subRun: 1 event: 71500
TuneFullTree failed.
%MSG
Boundary wire vector sizes: 297, 251, 230
minwire 0: 960
minwire 1: 1239
minwire 2: 1046
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.382287, 0.0194408, 0.598272, 
Output 1: 0.337893, 0.534323, 0.120433, 0.00735118, 
Output 2: 0.235455, 0.764545, 

549
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1947!
06-Nov-2024 07:31:56 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6464269_714_20231207T034113Z_gen_g4_detsim_hitreco__20240510T042247Z_reco2_reco_data_2024-11-06T_025251Z.root"
06-Nov-2024 07:31:56 GMT  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/9e/32/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6464269_714_20231207T034113Z_gen_g4_detsim_hitreco__20240510T042247Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.870323       163.931       8851.77       13.5983       938.442        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0278248     0.0590488     0.150357      0.0624972     0.0181198       100    
reco:linecluster:LineCluster                           0.159381       2.60809       119.618      0.276887       14.0572        100    
reco:trajcluster:TrajCluster                           0.0792135      8.41457       368.248      0.0916227      48.3645        100    
reco:pandora:StandardPandora                           0.0972468      61.2207       4585.72       2.05799       469.217        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000191862    0.0345321      1.8172      0.00213679     0.195264        100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000267063    0.0231305     0.459161     0.00372208     0.0612756       100    
reco:pandoracalo:Calorimetry                          0.000145655    0.136922       7.47303     0.00143531     0.822703        100    
reco:pandorapid:Chi2ParticleID                        5.5515e-05    0.000276719   0.00236184    0.000176599   0.00037352       100    
reco:trkshowersplit:TrackShowerHits                   0.000103074    0.116044       5.57865     0.000944867    0.636843        100    
reco:pmtrack:PMAlgTrackMaker                          0.00217034      13.6721       602.438      0.259293       72.0553        100    
reco:pmtrackcalo:Calorimetry                          0.000119004    0.113929       6.18081     0.00119729     0.696391        100    
reco:pmtrackpid:Chi2ParticleID                        5.0004e-05    0.000700466    0.0150564     0.0002011    0.00202489       100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000310075     17.7231       1324.82      0.365702       132.998        100    
reco:pmtrajfitcalo:Calorimetry                        0.000102534    0.132863       7.22508     0.00173709     0.793467        100    
reco:pmtrajfitpid:Chi2ParticleID                      4.1138e-05    0.000330324   0.00272462    0.000199802   0.000432235      100    
reco:pmtracktc:PMAlgTrackMaker                          0.00181       17.6995       787.574      0.289681       93.2841        100    
reco:pmtracktccalo:Calorimetry                        0.00011123     0.0459106      2.1873      0.00112523     0.253874        100    
reco:pmtracktcpid:Chi2ParticleID                      4.5225e-05    0.00058523     0.0117277    0.000210171   0.00145756       100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000269699     7.24804       297.474      0.375913       35.7848        100    
reco:pmtrajfittccalo:Calorimetry                      0.000103154    0.121684       6.49316     0.00151705     0.726429        100    
reco:pmtrajfittcpid:Chi2ParticleID                    4.4043e-05    0.000803816    0.0171163    0.000235538   0.00224695       100    
reco:blurredcluster:BlurredClustering                 0.00015377      1.88706        19.69       0.967196       3.21136        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000170451     27.1913       692.108       3.83248       88.8368        100    
reco:emshower:EMShower                                0.000241856    0.0625873      1.09294      0.0114847     0.155241        100    
reco:cvnmap:CVNMapper                                  2.686e-05     0.0092898     0.0651061     0.0094341    0.00993172       100    
reco:cvneva:CVNEvaluator                              2.3645e-05      1.22515       2.56989       1.58454      0.829854        100    
reco:energyrecnumu:EnergyReco                         0.000406937    0.169612       10.6202     0.00748944      1.06552        100    
reco:energyrecnue:EnergyReco                          0.000213873   0.00976285     0.407577     0.000871364    0.0454823       100    
reco:energyrecnc:EnergyReco                           0.00284283     0.0131995     0.442154     0.00446756     0.0481768       100    
reco:energyrecnumurange:EnergyReco                    0.000239221    0.197205       14.2345     0.00420668      1.42007        100    
reco:energyrecnumumcs:EnergyReco                      0.00135576     0.209052       15.2269     0.00586804      1.51811        100    
reco:opdec:Deconvolution                               0.0914493     0.436392      0.731308      0.449818      0.141131        100    
reco:ophitspe:OpHitFinderDeco                          0.245532       2.70245       5.49267       2.77132       1.14036        100    
reco:opflash:OpFlashFinder                            0.000301218   0.00197991    0.00651249    0.00190577    0.00101554       100    
reco:rns:RandomNumberSaver                            2.3084e-05    3.6737e-05    0.000542954   3.1224e-05    5.10983e-05      100    
reco:anglereconue:NuAngularReco                       0.000218392   0.00681183     0.272537     0.00045024     0.0325214       100    
reco:anglereconumu:NuAngularReco                      0.000103585   0.00752487     0.363384     0.000267134    0.0401857       100    
reco:anglereconuepfps:NuAngularReco                   0.000181632   0.00793718     0.404522     0.000438402    0.0432831       100    
reco:anglereconumupfps:NuAngularReco                  0.000162447   0.00797596     0.402125     0.000372247    0.043386        100    
[art]:TriggerResults:TriggerResultInserter            1.2894e-05    1.90901e-05   9.6913e-05    1.6497e-05    1.01317e-05      100    
end_path:out1:RootOutput                               3.517e-06    5.21804e-06   2.7452e-05     4.268e-06    4.21471e-06      100    
end_path:out1:RootOutput(write)                        0.0252745     0.409954       3.77422      0.365387      0.483853        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 22261.6 MB
  Peak resident set size usage (VmHWM): 2807.49 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6464269_714_20231207T034113Z_gen_g4_detsim_hitreco__20240510T042247Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6464269_714_20231207T034113Z_gen_g4_detsim_hitreco__20240510T042247Z_reco2_reco_2024-11-06T_025251Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6464269_714_20231207T034113Z_gen_g4_detsim_hitreco__20240510T042247Z_reco2_reco_data_2024-11-06T_025251Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
work
justIN time: 2024-11-17 10:44:38 UTC       justIN version: 01.01.09