justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301452.182@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301452.182@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:40:21
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2024-11-23 00:15:05
From worker nodeHostnameb9p08p3221.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:10:55
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6220954_342_20231122T085731Z_gen_g4_detsim_hitreco__20240503T065330Z_reco2.root
JobscriptExit code0
Real time55m (3318s)
CPU time52m (3157s = 95%)
Outputting started2024-11-23 00:06:13
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6220954_342_20231122T085731Z_gen_g4_detsim_hitreco__20240503T065330Z_reco2.root
Finished2024-11-23 00:15:05
Saved logsjustin-logs:301452.182-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

gTrackMaker:pmtracktc@BeginModule  23-Nov-2024 01:06:04 CET run: 6220954 subRun: 1 event: 34300
Track empty.
%MSG
%MSG-e pma::Track3D:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 01:06:04 CET run: 6220954 subRun: 1 event: 34300
Hit sorting problem.
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:06:04 CET run: 6220954 subRun: 1 event: 34300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:06:04 CET run: 6220954 subRun: 1 event: 34300
1st wire C:0 T:14 P:2 W:866 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:06:04 CET run: 6220954 subRun: 1 event: 34300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:06:04 CET run: 6220954 subRun: 1 event: 34300
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:06:04 CET run: 6220954 subRun: 1 event: 34300
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 137, 72, 94
minwire 0: 2016
minwire 1: 1199
minwire 2: 1582
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.00313805, 0.0001472, 0.996715, 
Output 1: 0.0673711, 0.915478, 0.0169548, 0.00019568, 
Output 2: 0.996338, 0.00366185, 

523
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1826!
23-Nov-2024 01:06:12 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6220954_342_20231122T085731Z_gen_g4_detsim_hitreco__20240503T065330Z_reco2_reco_data_2024-11-22T_231100Z.root"
23-Nov-2024 01:06:12 CET  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/dc/6f/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6220954_342_20231122T085731Z_gen_g4_detsim_hitreco__20240503T065330Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2.11237       29.7035       452.896       10.906        65.8411        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0165787     0.041339      0.223171      0.0388873     0.0210207       100    
reco:linecluster:LineCluster                           0.152732      0.448941       19.2627      0.176812       1.93559        100    
reco:trajcluster:TrajCluster                           0.0475482      1.14546       43.414       0.0597371      5.86519        100    
reco:pandora:StandardPandora                            0.99515       2.50209       35.327        1.39762       5.13863        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000148522   0.00621543     0.116614     0.00148214     0.0152502       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000225382    0.0133335     0.344402      0.0031886     0.0370255       100    
reco:pandoracalo:Calorimetry                          0.000124491    0.0201061     0.633824     0.00102621     0.0808711       100    
reco:pandorapid:Chi2ParticleID                         4.213e-05    0.00019675    0.00234167    0.000144311   0.000244269      100    
reco:trkshowersplit:TrackShowerHits                   0.000115651    0.0339021      1.15993     0.00063919     0.152271        100    
reco:pmtrack:PMAlgTrackMaker                          0.00137345      2.54251       64.3147      0.211542       8.09533        100    
reco:pmtrackcalo:Calorimetry                          7.6081e-05     0.0123913     0.335151     0.000867287    0.0467482       100    
reco:pmtrackpid:Chi2ParticleID                        2.9921e-05    0.000328291   0.00347445    0.000161881   0.000561871      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000225752     2.38774       46.3537      0.333129       6.75276        100    
reco:pmtrajfitcalo:Calorimetry                        7.3321e-05     0.0188148     0.614977     0.00132178     0.0714064       100    
reco:pmtrajfitpid:Chi2ParticleID                       3.04e-05     0.000217073   0.00130817    0.000176912   0.000191517      100    
reco:pmtracktc:PMAlgTrackMaker                         0.0011084      3.34911       77.2705      0.243015       11.3981        100    
reco:pmtracktccalo:Calorimetry                        8.7631e-05    0.00791805      0.24436     0.000869683    0.0276519       100    
reco:pmtracktcpid:Chi2ParticleID                       3.068e-05    0.000296117   0.00302235    0.000160111   0.000431406      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000171111     1.83305       34.5861      0.301463       4.97928        100    
reco:pmtrajfittccalo:Calorimetry                      6.5101e-05     0.0158051     0.413983     0.00113639     0.0569176       100    
reco:pmtrajfittcpid:Chi2ParticleID                     2.587e-05    0.00038719    0.00335204    0.000175066   0.000590925      100    
reco:blurredcluster:BlurredClustering                 0.00219159      1.11924       7.8299       0.552153       1.54399        100    
reco:emtrkmichelid:EmTrackMichelId                     0.180664       10.4999       132.522       2.72188       21.9769        100    
reco:emshower:EMShower                                0.000295353    0.0254266     0.188558     0.00269824     0.0416901       100    
reco:cvnmap:CVNMapper                                  2.208e-05     0.0117441     0.0550774     0.0110184     0.0114401       100    
reco:cvneva:CVNEvaluator                              1.6691e-05      0.72642       1.22164      0.970658      0.473681        100    
reco:energyrecnumu:EnergyReco                         0.000350532    0.0299986     0.744937     0.00391091     0.0952838       100    
reco:energyrecnue:EnergyReco                          0.000131321   0.00217007     0.0336794    0.000550795   0.00497053       100    
reco:energyrecnc:EnergyReco                           0.00173617    0.00482971     0.0386369    0.00337983    0.00546314       100    
reco:energyrecnumurange:EnergyReco                    0.000191162    0.0277391     0.691833     0.00279533     0.0928466       100    
reco:energyrecnumumcs:EnergyReco                      0.000952207    0.0280076      0.70512     0.00388921     0.0852356       100    
reco:opdec:Deconvolution                               0.0545445     0.302027      0.575622      0.300186      0.0959389       100    
reco:ophitspe:OpHitFinderDeco                          0.203221       2.27591       4.31538       2.22891      0.938353        100    
reco:opflash:OpFlashFinder                            0.000257302   0.00153488    0.00612266    0.00147178    0.000788283      100    
reco:rns:RandomNumberSaver                             1.823e-05    4.35569e-05   0.000403523   4.03355e-05   3.79553e-05      100    
reco:anglereconue:NuAngularReco                       0.000170581   0.00146928     0.0249044    0.000438489   0.00340597       100    
reco:anglereconumu:NuAngularReco                      8.3341e-05    0.00126587     0.0242031    0.000236327   0.00342095       100    
reco:anglereconuepfps:NuAngularReco                   0.000138641   0.00144296     0.024893     0.000372694   0.00351057       100    
reco:anglereconumupfps:NuAngularReco                  0.00010537    0.00131165     0.0247414    0.000310712   0.00330017       100    
[art]:TriggerResults:TriggerResultInserter             9.49e-06     1.52024e-05   5.6891e-05    1.42355e-05   6.02959e-06      100    
end_path:out1:RootOutput                                3.4e-06     8.66396e-06   3.0471e-05    8.7455e-06    3.90981e-06      100    
end_path:out1:RootOutput(write)                        0.0187977     0.260637       1.07523      0.250631      0.181514        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21637.2 MB
  Peak resident set size usage (VmHWM): 2257.66 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6220954_342_20231122T085731Z_gen_g4_detsim_hitreco__20240503T065330Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6220954_342_20231122T085731Z_gen_g4_detsim_hitreco__20240503T065330Z_reco2_reco_2024-11-22T_231100Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6220954_342_20231122T085731Z_gen_g4_detsim_hitreco__20240503T065330Z_reco2_reco_data_2024-11-22T_231100Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 13:51:25 UTC       justIN version: 01.01.09