justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301452.149@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301452.149@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:40:19
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2024-11-22 23:59:23
From worker nodeHostnameb9p10p9366.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:10:17
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577113_343_20231204T011159Z_gen_g4_detsim_hitreco__20240509T214712Z_reco2.root
JobscriptExit code0
Real time41m (2519s)
CPU time41m (2477s = 98%)
Outputting started2024-11-22 23:52:17
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577113_343_20231204T011159Z_gen_g4_detsim_hitreco__20240509T214712Z_reco2.root
Finished2024-11-22 23:59:23
Saved logsjustin-logs:301452.149-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

subRun: 1 event: 34400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:52:07 CET run: 50577113 subRun: 1 event: 34400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:52:07 CET run: 50577113 subRun: 1 event: 34400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:52:07 CET run: 50577113 subRun: 1 event: 34400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 00:52:07 CET run: 50577113 subRun: 1 event: 34400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:52:13 CET run: 50577113 subRun: 1 event: 34400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 00:52:13 CET run: 50577113 subRun: 1 event: 34400
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 366, 185, 245
minwire 0: 519
minwire 1: 1495
minwire 2: 554
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.000931618, 0.998998, 7.07186e-05, 
Output 1: 0.912275, 0.0874704, 0.000244088, 1.07971e-05, 
Output 2: 0.999513, 0.000486689, 

439
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1358!
23-Nov-2024 00:52:16 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577113_343_20231204T011159Z_gen_g4_detsim_hitreco__20240509T214712Z_reco2_reco_data_2024-11-22T_231023Z.root"
23-Nov-2024 00:52:16 CET  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/56/c9/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577113_343_20231204T011159Z_gen_g4_detsim_hitreco__20240509T214712Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              0.5595        23.0015       527.674       8.77672       57.8992        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0164201     0.0717113     0.938018      0.0424316     0.119807        100    
reco:linecluster:LineCluster                           0.0947096     0.525699       30.6268      0.168632       3.03396        100    
reco:trajcluster:TrajCluster                           0.0472654      0.57996       31.4486      0.0590174      3.23338        100    
reco:pandora:StandardPandora                           0.0583314      1.9986        30.3331       1.2335        4.05938        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000152241   0.00377645     0.057538     0.00123793    0.00743188       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000211942    0.008362      0.135912     0.00281232     0.0164936       100    
reco:pandoracalo:Calorimetry                          0.000125952    0.0164735      0.81369     0.000834405    0.0843962       100    
reco:pandorapid:Chi2ParticleID                        4.3031e-05    0.000145203   0.000509046   0.000122302   8.28514e-05      100    
reco:trkshowersplit:TrackShowerHits                   9.9551e-05     0.0165015      0.82172     0.000716134    0.0851178       100    
reco:pmtrack:PMAlgTrackMaker                          0.00118685      1.89313       78.4477      0.129813       8.17756        100    
reco:pmtrackcalo:Calorimetry                           6.721e-05    0.00580738     0.153232     0.000754193    0.0193362       100    
reco:pmtrackpid:Chi2ParticleID                         2.626e-05    0.000248233    0.0023838    0.000135831   0.000364226      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000176252     2.03983       79.7572      0.195491       8.47805        100    
reco:pmtrajfitcalo:Calorimetry                        7.7691e-05     0.0182574     0.838174     0.00132592     0.0883127       100    
reco:pmtrajfitpid:Chi2ParticleID                       3.241e-05    0.000186467   0.000587467   0.000140652   0.000135948      100    
reco:pmtracktc:PMAlgTrackMaker                         0.0011537      2.54851       94.4731      0.179351       10.4924        100    
reco:pmtracktccalo:Calorimetry                        6.7291e-05    0.00371929     0.0727242    0.00080931    0.00967147       100    
reco:pmtracktcpid:Chi2ParticleID                       2.37e-05     0.000227614   0.00186294    0.000140012   0.000272784      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000153482     1.42876       42.7838      0.247785       4.76116        100    
reco:pmtrajfittccalo:Calorimetry                       6.032e-05     0.010782      0.425569     0.00116271     0.0459588       100    
reco:pmtrajfittcpid:Chi2ParticleID                     2.363e-05    0.000321429   0.00388701    0.000165872   0.000512715      100    
reco:blurredcluster:BlurredClustering                 8.7591e-05     0.938976       7.70439      0.456123       1.20222        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000142272     7.82495       126.525       2.07038       16.5318        100    
reco:emshower:EMShower                                0.000186082    0.0321083     0.241524     0.00832742     0.0473095       100    
reco:cvnmap:CVNMapper                                 2.1901e-05     0.0145727     0.0379164     0.0184827    0.00986458       100    
reco:cvneva:CVNEvaluator                              1.8621e-05     0.683646       1.16752      0.904936      0.441794        100    
reco:energyrecnumu:EnergyReco                         0.000432255    0.0148631     0.250376      0.0039275     0.0354833       100    
reco:energyrecnue:EnergyReco                          0.000145022   0.00137844     0.0152997    0.000476861   0.00246608       100    
reco:energyrecnc:EnergyReco                           0.00171144    0.00383335     0.0189224    0.00303474    0.00270298       100    
reco:energyrecnumurange:EnergyReco                    0.000183082    0.0125441     0.208006     0.00257538     0.0323606       100    
reco:energyrecnumumcs:EnergyReco                      0.00168028     0.0145901     0.232381     0.00326019     0.0348194       100    
reco:opdec:Deconvolution                               0.0711908     0.265963      0.686224      0.268766      0.0940702       100    
reco:ophitspe:OpHitFinderDeco                          0.149477       1.79366       3.72836       1.76678      0.751436        100    
reco:opflash:OpFlashFinder                            0.000227513   0.00157769    0.00510085    0.00158118    0.000723088      100    
reco:rns:RandomNumberSaver                             1.73e-05     5.02995e-05   0.000464246   4.43855e-05   4.30628e-05      100    
reco:anglereconue:NuAngularReco                       0.000178842   0.00102877     0.0123678    0.00045552    0.00185262       100    
reco:anglereconumu:NuAngularReco                      7.2941e-05    0.000722107   0.00967622    0.000225953   0.00153893       100    
reco:anglereconuepfps:NuAngularReco                   0.000120781   0.000907928   0.00995664    0.00038302    0.00159116       100    
reco:anglereconumupfps:NuAngularReco                  9.5142e-05    0.000796207   0.00995263    0.000269413   0.00157891       100    
[art]:TriggerResults:TriggerResultInserter             8.14e-06     1.26927e-05    5.32e-05      1.207e-05    4.63494e-06      100    
end_path:out1:RootOutput                               2.94e-06     6.64975e-06    2.624e-05     6.19e-06     2.70213e-06      100    
end_path:out1:RootOutput(write)                        0.0153531     0.222164      0.900655      0.227539      0.146019        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21890.9 MB
  Peak resident set size usage (VmHWM): 2457.95 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577113_343_20231204T011159Z_gen_g4_detsim_hitreco__20240509T214712Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577113_343_20231204T011159Z_gen_g4_detsim_hitreco__20240509T214712Z_reco2_reco_2024-11-22T_231023Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50577113_343_20231204T011159Z_gen_g4_detsim_hitreco__20240509T214712Z_reco2_reco_data_2024-11-22T_231023Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 13:52:15 UTC       justIN version: 01.01.09