justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301487.4@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301487.4@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:57:53
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2024-11-23 00:26:23
From worker nodeHostnameb9p12p0328.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:11:34
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_165_20231202T160604Z_gen_g4_detsim_hitreco__20240508T041903Z_reco2.root
JobscriptExit code0
Real time54m (3268s)
CPU time49m (2985s = 91%)
Outputting started2024-11-23 00:06:03
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_165_20231202T160604Z_gen_g4_detsim_hitreco__20240508T041903Z_reco2.root
Finished2024-11-23 00:26:23
Saved logsjustin-logs:301487.4-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

eginModule  23-Nov-2024 01:05:54 CET run: 66004350 subRun: 1 event: 16600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 01:05:54 CET run: 66004350 subRun: 1 event: 16600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 01:05:54 CET run: 66004350 subRun: 1 event: 16600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 01:05:54 CET run: 66004350 subRun: 1 event: 16600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 01:05:54 CET run: 66004350 subRun: 1 event: 16600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 01:05:54 CET run: 66004350 subRun: 1 event: 16600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 01:05:54 CET run: 66004350 subRun: 1 event: 16600
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 3450, 5227, 3607
minwire 0: 1309
minwire 1: 503
minwire 2: 1349
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0334928, 0.773801, 0.192707, 
Output 1: 0.161253, 0.516756, 0.218889, 0.103103, 
Output 2: 0.206834, 0.793166, 

774
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 3024!
23-Nov-2024 01:06:01 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_165_20231202T160604Z_gen_g4_detsim_hitreco__20240508T041903Z_reco2_reco_data_2024-11-22T_231140Z.root"
23-Nov-2024 01:06:01 CET  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/27/e6/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_165_20231202T160604Z_gen_g4_detsim_hitreco__20240508T041903Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2.20052       29.7466       683.716       9.07901       77.9699        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0176921     0.141424       2.55357      0.0451785     0.378796        100    
reco:linecluster:LineCluster                            0.15404       0.42754       9.24493      0.185415       1.05489        100    
reco:trajcluster:TrajCluster                           0.0487115      1.03756       50.248       0.064402       5.34965        100    
reco:pandora:StandardPandora                            1.04798       2.81204       62.7742       1.41179       7.08929        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000173771   0.00723669     0.239817     0.00107113     0.0261626       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000235442    0.0117916     0.229585     0.00262038     0.0300059       100    
reco:pandoracalo:Calorimetry                          0.000143012    0.0226345     0.995308     0.000731636     0.10595        100    
reco:pandorapid:Chi2ParticleID                         4.304e-05    0.000202676   0.00196593    0.000144901   0.000246546      100    
reco:trkshowersplit:TrackShowerHits                   0.000105411    0.0306133      1.09201     0.000619151    0.132971        100    
reco:pmtrack:PMAlgTrackMaker                          0.00119147      2.73479       97.2853       0.18304       10.9418        100    
reco:pmtrackcalo:Calorimetry                            6.9e-05      0.013675       0.75221     0.000808337    0.0775655       100    
reco:pmtrackpid:Chi2ParticleID                        2.7901e-05    0.000326482   0.00536231    0.000149156   0.000639152      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000255222     1.80123       33.6991       0.24702       4.89455        100    
reco:pmtrajfitcalo:Calorimetry                        6.5951e-05     0.0238024      1.00331     0.00109211      0.10761        100    
reco:pmtrajfitpid:Chi2ParticleID                      3.4691e-05    0.000227151    0.0019525    0.000149981   0.000246964      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000969079     3.66014       137.046      0.172377       15.4582        100    
reco:pmtracktccalo:Calorimetry                        7.2461e-05    0.00771436     0.320664     0.000920523    0.034319        100    
reco:pmtracktcpid:Chi2ParticleID                       2.759e-05    0.000295816   0.00415075    0.000164577   0.000497665      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000195392     2.0255        69.8503      0.305005       7.57715        100    
reco:pmtrajfittccalo:Calorimetry                      9.0891e-05     0.0183115     0.774509     0.00107328     0.0832632       100    
reco:pmtrajfittcpid:Chi2ParticleID                     4.002e-05    0.000431857   0.00669003    0.000174576   0.000813563      100    
reco:blurredcluster:BlurredClustering                  0.0111759     0.967294       8.99677      0.426685       1.31892        100    
reco:emtrkmichelid:EmTrackMichelId                     0.227945       10.2216       192.978       2.08481       24.4198        100    
reco:emshower:EMShower                                0.000277022    0.039425       1.08057     0.00234646     0.117568        100    
reco:cvnmap:CVNMapper                                  2.955e-05     0.0136958     0.145094      0.0162363     0.0167593       100    
reco:cvneva:CVNEvaluator                               2.02e-05      0.769422       6.58806       1.00427      0.783093        100    
reco:energyrecnumu:EnergyReco                         0.000412134    0.0368878      2.27548     0.00384979      0.22669        100    
reco:energyrecnue:EnergyReco                          0.000140121   0.00303208     0.115944     0.000661036    0.0120376       100    
reco:energyrecnc:EnergyReco                           0.00158055    0.00573833     0.110967     0.00343185     0.0114524       100    
reco:energyrecnumurange:EnergyReco                    0.000186472    0.0334669      2.23705      0.0029095     0.222633        100    
reco:energyrecnumumcs:EnergyReco                      0.00140389     0.0359887      2.34741     0.00370211      0.23331        100    
reco:opdec:Deconvolution                               0.0820841      0.36549       4.8156       0.288686      0.487836        100    
reco:ophitspe:OpHitFinderDeco                          0.264625       2.2121        7.85444       2.03823       1.29591        100    
reco:opflash:OpFlashFinder                            0.000295352    0.001658      0.004685     0.00160761    0.000776164      100    
reco:rns:RandomNumberSaver                             2.686e-05    4.98228e-05   0.000329143   4.49955e-05   2.98139e-05      100    
reco:anglereconue:NuAngularReco                       0.000183231   0.00234627     0.0974966    0.000475614    0.0101855       100    
reco:anglereconumu:NuAngularReco                      7.8511e-05    0.00201442     0.0947629    0.000230553   0.00990658       100    
reco:anglereconuepfps:NuAngularReco                   0.000130041    0.0022031     0.0939143    0.000401644   0.00982692       100    
reco:anglereconumupfps:NuAngularReco                  0.000106141   0.00206133     0.0916765    0.000298068   0.00962286       100    
[art]:TriggerResults:TriggerResultInserter             9.48e-06     1.58223e-05    4.977e-05    1.5105e-05    4.70681e-06      100    
end_path:out1:RootOutput                                3.7e-06     8.61318e-06   3.3871e-05     7.855e-06    3.78082e-06      100    
end_path:out1:RootOutput(write)                        0.0194368     0.252301       1.54034       0.26528      0.211659        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21736.4 MB
  Peak resident set size usage (VmHWM): 2275.61 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_165_20231202T160604Z_gen_g4_detsim_hitreco__20240508T041903Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_165_20231202T160604Z_gen_g4_detsim_hitreco__20240508T041903Z_reco2_reco_2024-11-22T_231140Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66004350_165_20231202T160604Z_gen_g4_detsim_hitreco__20240508T041903Z_reco2_reco_data_2024-11-22T_231140Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 14:20:16 UTC       justIN version: 01.01.09