justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301491.94@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301491.94@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 23:09:00
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce511
Last heartbeat2024-11-23 00:21:44
From worker nodeHostnameb9p05p0582.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:23:14
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66029763_548_20231207T032342Z_gen_g4_detsim_hitreco__20240510T024916Z_reco2.root
JobscriptExit code0
Real time48m (2939s)
CPU time37m (2265s = 77%)
Outputting started2024-11-23 00:12:14
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66029763_548_20231207T032342Z_gen_g4_detsim_hitreco__20240510T024916Z_reco2.root
Finished2024-11-23 00:21:44
Saved logsjustin-logs:301491.94-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

11:31 CET run: 66029763 subRun: 1 event: 54900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:11:31 CET run: 66029763 subRun: 1 event: 54900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:11:31 CET run: 66029763 subRun: 1 event: 54900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 01:11:33 CET run: 66029763 subRun: 1 event: 54900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 01:12:07 CET run: 66029763 subRun: 1 event: 54900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 01:12:07 CET run: 66029763 subRun: 1 event: 54900
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 01:12:07 CET run: 66029763 subRun: 1 event: 54900
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 2051, 1381, 1574
minwire 0: 134
minwire 1: 1249
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.149519, 0.244184, 0.606297, 
Output 1: 0.35703, 0.510668, 0.115646, 0.0166555, 
Output 2: 0.0399906, 0.960009, 

727
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2620!
23-Nov-2024 01:12:13 CET  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66029763_548_20231207T032342Z_gen_g4_detsim_hitreco__20240510T024916Z_reco2_reco_data_2024-11-22T_233222Z.root"
23-Nov-2024 01:12:13 CET  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/53/d1/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66029763_548_20231207T032342Z_gen_g4_detsim_hitreco__20240510T024916Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.549079       20.9099        216.3        7.53782       37.2936        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0169421     0.0450265     0.149173      0.0444012     0.0173747       100    
reco:linecluster:LineCluster                           0.113101      0.301582       4.35252      0.171437      0.616161        100    
reco:trajcluster:TrajCluster                           0.0471894     0.521408       13.7867      0.0561525      1.96603        100    
reco:pandora:StandardPandora                           0.0544517      2.17474       61.7228       1.18964       6.20189        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000114222   0.00464865     0.0555069    0.000951274    0.0104091       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000150611   0.00996473     0.257677      0.0020107     0.0275523       100    
reco:pandoracalo:Calorimetry                          9.1741e-05     0.0118749     0.263699     0.000613891    0.0402369       100    
reco:pandorapid:Chi2ParticleID                        3.6401e-05    0.000145486   0.00117047    0.000107396   0.000139982      100    
reco:trkshowersplit:TrackShowerHits                    4.556e-05     0.0169097     0.376291     0.000493024    0.0576062       100    
reco:pmtrack:PMAlgTrackMaker                          0.00095151      1.66859       28.295       0.121716       4.68769        100    
reco:pmtrackcalo:Calorimetry                          5.7991e-05    0.00661823     0.121273     0.000592481    0.0205916       100    
reco:pmtrackpid:Chi2ParticleID                         2.244e-05    0.000217937   0.00221194    0.000114551   0.000350628      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000159491     1.48185       24.6682      0.194972       4.05457        100    
reco:pmtrajfitcalo:Calorimetry                        5.5001e-05     0.0135458      0.30837     0.00102734     0.0461149       100    
reco:pmtrajfitpid:Chi2ParticleID                       2.294e-05    0.000161482   0.000707597   0.000115741   0.000141902      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000826518     2.0144        39.4629       0.20708       6.04173        100    
reco:pmtracktccalo:Calorimetry                        6.1501e-05    0.00525555     0.110419     0.000627151    0.0158484       100    
reco:pmtracktcpid:Chi2ParticleID                       2.254e-05    0.000217942   0.00153543    0.000114791   0.000299752      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000138142     1.19905       19.4227      0.194709       2.91008        100    
reco:pmtrajfittccalo:Calorimetry                       5.679e-05     0.0101175     0.196026     0.000743757    0.0315185       100    
reco:pmtrajfittcpid:Chi2ParticleID                     2.223e-05    0.00029831    0.00275593    0.000121436   0.000490261      100    
reco:blurredcluster:BlurredClustering                 0.000129111    0.853698       6.35961      0.303993       1.2479         100    
reco:emtrkmichelid:EmTrackMichelId                    9.1251e-05      7.57872       71.5802       1.85368       14.6874        100    
reco:emshower:EMShower                                0.000168202    0.0238809     0.352416      0.002053      0.055041        100    
reco:cvnmap:CVNMapper                                  2.278e-05     0.0119475     0.0327792     0.0154121    0.00873311       100    
reco:cvneva:CVNEvaluator                               1.527e-05     0.675273       1.18533      0.864486       0.42936        100    
reco:energyrecnumu:EnergyReco                         0.000236652    0.0236641     0.449623     0.00366524     0.0600307       100    
reco:energyrecnue:EnergyReco                          0.000117651   0.00161016     0.0171106    0.000428039   0.00325315       100    
reco:energyrecnc:EnergyReco                           0.00163511    0.00395628     0.0205197    0.00292363    0.00364153       100    
reco:energyrecnumurange:EnergyReco                    0.000166872    0.0220999     0.483989     0.00229262     0.0624558       100    
reco:energyrecnumumcs:EnergyReco                      0.000778728    0.0234486     0.473512     0.00320531     0.0610331       100    
reco:opdec:Deconvolution                               0.0607377     0.266592       0.44807      0.261081      0.0769923       100    
reco:ophitspe:OpHitFinderDeco                          0.140926       1.71945       3.69605       1.63545      0.705546        100    
reco:opflash:OpFlashFinder                            0.000129092   0.00131328    0.00333247    0.00126016    0.00057425       100    
reco:rns:RandomNumberSaver                             1.738e-05    3.73531e-05   0.000249622   3.45305e-05   2.25994e-05      100    
reco:anglereconue:NuAngularReco                       0.000152372   0.00125964     0.0202886    0.000372054   0.00290027       100    
reco:anglereconumu:NuAngularReco                      6.7791e-05    0.00104813     0.0196181    0.000169482   0.00290976       100    
reco:anglereconuepfps:NuAngularReco                   0.000114991   0.00120404     0.0198975    0.000326593   0.00293788       100    
reco:anglereconumupfps:NuAngularReco                  0.000101771   0.00113793     0.0197682    0.000232802   0.00298633       100    
[art]:TriggerResults:TriggerResultInserter             8.45e-06     1.22363e-05   3.7741e-05    1.1645e-05    3.47939e-06      100    
end_path:out1:RootOutput                               2.82e-06     6.79313e-06    2.705e-05    6.5805e-06    2.82852e-06      100    
end_path:out1:RootOutput(write)                        0.0104118     0.211066      0.703955      0.211933      0.139449        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21615.5 MB
  Peak resident set size usage (VmHWM): 2169.85 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66029763_548_20231207T032342Z_gen_g4_detsim_hitreco__20240510T024916Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66029763_548_20231207T032342Z_gen_g4_detsim_hitreco__20240510T024916Z_reco2_reco_2024-11-22T_233222Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66029763_548_20231207T032342Z_gen_g4_detsim_hitreco__20240510T024916Z_reco2_reco_data_2024-11-22T_233222Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 13:52:11 UTC       justIN version: 01.01.09