justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301488.39@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301488.39@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 22:59:11
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce02
Last heartbeat2024-11-23 00:07:29
From worker nodeHostnamedune001-3353676.0-lcg2596.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 23:14:50
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6467222_609_20231207T061907Z_gen_g4_detsim_hitreco__20240510T045144Z_reco2.root
JobscriptExit code0
Real time42m (2578s)
CPU time58m (3530s = 136%)
Outputting started2024-11-22 23:57:49
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/ismerio/04213/1/Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6467222_609_20231207T061907Z_gen_g4_detsim_hitreco__20240510T045144Z_reco2.root
Finished2024-11-23 00:07:29
Saved logsjustin-logs:301488.39-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

22-Nov-2024 23:57:42 UTC run: 6467222 subRun: 1 event: 61000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  22-Nov-2024 23:57:42 UTC run: 6467222 subRun: 1 event: 61000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:57:42 UTC run: 6467222 subRun: 1 event: 61000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:57:42 UTC run: 6467222 subRun: 1 event: 61000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  22-Nov-2024 23:57:42 UTC run: 6467222 subRun: 1 event: 61000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:57:42 UTC run: 6467222 subRun: 1 event: 61000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  22-Nov-2024 23:57:42 UTC run: 6467222 subRun: 1 event: 61000
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 57, 101, 73
minwire 0: 200
minwire 1: 2025
minwire 2: 221
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.802289, 0.0312263, 0.166484, 
Output 1: 0.0637684, 0.395, 0.375288, 0.165944, 
Output 2: 0.252413, 0.747587, 

317
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 948!
22-Nov-2024 23:57:48 UTC  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6467222_609_20231207T061907Z_gen_g4_detsim_hitreco__20240510T045144Z_reco2_reco_data_2024-11-22T_231455Z.root"
22-Nov-2024 23:57:48 UTC  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/f2/f8/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6467222_609_20231207T061907Z_gen_g4_detsim_hitreco__20240510T045144Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.271984       24.3198       306.872       11.3862       41.3805        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00181387     0.0869153     0.265319      0.0725962     0.054613        100    
reco:linecluster:LineCluster                          0.00618218     0.294241       4.84337      0.191424      0.518099        100    
reco:trajcluster:TrajCluster                          0.00113228     0.456593       14.0293      0.0634437      1.67081        100    
reco:pandora:StandardPandora                           0.0495098      1.89013       19.6166       1.51828       1.95136        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000168375   0.00525477     0.0817711    0.00177215     0.0105036       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000201215    0.0172414     0.692604     0.00393292     0.0717778       100    
reco:pandoracalo:Calorimetry                          0.000127573    0.0143795     0.513544     0.00131117     0.0550366       100    
reco:pandorapid:Chi2ParticleID                        4.2921e-05    0.000198333   0.00239208    0.000147769   0.000244502      100    
reco:trkshowersplit:TrackShowerHits                   8.3452e-05     0.0173113     0.536518     0.000976656    0.062028        100    
reco:pmtrack:PMAlgTrackMaker                          0.00137466      1.88612       31.9248      0.278608       4.57838        100    
reco:pmtrackcalo:Calorimetry                          9.3152e-05    0.00846891      0.21845     0.000997532    0.0281008       100    
reco:pmtrackpid:Chi2ParticleID                        3.6141e-05    0.000291637   0.00259973    0.000155179   0.000392074      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000215286      2.303        56.3041      0.287614       6.76503        100    
reco:pmtrajfitcalo:Calorimetry                        7.5582e-05     0.0124733     0.290141     0.00195479     0.0359475       100    
reco:pmtrajfitpid:Chi2ParticleID                      3.1191e-05    0.000212937   0.000900564   0.000182855   0.000145908      100    
reco:pmtracktc:PMAlgTrackMaker                         0.0010259      2.18357       38.1888      0.322777       5.86543        100    
reco:pmtracktccalo:Calorimetry                        7.7902e-05    0.00554237     0.0950333    0.00117854     0.0150312       100    
reco:pmtracktcpid:Chi2ParticleID                      3.2491e-05    0.000264098   0.00163046    0.000186795   0.000279467      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000208865     1.38014       25.9721      0.382113       3.19946        100    
reco:pmtrajfittccalo:Calorimetry                      7.5702e-05    0.00937151     0.207722     0.00122571     0.0274441       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.8911e-05    0.000337011   0.00252139    0.000192685   0.000418717      100    
reco:blurredcluster:BlurredClustering                 0.000201775    0.931309       7.3157        0.39639       1.30355        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000141764     8.83165       103.24        3.28289       16.0056        100    
reco:emshower:EMShower                                0.000200755    0.0347625     0.224308      0.0065552     0.0528662       100    
reco:cvnmap:CVNMapper                                 2.3791e-05    0.00870058     0.0469702    0.00610795    0.00918625       100    
reco:cvneva:CVNEvaluator                              1.7371e-05     0.931559       1.59392       1.21338      0.547023        100    
reco:energyrecnumu:EnergyReco                         0.000448592    0.0197567     0.402807     0.00482095     0.0524425       100    
reco:energyrecnue:EnergyReco                          0.000157404   0.00177696     0.0215006    0.000645898    0.0029917       100    
reco:energyrecnc:EnergyReco                           0.00197732    0.00442433     0.0252381    0.00349182    0.00326072       100    
reco:energyrecnumurange:EnergyReco                    0.000227217    0.0178972     0.449498     0.00321761     0.0552295       100    
reco:energyrecnumumcs:EnergyReco                      0.00189973     0.018741      0.391717     0.00490438     0.0503176       100    
reco:opdec:Deconvolution                               0.0159806     0.309754      0.593665      0.287061      0.121991        100    
reco:ophitspe:OpHitFinderDeco                          0.0307111      2.35602       4.48354       2.21134       1.01107        100    
reco:opflash:OpFlashFinder                            0.000192685   0.00153882     0.0050908    0.00138988    0.000734446      100    
reco:rns:RandomNumberSaver                             1.757e-05    3.67031e-05   0.000429331   2.99455e-05   4.05269e-05      100    
reco:anglereconue:NuAngularReco                       0.000182345   0.00110839     0.0102851    0.000435426   0.00177599       100    
reco:anglereconumu:NuAngularReco                      8.9712e-05    0.000934486   0.00964519    0.000258987   0.00180821       100    
reco:anglereconuepfps:NuAngularReco                   0.000128233   0.00110832    0.00991092     0.0003799    0.00187172       100    
reco:anglereconumupfps:NuAngularReco                  0.000116273   0.00102528    0.00996005    0.000334279   0.00188136       100    
[art]:TriggerResults:TriggerResultInserter             9.48e-06     1.56974e-05   6.5002e-05    1.44905e-05   6.31137e-06      100    
end_path:out1:RootOutput                               3.02e-06     5.28454e-06   2.9381e-05     4.35e-06     3.1739e-06       100    
end_path:out1:RootOutput(write)                        0.0184514     0.273496      0.691555       0.28252       0.15392        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 39226.6 MB
  Peak resident set size usage (VmHWM): 2012.72 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6467222_609_20231207T061907Z_gen_g4_detsim_hitreco__20240510T045144Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6467222_609_20231207T061907Z_gen_g4_detsim_hitreco__20240510T045144Z_reco2_reco_2024-11-22T_231455Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6467222_609_20231207T061907Z_gen_g4_detsim_hitreco__20240510T045144Z_reco2_reco_data_2024-11-22T_231455Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-24 16:08:23 UTC       justIN version: 01.01.09