justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 108854.8@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID108854.8@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-23 06:16:25
SiteUK_Lancaster
EntryUBoone_UK_Lancaster_HEC_grendel_ce02
Last heartbeat2024-11-23 07:34:18
From worker nodeHostnamecomp20-02
cpuinfoIntel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-23 06:17:13
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6454800_431_20231207T104926Z_gen_g4_detsim_hitreco__20240510T051208Z_reco2.root
JobscriptExit code0
Real time1h (4612s)
CPU time1h (4193s = 90%)
Outputting started2024-11-23 07:34:06
Output files
Finished2024-11-23 07:34:18
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

rimaryId 1, Nu 1, CR 0, MCPDG 2212, Energy 1.28062, Dist. 63.0881, nMCHits 219 (24, 118, 77)
-MatchedPfoId 1, Nu 1 [NuId: 1], CR 0, PDG 13, nMatchedHits 218 (24, 117, 77), nPfoHits 218 (24, 117, 77)

---SUMMARY--------------------------------------------------------------------------------------
#CorrectNu: 1/1, Fraction: 1
------------------------------------------------------------------------------------------------

Found: 2212 with KE=0.34235 GeV, E=1.28062 GeV, p2=0.759638
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 07:33:58 GMT run: 6454800 subRun: 1 event: 43200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 07:33:58 GMT run: 6454800 subRun: 1 event: 43200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 07:33:58 GMT run: 6454800 subRun: 1 event: 43200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 07:33:58 GMT run: 6454800 subRun: 1 event: 43200
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 118, 27, 78
minwire 0: 1633
minwire 1: 1624
minwire 2: 970
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.996101, 0.000656263, 0.00324246, 
Output 1: 0.0223397, 0.976479, 0.00113254, 4.8561e-05, 
Output 2: 0.999423, 0.000576924, 

548
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1997!
23-Nov-2024 07:34:05 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6454800_431_20231207T104926Z_gen_g4_detsim_hitreco__20240510T051208Z_reco2_reco_data_2024-11-23T_061716Z.root"
23-Nov-2024 07:34:05 GMT  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/f1/92/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6454800_431_20231207T104926Z_gen_g4_detsim_hitreco__20240510T051208Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.736535       42.2195       947.107       9.65385       128.95         100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.010777      0.0984331     0.338328      0.0824297     0.0554061       100    
reco:linecluster:LineCluster                           0.0906998     0.905177       26.3141      0.289395       3.03676        100    
reco:trajcluster:TrajCluster                           0.0303738      3.83638       168.385      0.107961       19.1025        100    
reco:pandora:StandardPandora                           0.0719566      4.77026       208.426       1.23888       21.9935        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000124556    0.0103098     0.201575     0.00129528     0.0332399       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000168562   0.00923447     0.126749     0.00255296     0.0202391       100    
reco:pandoracalo:Calorimetry                          9.7014e-05     0.0560208      1.87482     0.000863966    0.271173        100    
reco:pandorapid:Chi2ParticleID                        3.4869e-05    0.000156295   0.00120437    0.000104593   0.000186276      100    
reco:trkshowersplit:TrackShowerHits                   6.1402e-05     0.0402165      1.11685     0.000663057    0.165866        100    
reco:pmtrack:PMAlgTrackMaker                          0.00112332      3.56314       104.082      0.145376       13.5084        100    
reco:pmtrackcalo:Calorimetry                          7.4687e-05     0.0227875     0.843347     0.000795934    0.104361        100    
reco:pmtrackpid:Chi2ParticleID                        2.9058e-05    0.000278039   0.00388065    0.000116138   0.000587719      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.00017974      3.06125        89.75       0.235104       11.7328        100    
reco:pmtrajfitcalo:Calorimetry                        5.9475e-05     0.0565605      1.88778     0.00114278     0.270847        100    
reco:pmtrajfitpid:Chi2ParticleID                      2.5546e-05    0.000165535   0.000925594   0.000117411   0.000175885      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000995406     4.3567        138.411      0.150628       17.3607        100    
reco:pmtracktccalo:Calorimetry                        6.7278e-05     0.0114661     0.345711     0.000887873    0.0459464       100    
reco:pmtracktcpid:Chi2ParticleID                      2.7252e-05    0.000254264   0.00303338    0.000120699   0.000466699      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000154336     1.9499        49.6215      0.258058       6.57443        100    
reco:pmtrajfittccalo:Calorimetry                      5.8121e-05     0.0331391      1.20633     0.00103572     0.148537        100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.5605e-05    0.000343128   0.00445804    0.000129857   0.000710969      100    
reco:blurredcluster:BlurredClustering                 6.3109e-05      1.02818       8.99279      0.470554       1.54336        100    
reco:emtrkmichelid:EmTrackMichelId                    9.4003e-05      15.0168       253.395       3.12601       38.8066        100    
reco:emshower:EMShower                                0.00014283     0.0304136     0.418771     0.00405767     0.0680948       100    
reco:cvnmap:CVNMapper                                 1.6937e-05     0.0162568     0.053576      0.0145566     0.0131227       100    
reco:cvneva:CVNEvaluator                              1.4153e-05     0.501228       1.67121      0.622628      0.330535        100    
reco:energyrecnumu:EnergyReco                         0.000241439    0.101454       5.66127     0.00414999      0.5828         100    
reco:energyrecnue:EnergyReco                          0.000122125    0.0034023     0.0714054    0.000436269    0.0111006       100    
reco:energyrecnc:EnergyReco                           0.00159507    0.00493133     0.0740545    0.00194878     0.0112011       100    
reco:energyrecnumurange:EnergyReco                    0.000158433    0.0980596      5.62596     0.00172105     0.578692        100    
reco:energyrecnumumcs:EnergyReco                      0.00138173     0.0984708      5.5599      0.00227925     0.572214        100    
reco:opdec:Deconvolution                               0.152154       0.38527       0.85437      0.359839      0.145374        100    
reco:ophitspe:OpHitFinderDeco                          0.110823       1.91579       3.70868       1.86775      0.749945        100    
reco:opflash:OpFlashFinder                            0.000122207   0.00128367    0.00331583    0.00114808    0.000603592      100    
reco:rns:RandomNumberSaver                            1.6727e-05    3.37543e-05   0.000249812   3.07865e-05   2.47269e-05      100    
reco:anglereconue:NuAngularReco                       0.000138366    0.0029567     0.0663764    0.000312656    0.0100445       100    
reco:anglereconumu:NuAngularReco                      6.1159e-05    0.00264488     0.0617624    0.000164354   0.00960539       100    
reco:anglereconuepfps:NuAngularReco                   0.000105279   0.00278387     0.0632632    0.000263126   0.00972756       100    
reco:anglereconumupfps:NuAngularReco                   8.757e-05    0.00271975     0.062498     0.000220479   0.00968738       100    
[art]:TriggerResults:TriggerResultInserter             8.079e-06    1.03542e-05   3.7409e-05    9.4145e-06    3.51533e-06      100    
end_path:out1:RootOutput                               2.534e-06    6.08796e-06   2.0232e-05    5.6855e-06    3.53644e-06      100    
end_path:out1:RootOutput(write)                       0.00706758     0.223061       1.35055      0.197228       0.19947        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9599.52 MB
  Peak resident set size usage (VmHWM): 2521.89 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6454800_431_20231207T104926Z_gen_g4_detsim_hitreco__20240510T051208Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6454800_431_20231207T104926Z_gen_g4_detsim_hitreco__20240510T051208Z_reco2_reco_2024-11-23T_061716Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6454800_431_20231207T104926Z_gen_g4_detsim_hitreco__20240510T051208Z_reco2_reco_data_2024-11-23T_061716Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 11:20:00 UTC       justIN version: 01.01.09