justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301838.15@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301838.15@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4213
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-23 06:17:28
SiteUK_Lancaster
EntryUBoone_UK_Lancaster_HEC_grendel_ce02
Last heartbeat2024-11-23 07:31:42
From worker nodeHostnamecomp19-03
cpuinfoIntel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-23 06:20:04
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50573344_461_20231203T081143Z_gen_g4_detsim_hitreco__20240508T033527Z_reco2.root
JobscriptExit code0
Real time1h (4285s)
CPU time57m (3422s = 79%)
Outputting started2024-11-23 07:31:30
Output files
Finished2024-11-23 07:31:42
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

2, Nu 1, CR 0)
IsCorrectNu (NNuMatches: 1) 
Parent Neutrino: 12
Neutrino Energy: 0.685763
Neutrino Momentum:   x: 0.110433  y: -0.490657  z: -0.466191 length: 0.685765
PrimaryId 1, Nu 1, CR 0, MCPDG 2212, Energy 1.13049, Dist. 24.0199, nMCHits 104 (18, 48, 38)
-MatchedPfoId 1, Nu 1 [NuId: 1], CR 0, PDG 13, nMatchedHits 104 (18, 48, 38), nPfoHits 104 (18, 48, 38)

---SUMMARY--------------------------------------------------------------------------------------
#CorrectNu: 1/1, Fraction: 1
------------------------------------------------------------------------------------------------

Found: 2212 with KE=0.192218 GeV, E=1.13049 GeV, p2=0.397654
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  23-Nov-2024 07:31:23 GMT run: 50573344 subRun: 1 event: 46200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 07:31:23 GMT run: 50573344 subRun: 1 event: 46200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 07:31:24 GMT run: 50573344 subRun: 1 event: 46200
1st wire C:0 T:6 P:2 W:608 does not exist (max wire number: 480)
%MSG
Boundary wire vector sizes: 18, 48, 38
minwire 0: 626
minwire 1: 2177
minwire 2: 494
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.990467, 0.00448605, 0.00504735, 
Output 1: 0.0329885, 0.920838, 0.0445355, 0.00163755, 
Output 2: 0.998368, 0.00163241, 

358
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1076!
23-Nov-2024 07:31:28 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50573344_461_20231203T081143Z_gen_g4_detsim_hitreco__20240508T033527Z_reco2_reco_data_2024-11-23T_062006Z.root"
23-Nov-2024 07:31:28 GMT  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/1c/d3/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50573344_461_20231203T081143Z_gen_g4_detsim_hitreco__20240508T033527Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.936351       34.7464       364.784       12.6322       59.8918        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0291756     0.0564007     0.0961817     0.0615523     0.0146247       100    
reco:linecluster:LineCluster                            0.16127      0.630693       10.6471      0.341179       1.2094         100    
reco:trajcluster:TrajCluster                           0.0809219      1.13564       27.4498      0.103172        3.602         100    
reco:pandora:StandardPandora                           0.0921961      2.16016       22.8581       1.33226       2.88298        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000133971   0.00730291     0.0833824    0.00205316     0.0139367       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000175554    0.0114201     0.275834     0.00382146     0.0290378       100    
reco:pandoracalo:Calorimetry                          9.4041e-05     0.0222021     0.776236     0.00189775     0.0832846       100    
reco:pandorapid:Chi2ParticleID                        3.5114e-05    0.000152927   0.00145876    0.000115684   0.000161552      100    
reco:trkshowersplit:TrackShowerHits                   7.4203e-05     0.0226278     0.340534     0.00108057     0.0610514       100    
reco:pmtrack:PMAlgTrackMaker                          0.00110159      2.53998       42.6519      0.257262       6.49209        100    
reco:pmtrackcalo:Calorimetry                          7.8734e-05     0.0132395      0.27594     0.00143937     0.0373791       100    
reco:pmtrackpid:Chi2ParticleID                        2.9608e-05    0.000308966   0.00224387    0.000143307   0.000434315      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000185377     2.49288       48.6021      0.372752       7.12564        100    
reco:pmtrajfitcalo:Calorimetry                        6.3667e-05     0.0229087     0.800632     0.00229592     0.0850842       100    
reco:pmtrajfitpid:Chi2ParticleID                      2.6753e-05    0.000182333   0.000818589   0.000129145   0.000149196      100    
reco:pmtracktc:PMAlgTrackMaker                        0.000987014     3.05134       53.9415      0.266781       7.99943        100    
reco:pmtracktccalo:Calorimetry                        6.9806e-05    0.00953291     0.200062     0.00128833     0.024859        100    
reco:pmtracktcpid:Chi2ParticleID                      2.7977e-05    0.000318795   0.00367727    0.00015565    0.000489298      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000166087     1.65477       18.0494      0.286831       3.33003        100    
reco:pmtrajfittccalo:Calorimetry                      6.1306e-05     0.0209595     0.392793     0.00147728     0.0593555       100    
reco:pmtrajfittcpid:Chi2ParticleID                    2.5841e-05    0.000384549   0.00282693    0.000158699   0.000554736      100    
reco:blurredcluster:BlurredClustering                 6.1362e-05      1.31499       7.63671      0.654632       1.7127         100    
reco:emtrkmichelid:EmTrackMichelId                    9.7974e-05      15.8671       137.757       4.89365       26.6958        100    
reco:emshower:EMShower                                0.000148716    0.0314232     0.243091     0.00807203     0.046803        100    
reco:cvnmap:CVNMapper                                 1.6931e-05     0.0162364     0.0601253     0.013054      0.0125766       100    
reco:cvneva:CVNEvaluator                               1.467e-05     0.494023       1.28529      0.623591      0.289219        100    
reco:energyrecnumu:EnergyReco                         0.000298192    0.0481672      1.07347     0.00524761     0.133063        100    
reco:energyrecnue:EnergyReco                          0.000133292   0.00237591     0.0298231    0.000646203   0.00460009       100    
reco:energyrecnc:EnergyReco                            0.0017958    0.00407127     0.032704     0.00224035    0.00479493       100    
reco:energyrecnumurange:EnergyReco                    0.000195937    0.0458907      1.07054     0.00222976      0.13282        100    
reco:energyrecnumumcs:EnergyReco                       0.0016692     0.0471112      1.05614     0.00346712     0.131571        100    
reco:opdec:Deconvolution                               0.0880515     0.455061      0.980578      0.442314      0.163997        100    
reco:ophitspe:OpHitFinderDeco                          0.298109       2.32653       4.17138       2.35587      0.894988        100    
reco:opflash:OpFlashFinder                            0.000210155   0.00130562    0.00391151    0.00126698    0.000570505      100    
reco:rns:RandomNumberSaver                            1.7193e-05    2.90598e-05   0.000238156    2.673e-05    2.24181e-05      100    
reco:anglereconue:NuAngularReco                       0.000140236   0.00182706     0.0262504    0.000423861   0.00391653       100    
reco:anglereconumu:NuAngularReco                      6.5387e-05    0.00162123     0.0253522    0.000253348   0.00379938       100    
reco:anglereconuepfps:NuAngularReco                   0.000112851   0.00172872     0.0257102    0.000331196   0.00385367       100    
reco:anglereconumupfps:NuAngularReco                  9.6337e-05    0.00168181     0.0251932    0.000316344   0.00380302       100    
[art]:TriggerResults:TriggerResultInserter             8.562e-06    1.06521e-05   4.5125e-05     9.658e-06    3.88684e-06      100    
end_path:out1:RootOutput                               2.268e-06    4.10323e-06   1.7278e-05    2.8355e-06    2.33882e-06      100    
end_path:out1:RootOutput(write)                       0.00954079     0.230216       0.82338      0.213189      0.157753        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 9321.09 MB
  Peak resident set size usage (VmHWM): 2253.94 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50573344_461_20231203T081143Z_gen_g4_detsim_hitreco__20240508T033527Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50573344_461_20231203T081143Z_gen_g4_detsim_hitreco__20240508T033527Z_reco2_reco_2024-11-23T_062006Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50573344_461_20231203T081143Z_gen_g4_detsim_hitreco__20240508T033527Z_reco2_reco_data_2024-11-23T_062006Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work
justIN time: 2024-11-23 12:07:08 UTC       justIN version: 01.01.09