Jobsub ID 301697.2@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID	301697.2@justin-prod-sched01.dune.hep.ac.uk
Workflow ID	4213
Stage ID	1
User name	ismerio@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2024-11-23 04:11:36
Site	UK_Durham
Entry	DUNE_UK_SGridDurham_ce3
Last heartbeat	2024-11-23 05:53:11
From worker node	Hostname	n239.dur.scotgrid.ac.uk
	cpuinfo	AMD EPYC 7352 24-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	171000 (47 hours)
	Inner Apptainer?	True
Job state	outputting_failed
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2024-11-23 04:12:42
Input files	fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6208838_465_20231122T071457Z_gen_g4_detsim_hitreco__20240507T182212Z_reco2.root
Jobscript	Exit code	0
	Real time	1h (6012s)
	CPU time	1h (5416s = 90%)
Outputting started	2024-11-23 05:52:55
Output files
Finished	2024-11-23 05:53:11
List job events Wrapper job log
Jobscript log (last 10,000 characters)

: 0.419565
Neutrino Momentum:   x: -0.0529093  y: -0.404971  z: 0.096092 length: 0.419565
PrimaryId 1, Nu 1, CR 0, MCPDG 2212, Energy 1.05977, Dist. 11.101, nMCHits 42 (24, 4, 14)
-MatchedPfoId 1, Nu 1 [NuId: 1], CR 0, PDG 13, nMatchedHits 38 (24, 0, 14), nPfoHits 38 (24, 0, 14)

------------------------------------------------------------------------------------------------

---INTERPRETED-MATCHING-OUTPUT------------------(my version)-----------------------------------------
Found: 2212 with KE=0.1215 GeV, E=1.05977 GeV, p2=0.242761
NCQEL_P (Nuance 1002, Nu 1, CR 0)
IsCorrectNu (NNuMatches: 1) 
Parent Neutrino: 14
Neutrino Energy: 0.419565
Neutrino Momentum:   x: -0.0529093  y: -0.404971  z: 0.096092 length: 0.419565
PrimaryId 1, Nu 1, CR 0, MCPDG 2212, Energy 1.05977, Dist. 11.101, nMCHits 42 (24, 4, 14)
-MatchedPfoId 1, Nu 1 [NuId: 1], CR 0, PDG 13, nMatchedHits 38 (24, 0, 14), nPfoHits 38 (24, 0, 14)

---SUMMARY--------------------------------------------------------------------------------------
#CorrectNu: 1/1, Fraction: 1
------------------------------------------------------------------------------------------------

Found: 2212 with KE=0.1215 GeV, E=1.05977 GeV, p2=0.242761
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  23-Nov-2024 05:52:51 GMT run: 6208838 subRun: 1 event: 93200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfit@BeginModule  23-Nov-2024 05:52:51 GMT run: 6208838 subRun: 1 event: 93200
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 05:52:51 GMT run: 6208838 subRun: 1 event: 93200
Comparing two wires in the same plane: return failure
%MSG
351
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 994!
23-Nov-2024 05:52:54 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6208838_465_20231122T071457Z_gen_g4_detsim_hitreco__20240507T182212Z_reco2_reco_data_2024-11-23T_041246Z.root"
23-Nov-2024 05:52:54 GMT  Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/be/37/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6208838_465_20231122T071457Z_gen_g4_detsim_hitreco__20240507T182212Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.864359       27.6413       660.052       9.81573       66.8588        200    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0180299     0.114501      0.406377      0.0839113     0.080276        200    
reco:linecluster:LineCluster                           0.103334      0.614457       28.0756      0.329393       2.08628        200    
reco:trajcluster:TrajCluster                           0.0495135      1.07483       47.8746      0.131042       5.00022        200    
reco:pandora:StandardPandora                           0.0730047      2.17703       61.2759       1.55049       4.64458        200    
reco:pandoraTrack:LArPandoraTrackCreation             0.000129073   0.00514931     0.0981101    0.00138348     0.0115569       200    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000173947    0.0155964     0.523429      0.0027789     0.0571214       200    
reco:pandoracalo:Calorimetry                          9.7173e-05     0.0131808     0.408416     0.000919828    0.0477421       200    
reco:pandorapid:Chi2ParticleID                        3.8462e-05    0.000163653   0.00209383    0.000121804   0.000174529      200    
reco:trkshowersplit:TrackShowerHits                   5.5975e-05     0.0227592      1.32589     0.000616223    0.113306        200    
reco:pmtrack:PMAlgTrackMaker                          0.00124468      2.52224       113.382      0.166023       10.3353        200    
reco:pmtrackcalo:Calorimetry                          6.4411e-05    0.00874236     0.334474     0.000836271    0.031309        200    
reco:pmtrackpid:Chi2ParticleID                         2.67e-05     0.00026867    0.00438789    0.000131482   0.000461621      200    
reco:pmtrajfit:PMAlgTrajFitter                        0.000181662     1.87163       57.622       0.247946       6.24166        200    
reco:pmtrajfitcalo:Calorimetry                        5.8711e-05     0.0139348     0.402058      0.0012726     0.0490296       200    
reco:pmtrajfitpid:Chi2ParticleID                      2.5728e-05    0.000184973   0.000989719   0.00014073    0.000159532      200    
reco:pmtracktc:PMAlgTrackMaker                        0.00102465      2.93345       114.833      0.225188       12.1561        200    
reco:pmtracktccalo:Calorimetry                         6.363e-05    0.00631673     0.151527     0.000877749    0.018261        200    
reco:pmtracktcpid:Chi2ParticleID                      2.6099e-05    0.000247145   0.00287028    0.000142353   0.000334043      200    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000157105     1.57231       45.9695      0.273325       4.67786        200    
reco:pmtrajfittccalo:Calorimetry                      5.8841e-05     0.0131299     0.506245     0.00103172     0.0495719       200    
reco:pmtrajfittcpid:Chi2ParticleID                    2.5167e-05    0.000331341    0.0052993    0.000144025   0.000590855      200    
reco:blurredcluster:BlurredClustering                 6.5072e-05      1.02256       8.32738      0.547932       1.31563        200    
reco:emtrkmichelid:EmTrackMichelId                    0.000105258     10.403        186.439       2.68377        22.66         200    
reco:emshower:EMShower                                0.000150883    0.0260344     0.278074     0.00613034     0.0470361       200    
reco:cvnmap:CVNMapper                                 1.8144e-05     0.0127072     0.0576718     0.0146149    0.00981933       200    
reco:cvneva:CVNEvaluator                              1.6621e-05     0.628743       1.27508       0.7524       0.408107        200    
reco:energyrecnumu:EnergyReco                         0.000272953    0.0424107      3.14504     0.00445722     0.236249        200    
reco:energyrecnue:EnergyReco                           0.0001276    0.00170199     0.0346754    0.000478789   0.00374831       200    
reco:energyrecnc:EnergyReco                           0.00184121     0.0040855     0.0415744    0.00306501    0.00417435       200    
reco:energyrecnumurange:EnergyReco                    0.000124393    0.0403491      3.15447      0.0028397     0.236709        200    
reco:energyrecnumumcs:EnergyReco                      0.000646404    0.0419014      3.17554     0.00342018     0.238041        200    
reco:opdec:Deconvolution                               0.0852821     0.383508      0.895245       0.36869       0.15105        200    
reco:ophitspe:OpHitFinderDeco                          0.180742       1.79679       4.20167       1.64899      0.879019        200    
reco:opflash:OpFlashFinder                            0.000235182   0.00146586    0.00559521    0.00134465    0.000718039      200    
reco:rns:RandomNumberSaver                            1.7172e-05    4.32183e-05   0.000429788   3.9705e-05    3.94843e-05      200    
reco:anglereconue:NuAngularReco                       0.000136607   0.00130069     0.0325655    0.000392102   0.00318469       200    
reco:anglereconumu:NuAngularReco                      6.6054e-05    0.00106545     0.0264611    0.00021309     0.0028617       200    
reco:anglereconuepfps:NuAngularReco                   0.000110117   0.00120749     0.0265314    0.000353253   0.00286918       200    
reco:anglereconumupfps:NuAngularReco                  9.5099e-05     0.0011305     0.0260259    0.000272507   0.00285989       200    
[art]:TriggerResults:TriggerResultInserter             9.087e-06    1.3405e-05    6.6966e-05    1.2864e-05    4.82943e-06      200    
end_path:out1:RootOutput                               2.484e-06    6.74445e-06   3.0968e-05     6.477e-06    3.31469e-06      200    
end_path:out1:RootOutput(write)                        0.0117023     0.248781       1.25997      0.244899      0.180829        200    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 16864.1 MB
  Peak resident set size usage (VmHWM): 2276.69 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6208838_465_20231122T071457Z_gen_g4_detsim_hitreco__20240507T182212Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6208838_465_20231122T071457Z_gen_g4_detsim_hitreco__20240507T182212Z_reco2_reco_2024-11-23T_041246Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6208838_465_20231122T071457Z_gen_g4_detsim_hitreco__20240507T182212Z_reco2_reco_data_2024-11-23T_041246Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work