Jobsub ID 108718.33@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID	108718.33@justin-prod-sched02.dune.hep.ac.uk
Workflow ID	4213
Stage ID	1
User name	ismerio@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2024-11-23 03:35:51
Site	UK_Durham
Entry	DUNE_UK_SGridDurham_ce4
Last heartbeat	2024-11-23 06:00:04
From worker node	Hostname	n260.dur.scotgrid.ac.uk
	cpuinfo	AMD EPYC 7763 64-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	171000 (47 hours)
	Inner Apptainer?	True
Job state	outputting_failed
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2024-11-23 03:39:27
Input files	fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1794_231_20231028T043026Z_gen_g4_detsim_hitreco__20240503T050959Z_reco2.root
Jobscript	Exit code	0
	Real time	2h (8419s)
	CPU time	2h (7465s = 88%)
Outputting started	2024-11-23 05:59:46
Output files
Finished	2024-11-23 06:00:04
List job events Wrapper job log
Jobscript log (last 10,000 characters)

6
Neutrino Energy: 0.761141
Neutrino Momentum:   x: -0.363895  y: 0.661632  z: 0.0957131 length: 0.761142
PrimaryId 1, Nu 1, CR 0, MCPDG 2212, Energy 1.0575, Dist. 10.8572, nMCHits 67 (28, 27, 12)
-MatchedPfoId 1, Nu 1 [NuId: 1], CR 0, PDG 13, nMatchedHits 34 (5, 17, 12), nPfoHits 34 (5, 17, 12)

------------------------------------------------------------------------------------------------

---INTERPRETED-MATCHING-OUTPUT------------------(my version)-----------------------------------------
Found: 2212 with KE=0.119233 GeV, E=1.0575 GeV, p2=0.237962
NCQEL_P (Nuance 1002, Nu 1, CR 0)
IsCorrectNu (NNuMatches: 1) 
Parent Neutrino: 16
Neutrino Energy: 0.761141
Neutrino Momentum:   x: -0.363895  y: 0.661632  z: 0.0957131 length: 0.761142
PrimaryId 1, Nu 1, CR 0, MCPDG 2212, Energy 1.0575, Dist. 10.8572, nMCHits 67 (28, 27, 12)
-MatchedPfoId 1, Nu 1 [NuId: 1], CR 0, PDG 13, nMatchedHits 34 (5, 17, 12), nPfoHits 34 (5, 17, 12)

---SUMMARY--------------------------------------------------------------------------------------
#CorrectNu: 1/1, Fraction: 1
------------------------------------------------------------------------------------------------

Found: 2212 with KE=0.119233 GeV, E=1.0575 GeV, p2=0.237962
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  23-Nov-2024 05:59:40 GMT run: 1794 subRun: 1 event: 46400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 05:59:40 GMT run: 1794 subRun: 1 event: 46400
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 05:59:40 GMT run: 1794 subRun: 1 event: 46400
1st wire C:0 T:18 P:2 W:759 does not exist (max wire number: 480)
%MSG
423
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1289!
23-Nov-2024 05:59:45 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1794_231_20231028T043026Z_gen_g4_detsim_hitreco__20240503T050959Z_reco2_reco_data_2024-11-23T_033935Z.root"
23-Nov-2024 05:59:45 GMT  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/b4/c7/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1794_231_20231028T043026Z_gen_g4_detsim_hitreco__20240503T050959Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              2.12893       37.8949       1035.25       11.6115       94.3647        200    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0176825     0.114204      0.804082      0.0565513     0.139748        200    
reco:linecluster:LineCluster                           0.154659      0.613754       12.7448      0.191909       1.33611        200    
reco:trajcluster:TrajCluster                           0.0485831      1.00413       43.6904      0.0663818      4.19116        200    
reco:pandora:StandardPandora                            0.87743       3.02907       147.136       1.42616       10.9482        200    
reco:pandoraTrack:LArPandoraTrackCreation             0.000149873   0.00958438     0.459786     0.00219566     0.0358198       200    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000199797    0.0160843     0.332754     0.00331301     0.0404171       200    
reco:pandoracalo:Calorimetry                          0.000119475    0.0281041      1.31186     0.00143113     0.113175        200    
reco:pandorapid:Chi2ParticleID                        4.5726e-05    0.000220844   0.00291111    0.00015392    0.000293947      200    
reco:trkshowersplit:TrackShowerHits                   0.000136076    0.0339857      1.39233     0.000952912     0.13256        200    
reco:pmtrack:PMAlgTrackMaker                          0.00136045      3.45494       130.804      0.269125       11.7195        200    
reco:pmtrackcalo:Calorimetry                          7.5503e-05     0.0193712      1.34734     0.00130219     0.102613        200    
reco:pmtrackpid:Chi2ParticleID                        3.0397e-05    0.000424797   0.00771314    0.000202632   0.000768175      200    
reco:pmtrajfit:PMAlgTrajFitter                        0.000209184     2.93402       75.8098       0.38047       8.82802        200    
reco:pmtrajfitcalo:Calorimetry                        7.0072e-05     0.0305639      1.32264     0.00216515     0.121746        200    
reco:pmtrajfitpid:Chi2ParticleID                      2.9465e-05    0.000259378   0.00196363    0.000191761   0.000230733      200    
reco:pmtracktc:PMAlgTrackMaker                        0.00103043      4.56932       196.664      0.352584       17.2448        200    
reco:pmtracktccalo:Calorimetry                        7.8147e-05     0.0137388     0.930736     0.00144347     0.0697815       200    
reco:pmtracktcpid:Chi2ParticleID                      2.8924e-05    0.000386736   0.00637933    0.000209651   0.000617105      200    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000259589     2.4793        111.92       0.350938       8.84695        200    
reco:pmtrajfittccalo:Calorimetry                      0.000105118    0.0259259      1.75582      0.0015639      0.13284        200    
reco:pmtrajfittcpid:Chi2ParticleID                    4.1718e-05    0.000507931   0.00875086    0.000226933   0.000873955      200    
reco:blurredcluster:BlurredClustering                 0.00418905      1.30298       12.284       0.596042       1.77976        200    
reco:emtrkmichelid:EmTrackMichelId                     0.281832       14.3277       298.331       3.83148       31.069         200    
reco:emshower:EMShower                                0.000276682    0.0350594      1.20305     0.00886546     0.0945598       200    
reco:cvnmap:CVNMapper                                 2.5298e-05     0.010801      0.0565298    0.00918324     0.0100804       200    
reco:cvneva:CVNEvaluator                              1.8355e-05      0.64165       1.2361       0.713789      0.408474        200    
reco:energyrecnumu:EnergyReco                         0.000319813    0.0652315      3.25311     0.00686512      0.31692        200    
reco:energyrecnue:EnergyReco                          0.000143261   0.00312447     0.145835     0.000612785    0.0117224       200    
reco:energyrecnc:EnergyReco                           0.00168988     0.0056556     0.152012     0.00347545     0.0121037       200    
reco:energyrecnumurange:EnergyReco                    0.000152718    0.0619244      3.26983     0.00317092     0.316104        200    
reco:energyrecnumumcs:EnergyReco                      0.00173444     0.0636418      3.22884     0.00393011      0.31586        200    
reco:opdec:Deconvolution                               0.109445      0.388879       2.26994      0.304597      0.300727        200    
reco:ophitspe:OpHitFinderDeco                          0.342686       2.30742       5.58878       2.13656       1.16113        200    
reco:opflash:OpFlashFinder                            0.00034453    0.00172333    0.00602987    0.00163721    0.000788883      200    
reco:rns:RandomNumberSaver                             2.123e-05    4.22943e-05   0.000372121   3.8288e-05    2.69357e-05      200    
reco:anglereconue:NuAngularReco                       0.000160744   0.00251805     0.137144     0.000455965    0.010782        200    
reco:anglereconumu:NuAngularReco                      7.2146e-05    0.00228929     0.136373     0.000298943    0.0106785       200    
reco:anglereconuepfps:NuAngularReco                   0.000124795   0.00241522     0.137074     0.000398721    0.0107219       200    
reco:anglereconumupfps:NuAngularReco                  0.000103154   0.00235778     0.136564     0.000352039    0.0107207       200    
[art]:TriggerResults:TriggerResultInserter             9.207e-06    1.66733e-05   6.1736e-05    1.55945e-05   6.24233e-06      200    
end_path:out1:RootOutput                               2.905e-06    7.2474e-06    3.0988e-05     5.971e-06    4.09367e-06      200    
end_path:out1:RootOutput(write)                        0.0232788     0.289231       2.06086       0.27425      0.239119        200    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 38660.4 MB
  Peak resident set size usage (VmHWM): 2593.33 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1794_231_20231028T043026Z_gen_g4_detsim_hitreco__20240503T050959Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1794_231_20231028T043026Z_gen_g4_detsim_hitreco__20240503T050959Z_reco2_reco_2024-11-23T_033935Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_1794_231_20231028T043026Z_gen_g4_detsim_hitreco__20240503T050959Z_reco2_reco_data_2024-11-23T_033935Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work