Jobsub ID 108730.66@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID	108730.66@justin-prod-sched02.dune.hep.ac.uk
Workflow ID	4213
Stage ID	1
User name	ismerio@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2024-11-23 04:04:08
Site	UK_RAL-PPD
Entry	CMSHTPC_T2_UK_SGrid_RALPP_hep208
Last heartbeat	2024-11-23 05:12:36
From worker node	Hostname	heplnc067.pp.rl.ac.uk
	cpuinfo	Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	257400 (71 hours)
	Inner Apptainer?	True
Job state	outputting_failed
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2024-11-23 04:06:07
Input files	fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50584512_170_20231204T060234Z_gen_g4_detsim_hitreco__20240509T214512Z_reco2.root
Jobscript	Exit code	0
	Real time	1h (3969s)
	CPU time	1h (3702s = 93%)
Outputting started	2024-11-23 05:12:17
Output files
Finished	2024-11-23 05:12:36
List job events Wrapper job log
Jobscript log (last 10,000 characters)

INTERPRETED-MATCHING-OUTPUT------------------(my version)-----------------------------------------
Found: 11 with KE=0.261316 GeV, E=0.261827 GeV, p2=0.0685532
CCQEL_E (Nuance 1001, Nu 1, CR 0)
IsCorrectNu (NNuMatches: 1) 
Parent Neutrino: 12
Neutrino Energy: 0.377701
Neutrino Momentum:   x: -0.0452974  y: 0.338582  z: -0.161149 length: 0.377701
PrimaryId 1, Nu 1, CR 0, MCPDG 11, Energy 0.261827, Dist. 27.1194, nMCHits 33 (4, 18, 11)
-MatchedPfoId 1, Nu 1 [NuId: 1], CR 0, PDG 13, nMatchedHits 33 (4, 18, 11), nPfoHits 45 (8, 23, 14)

---SUMMARY--------------------------------------------------------------------------------------
#CorrectNu: 1/1, Fraction: 1
------------------------------------------------------------------------------------------------

Found: 11 with KE=0.261316 GeV, E=0.261827 GeV, p2=0.0685532
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  23-Nov-2024 05:12:12 GMT run: 50584512 subRun: 1 event: 17100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  23-Nov-2024 05:12:12 GMT run: 50584512 subRun: 1 event: 17100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 05:12:12 GMT run: 50584512 subRun: 1 event: 17100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 05:12:12 GMT run: 50584512 subRun: 1 event: 17100
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 05:12:13 GMT run: 50584512 subRun: 1 event: 17100
Comparing two wires in the same plane: return failure
%MSG
309
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 913!
23-Nov-2024 05:12:16 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50584512_170_20231204T060234Z_gen_g4_detsim_hitreco__20240509T214512Z_reco2_reco_data_2024-11-23T_040616Z.root"
23-Nov-2024 05:12:16 GMT  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/15/d9/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50584512_170_20231204T060234Z_gen_g4_detsim_hitreco__20240509T214512Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.570738       36.8148       440.091       15.7457       67.1835        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00693179     0.127457      0.693866      0.067782      0.147959        100    
reco:linecluster:LineCluster                           0.0227604      0.69125       32.9908      0.137514       3.30366        100    
reco:trajcluster:TrajCluster                           0.0120619     0.986184       42.4606      0.0360867      5.12975        100    
reco:pandora:StandardPandora                           0.0243771      3.77944       23.6309       3.2294        2.77915        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000224119   0.00823706     0.152301     0.00227116     0.0194659       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000281722    0.0313337     0.648939     0.00635976     0.0958599       100    
reco:pandoracalo:Calorimetry                          0.00017829     0.0242128     0.699668     0.00180521     0.088036        100    
reco:pandorapid:Chi2ParticleID                        6.7459e-05    0.000305149   0.00242399    0.000252285   0.000284571      100    
reco:trkshowersplit:TrackShowerHits                   0.000135941    0.0260678      1.03978     0.00127327     0.126332        100    
reco:pmtrack:PMAlgTrackMaker                          0.00180432      2.73016       61.7688       0.32312       7.93749        100    
reco:pmtrackcalo:Calorimetry                          0.000107617    0.0132566     0.372578     0.00172726     0.0442882       100    
reco:pmtrackpid:Chi2ParticleID                         4.46e-05     0.00045356    0.00502908    0.000231029   0.000702532      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000262603     2.30901       34.679       0.432912       5.38507        100    
reco:pmtrajfitcalo:Calorimetry                        0.000102563    0.0248651     0.605541     0.00231626     0.0867582       100    
reco:pmtrajfitpid:Chi2ParticleID                      4.4819e-05    0.000319023   0.00132164    0.000261165   0.000241266      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00142725      3.31769       85.1631      0.266711       11.1291        100    
reco:pmtracktccalo:Calorimetry                         0.0001051     0.0113013      0.25905     0.00170463     0.0345892       100    
reco:pmtracktcpid:Chi2ParticleID                      4.4258e-05    0.000429802   0.00412483    0.000269251   0.000575867      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000259612     2.40439       33.7388      0.354756       5.76072        100    
reco:pmtrajfittccalo:Calorimetry                      0.000101655    0.0201845     0.464824     0.00200422     0.0670649       100    
reco:pmtrajfittcpid:Chi2ParticleID                    4.3732e-05    0.000650359   0.00642106    0.000286309   0.00106811       100    
reco:blurredcluster:BlurredClustering                 0.000130717     1.44584       9.89226      0.732029       1.82144        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000206583     14.0681       163.704       4.38685       26.1701        100    
reco:emshower:EMShower                                0.000277252    0.0468834     0.476925     0.00747234     0.0820614       100    
reco:cvnmap:CVNMapper                                 3.6254e-05     0.0240638     0.103727      0.0306683     0.0200811       100    
reco:cvneva:CVNEvaluator                              2.7535e-05      1.38763       2.67234       1.90368      0.983825        100    
reco:energyrecnumu:EnergyReco                         0.000510347    0.0646185      1.82924     0.00694948     0.212881        100    
reco:energyrecnue:EnergyReco                          0.000252586   0.00303596     0.0472733    0.00101477     0.0058709       100    
reco:energyrecnc:EnergyReco                           0.00270278    0.00699494     0.0612854    0.00439957    0.00752951       100    
reco:energyrecnumurange:EnergyReco                    0.000307723    0.0593429      1.80625     0.00394409     0.209001        100    
reco:energyrecnumumcs:EnergyReco                      0.00252604     0.0588013      1.70456     0.00612549     0.195709        100    
reco:opdec:Deconvolution                               0.034618      0.441504       1.90149      0.334046      0.374457        100    
reco:ophitspe:OpHitFinderDeco                          0.0372823      2.3306        4.96026       2.40545       1.07076        100    
reco:opflash:OpFlashFinder                            0.000170542   0.00210763    0.00529464    0.00201979    0.000936623      100    
reco:rns:RandomNumberSaver                            2.7148e-05    8.13422e-05   0.000672487    5.946e-05    0.00010984       100    
reco:anglereconue:NuAngularReco                       0.000247166   0.00179609     0.0402248    0.000608856   0.00442423       100    
reco:anglereconumu:NuAngularReco                      0.000131961   0.00154233     0.0394634    0.000371821   0.00436787       100    
reco:anglereconuepfps:NuAngularReco                   0.000254803    0.0017863     0.0402265    0.000592925   0.00443126       100    
reco:anglereconumupfps:NuAngularReco                  0.00023934    0.00167873     0.0386581    0.00050268    0.00430297       100    
[art]:TriggerResults:TriggerResultInserter            1.4878e-05    2.56745e-05   7.6287e-05    2.3998e-05    7.72854e-06      100    
end_path:out1:RootOutput                               3.819e-06    1.07361e-05   3.0508e-05    1.0519e-05    4.16795e-06      100    
end_path:out1:RootOutput(write)                        0.0188954     0.357741       1.28785      0.398801      0.241146        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8248.26 MB
  Peak resident set size usage (VmHWM): 2156.33 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50584512_170_20231204T060234Z_gen_g4_detsim_hitreco__20240509T214512Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50584512_170_20231204T060234Z_gen_g4_detsim_hitreco__20240509T214512Z_reco2_reco_2024-11-23T_040616Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50584512_170_20231204T060234Z_gen_g4_detsim_hitreco__20240509T214512Z_reco2_reco_data_2024-11-23T_040616Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work