Jobsub ID 301705.93@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID	301705.93@justin-prod-sched01.dune.hep.ac.uk
Workflow ID	4213
Stage ID	1
User name	ismerio@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2024-11-23 04:31:13
Site	UK_RAL-PPD
Entry	CMSHTPC_T2_UK_SGrid_RALPP_hep207
Last heartbeat	2024-11-23 06:58:17
From worker node	Hostname	heplnc147.pp.rl.ac.uk
	cpuinfo	AMD EPYC 7452 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	257400 (71 hours)
	Inner Apptainer?	True
Job state	outputting_failed
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2024-11-23 04:33:32
Input files	fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6208838_314_20231122T053735Z_gen_g4_detsim_hitreco__20240507T182133Z_reco2.root
Jobscript	Exit code	0
	Real time	2h (8658s)
	CPU time	2h (8374s = 96%)
Outputting started	2024-11-23 06:57:51
Output files
Finished	2024-11-23 06:58:17
List job events Wrapper job log
Jobscript log (last 10,000 characters)

, nMCHits 17 (6, 5, 6)
-MatchedPfoId 1, Nu 1 [NuId: 1], CR 0, PDG 13, nMatchedHits 17 (6, 5, 6), nPfoHits 17 (6, 5, 6)

---SUMMARY--------------------------------------------------------------------------------------
#CorrectNu: 1/1, Fraction: 1
------------------------------------------------------------------------------------------------

Found: 2212 with KE=0.0515354 GeV, E=0.989807 GeV, p2=0.0993643
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  23-Nov-2024 06:57:45 GMT run: 6208838 subRun: 1 event: 63000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  23-Nov-2024 06:57:45 GMT run: 6208838 subRun: 1 event: 63000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  23-Nov-2024 06:57:45 GMT run: 6208838 subRun: 1 event: 63000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfit@BeginModule  23-Nov-2024 06:57:45 GMT run: 6208838 subRun: 1 event: 63000
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfit@BeginModule  23-Nov-2024 06:57:45 GMT run: 6208838 subRun: 1 event: 63000
1st wire C:0 T:17 P:2 W:569 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 06:57:45 GMT run: 6208838 subRun: 1 event: 63000
1st wire C:0 T:17 P:2 W:563 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 06:57:45 GMT run: 6208838 subRun: 1 event: 63000
1st wire C:0 T:17 P:2 W:569 does not exist (max wire number: 480)
%MSG
334
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 868!
23-Nov-2024 06:57:49 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6208838_314_20231122T053735Z_gen_g4_detsim_hitreco__20240507T182133Z_reco2_reco_data_2024-11-23T_043338Z.root"
23-Nov-2024 06:57:49 GMT  Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/d6/14/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6208838_314_20231122T053735Z_gen_g4_detsim_hitreco__20240507T182133Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.208264       41.6963       1082.6        14.5673       103.088        200    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00557765     0.0945849     0.811026      0.0234036     0.147553        200    
reco:linecluster:LineCluster                           0.0241548     0.811366       43.1006      0.0947854      3.70511        200    
reco:trajcluster:TrajCluster                           0.0113993      1.44964       100.373      0.0294904      9.9757         200    
reco:pandora:StandardPandora                           0.0203254      3.73973       121.841       2.22283       10.0422        200    
reco:pandoraTrack:LArPandoraTrackCreation             0.000163489   0.00933125     0.149355     0.00250786     0.0197091       200    
reco:pandoraShower:LArPandoraModularShowerCreation    0.00025446     0.0165361     0.139756     0.00390804     0.0266368       200    
reco:pandoracalo:Calorimetry                          0.000131568    0.0258832      1.07969     0.00169442     0.111986        200    
reco:pandorapid:Chi2ParticleID                        4.4063e-05    0.000295857   0.00242873     0.0002068    0.00029299       200    
reco:trkshowersplit:TrackShowerHits                   9.0491e-05     0.0358321      1.76841     0.00119341     0.185446        200    
reco:pmtrack:PMAlgTrackMaker                          0.00132321      2.91386       118.88       0.273895       11.0302        200    
reco:pmtrackcalo:Calorimetry                          7.1586e-05     0.0106362      0.41205     0.00135551     0.0371184       200    
reco:pmtrackpid:Chi2ParticleID                        2.8765e-05    0.000428054   0.00365351    0.000218918   0.000568603      200    
reco:pmtrajfit:PMAlgTrajFitter                        0.000284707     2.76562       86.004        0.34814       8.72621        200    
reco:pmtrajfitcalo:Calorimetry                        6.6876e-05     0.0248097      1.03673     0.00183525     0.0981118       200    
reco:pmtrajfitpid:Chi2ParticleID                      3.2972e-05    0.000316304   0.00218195    0.000223151   0.000285049      200    
reco:pmtracktc:PMAlgTrackMaker                        0.00154016       3.345        137.898      0.294099       13.1551        200    
reco:pmtracktccalo:Calorimetry                        8.3568e-05    0.00828336     0.285027     0.00131872     0.0259148       200    
reco:pmtracktcpid:Chi2ParticleID                      3.7481e-05    0.000395886   0.00428183    0.000227429   0.000506788      200    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000280499     2.04838       57.039       0.340405       6.29491        200    
reco:pmtrajfittccalo:Calorimetry                      8.9119e-05     0.0218511      0.95651      0.0018043     0.0949757       200    
reco:pmtrajfittcpid:Chi2ParticleID                    3.4665e-05    0.000594944   0.00673976    0.000247833   0.000956322      200    
reco:blurredcluster:BlurredClustering                 0.000215035     1.27103       9.20825      0.749427       1.61437        200    
reco:emtrkmichelid:EmTrackMichelId                    0.000173397     18.9879       396.77        5.55426       40.5487        200    
reco:emshower:EMShower                                0.000261142    0.0313436     0.496372     0.00518791     0.0654705       200    
reco:cvnmap:CVNMapper                                 2.8664e-05     0.0186699     0.0703491     0.0199762     0.0155697       200    
reco:cvneva:CVNEvaluator                              1.8776e-05      1.26772       3.45541       1.44677       0.92454        200    
reco:energyrecnumu:EnergyReco                         0.000424922    0.0430186      1.25278     0.00783853      0.12495        200    
reco:energyrecnue:EnergyReco                          0.000151316   0.00278691     0.0637259    0.000855435   0.00657821       200    
reco:energyrecnc:EnergyReco                           0.00203015     0.005545      0.0664335    0.00372523    0.00676807       200    
reco:energyrecnumurange:EnergyReco                    0.000196751    0.0387883      1.2574      0.00348205     0.125239        200    
reco:energyrecnumumcs:EnergyReco                      0.00134251     0.0384884      1.16212     0.00477185     0.113799        200    
reco:opdec:Deconvolution                               0.0155704     0.356532       2.61387      0.244432      0.371769        200    
reco:ophitspe:OpHitFinderDeco                          0.039654       1.99755       4.75838       1.88396      0.908776        200    
reco:opflash:OpFlashFinder                            0.000240454   0.00225046    0.00823904    0.00194824    0.00129319       200    
reco:rns:RandomNumberSaver                             2.143e-05    6.85048e-05   0.000612937    5.288e-05    5.73945e-05      200    
reco:anglereconue:NuAngularReco                       0.000196371   0.00198306     0.0436107    0.000597453    0.0045757       200    
reco:anglereconumu:NuAngularReco                       7.992e-05    0.00158485     0.0481491    0.000241461   0.00479004       200    
reco:anglereconuepfps:NuAngularReco                   0.000156926   0.00175466     0.0413817    0.00045832    0.00439278       200    
reco:anglereconumupfps:NuAngularReco                  0.000115869   0.00159734     0.0418292    0.000330058    0.0043303       200    
[art]:TriggerResults:TriggerResultInserter            1.1171e-05    2.10607e-05   0.000115378   1.76335e-05   1.3215e-05       200    
end_path:out1:RootOutput                               4.067e-06    1.07973e-05    3.707e-05    1.0149e-05    5.02038e-06      200    
end_path:out1:RootOutput(write)                        0.0152221     0.300497       1.43495      0.304351      0.206008        200    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21760.7 MB
  Peak resident set size usage (VmHWM): 2316.96 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6208838_314_20231122T053735Z_gen_g4_detsim_hitreco__20240507T182133Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6208838_314_20231122T053735Z_gen_g4_detsim_hitreco__20240507T182133Z_reco2_reco_2024-11-23T_043338Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6208838_314_20231122T053735Z_gen_g4_detsim_hitreco__20240507T182133Z_reco2_reco_data_2024-11-23T_043338Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work