Jobsub ID 108742.95@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID	108742.95@justin-prod-sched02.dune.hep.ac.uk
Workflow ID	4213
Stage ID	1
User name	ismerio@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2024-11-23 04:30:09
Site	UK_Brunel
Entry	CMSHTPC_T2_UK_London_Brunel_dc2_22
Last heartbeat	2024-11-23 05:21:01
From worker node	Hostname	wn-b2-16-01.brunel.ac.uk
	cpuinfo	Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	171000 (47 hours)
	Inner Apptainer?	True
Job state	outputting_failed
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2024-11-23 04:37:24
Input files	fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6483936_25_20231207T081439Z_gen_g4_detsim_hitreco__20240510T035428Z_reco2.root
Jobscript	Exit code	0
	Real time	43m (2603s)
	CPU time	39m (2356s = 90%)
Outputting started	2024-11-23 05:20:48
Output files
Finished	2024-11-23 05:21:01
List job events Wrapper job log
Jobscript log (last 10,000 characters)

---------------------------------------
Found: 2212 with KE=0.0254216 GeV, E=0.963694 GeV, p2=0.048351
NCQEL_P (Nuance 1002, Nu 1, CR 0)
IsCorrectNu (NNuMatches: 1) 
Parent Neutrino: 16
Neutrino Energy: 0.192262
Neutrino Momentum:   x: 0.130546  y: -0.0755997  z: 0.119195 length: 0.192263
PrimaryId 1, Nu 1, CR 0, MCPDG 2212, Energy 0.963694, Dist. 0.698789, nMCHits 26 (8, 16, 2)
-MatchedPfoId 1, Nu 1 [NuId: 1], CR 0, PDG 13, nMatchedHits 8 (4, 4, 0), nPfoHits 8 (4, 4, 0)

---SUMMARY--------------------------------------------------------------------------------------
#CorrectNu: 1/1, Fraction: 1
------------------------------------------------------------------------------------------------

Found: 2212 with KE=0.0254216 GeV, E=0.963694 GeV, p2=0.048351
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  23-Nov-2024 05:20:45 GMT run: 6483936 subRun: 1 event: 2600
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 05:20:45 GMT run: 6483936 subRun: 1 event: 2600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  23-Nov-2024 05:20:45 GMT run: 6483936 subRun: 1 event: 2600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 05:20:45 GMT run: 6483936 subRun: 1 event: 2600
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  EMShower:emshower@BeginModule  23-Nov-2024 05:20:45 GMT run: 6483936 subRun: 1 event: 2600
Comparing two wires in the same plane: return failure
%MSG
207
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 454!
23-Nov-2024 05:20:47 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6483936_25_20231207T081439Z_gen_g4_detsim_hitreco__20240510T035428Z_reco2_reco_data_2024-11-23T_043727Z.root"
23-Nov-2024 05:20:47 GMT  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/a2/6f/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6483936_25_20231207T081439Z_gen_g4_detsim_hitreco__20240510T035428Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.742704       22.5903       438.637       8.8893        50.4739        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0218278     0.0476237     0.138919      0.0501689     0.0168287       100    
reco:linecluster:LineCluster                           0.127563      0.311257       5.92438      0.228804      0.572832        100    
reco:trajcluster:TrajCluster                           0.064001      0.516155       25.5133      0.0771961      2.64749        100    
reco:pandora:StandardPandora                           0.0753927      2.22892       46.1554       1.27059       6.03603        100    
reco:pandoraTrack:LArPandoraTrackCreation             0.000142991   0.00503595     0.096654     0.00144599     0.0118829       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000186778   0.00946709     0.105796     0.00307315     0.0158008       100    
reco:pandoracalo:Calorimetry                          9.9565e-05     0.0201542      1.10299     0.00114685     0.117877        100    
reco:pandorapid:Chi2ParticleID                        3.8832e-05    0.000142636   0.00109295    0.000120227   0.000120925      100    
reco:trkshowersplit:TrackShowerHits                   8.0822e-05      0.01116      0.496667     0.000698419    0.0532884       100    
reco:pmtrack:PMAlgTrackMaker                          0.00115906      1.5574        45.1266      0.234611       5.07551        100    
reco:pmtrackcalo:Calorimetry                          7.8268e-05    0.00898313     0.441965     0.000948483    0.0450716       100    
reco:pmtrackpid:Chi2ParticleID                        3.2506e-05    0.000223898   0.00297695    0.000126693    0.0003499       100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000215823     1.51602       33.0563      0.234095       4.5063         100    
reco:pmtrajfitcalo:Calorimetry                        7.3793e-05     0.0206889      1.09185     0.00135022     0.117023        100    
reco:pmtrajfitpid:Chi2ParticleID                       3.213e-05    0.000162413   0.000668967   0.000139652   0.00011567       100    
reco:pmtracktc:PMAlgTrackMaker                        0.00107362      1.94524       72.3831      0.295527       7.73577        100    
reco:pmtracktccalo:Calorimetry                        8.2708e-05    0.00559775     0.166556     0.000988222    0.0182405       100    
reco:pmtracktcpid:Chi2ParticleID                      3.2401e-05    0.000216328   0.00241846    0.000136383   0.000290177      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000208816     1.26508       40.8877       0.28711       4.31178        100    
reco:pmtrajfittccalo:Calorimetry                      7.6881e-05     0.0131272     0.649462     0.00134432     0.0671728       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.1958e-05    0.000279171   0.00363634    0.000148472   0.000438876      100    
reco:blurredcluster:BlurredClustering                  9.956e-05     0.961955       6.52323      0.428982       1.25884        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000134901     9.60383       154.346       3.19037       19.0642        100    
reco:emshower:EMShower                                0.000199626    0.0240148     0.181877     0.00483703     0.0373577       100    
reco:cvnmap:CVNMapper                                 2.7241e-05     0.0104719     0.0445923     0.0095425    0.00861412       100    
reco:cvneva:CVNEvaluator                              1.8009e-05      0.49831       2.01756      0.638901      0.326841        100    
reco:energyrecnumu:EnergyReco                         0.000265177    0.0346903      1.15298     0.00329133     0.122083        100    
reco:energyrecnue:EnergyReco                          0.000155291   0.00165864     0.0323869    0.000508987    0.003961        100    
reco:energyrecnc:EnergyReco                           0.00200101    0.00366527     0.0364812    0.00245271    0.00421209       100    
reco:energyrecnumurange:EnergyReco                    0.000152151    0.033331       1.14377     0.00213114     0.121157        100    
reco:energyrecnumumcs:EnergyReco                      0.00186394     0.0347471      1.15909     0.00291112     0.122345        100    
reco:opdec:Deconvolution                                0.14968      0.325593       0.52503       0.32404      0.0757008       100    
reco:ophitspe:OpHitFinderDeco                          0.191409       1.35793       2.47668       1.40835      0.439906        100    
reco:opflash:OpFlashFinder                            0.000180652   0.00119252    0.00297406    0.00119827    0.000499744      100    
reco:rns:RandomNumberSaver                             1.614e-05    2.55975e-05   0.000236306   2.0207e-05    2.22831e-05      100    
reco:anglereconue:NuAngularReco                       9.8959e-05    0.00122734     0.0269015    0.000299714   0.00327216       100    
reco:anglereconumu:NuAngularReco                      7.5151e-05    0.00115676     0.0264449    0.000243227    0.0032314       100    
reco:anglereconuepfps:NuAngularReco                   0.000113303   0.00125986     0.0266468    0.000334225    0.0032441       100    
reco:anglereconumupfps:NuAngularReco                  0.00011055    0.00123228     0.0264538    0.000318815   0.00322735       100    
[art]:TriggerResults:TriggerResultInserter             9.561e-06    1.18241e-05   3.8145e-05    1.0934e-05    3.58242e-06      100    
end_path:out1:RootOutput                               2.755e-06    4.23444e-06   1.5912e-05    3.6185e-06    1.74709e-06      100    
end_path:out1:RootOutput(write)                        0.0111742     0.209643      0.909812      0.216673      0.130195        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8121.1 MB
  Peak resident set size usage (VmHWM): 2057.51 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6483936_25_20231207T081439Z_gen_g4_detsim_hitreco__20240510T035428Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6483936_25_20231207T081439Z_gen_g4_detsim_hitreco__20240510T035428Z_reco2_reco_2024-11-23T_043727Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_6483936_25_20231207T081439Z_gen_g4_detsim_hitreco__20240510T035428Z_reco2_reco_data_2024-11-23T_043727Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work