Jobsub ID 301665.103@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID	301665.103@justin-prod-sched01.dune.hep.ac.uk
Workflow ID	4213
Stage ID	1
User name	ismerio@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2024-11-23 03:06:47
Site	UK_Brunel
Entry	CMSHTPC_T2_UK_London_Brunel_dc2_22
Last heartbeat	2024-11-23 04:10:54
From worker node	Hostname	wn-b2-16-01.brunel.ac.uk
	cpuinfo	Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	171000 (47 hours)
	Inner Apptainer?	True
Job state	outputting_failed
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2024-11-23 03:09:39
Input files	fardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66020489_964_20231205T063747Z_gen_g4_detsim_hitreco__20240510T023001Z_reco2.root
Jobscript	Exit code	0
	Real time	1h (3660s)
	CPU time	54m (3273s = 89%)
Outputting started	2024-11-23 04:10:39
Output files
Finished	2024-11-23 04:10:54
List job events Wrapper job log
Jobscript log (last 10,000 characters)

: 1 event: 96500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 04:10:21 GMT run: 66020489 subRun: 1 event: 96500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 04:10:21 GMT run: 66020489 subRun: 1 event: 96500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 04:10:21 GMT run: 66020489 subRun: 1 event: 96500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 04:10:21 GMT run: 66020489 subRun: 1 event: 96500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 04:10:21 GMT run: 66020489 subRun: 1 event: 96500
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  23-Nov-2024 04:10:21 GMT run: 66020489 subRun: 1 event: 96500
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 532, 623, 392
minwire 0: 2260
minwire 1: 103
minwire 2: 2584
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.00626533, 0.000718708, 0.993016, 
Output 1: 0.44312, 0.432694, 0.089325, 0.0348615, 
Output 2: 0.8096, 0.1904, 

433
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1227!
23-Nov-2024 04:10:38 GMT  Closed output file "atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66020489_964_20231205T063747Z_gen_g4_detsim_hitreco__20240510T023001Z_reco2_reco_data_2024-11-23T_030944Z.root"
23-Nov-2024 04:10:38 GMT  Closed input file "root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/fardet-hd/2c/57/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66020489_964_20231205T063747Z_gen_g4_detsim_hitreco__20240510T023001Z_reco2.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                             0.754087       31.9711       643.283       9.65139       88.6326        100    
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                 0.0223023     0.0535082     0.296185      0.0512039     0.0327299       100    
reco:linecluster:LineCluster                           0.126921      0.675425       21.4892       0.23635       2.56104        100    
reco:trajcluster:TrajCluster                           0.0635466      1.92459       65.953       0.0779483      9.1411         100    
reco:pandora:StandardPandora                           0.0719906      3.57337       91.6795       1.24928       11.8511        100    
reco:pandoraTrack:LArPandoraTrackCreation              0.0001216    0.00673929     0.173824     0.00137565     0.0206156       100    
reco:pandoraShower:LArPandoraModularShowerCreation    0.000165344    0.010836      0.0938415    0.00262842     0.0191109       100    
reco:pandoracalo:Calorimetry                          9.7701e-05     0.0390447      1.60455     0.00103833     0.193114        100    
reco:pandorapid:Chi2ParticleID                        3.9287e-05    0.000136767   0.000971322   0.000101493   0.000122511      100    
reco:trkshowersplit:TrackShowerHits                   6.7331e-05     0.028543      0.915557     0.000632833    0.129709        100    
reco:pmtrack:PMAlgTrackMaker                          0.00113067      2.74402       78.0378      0.190402       10.3036        100    
reco:pmtrackcalo:Calorimetry                          7.5801e-05     0.0139003     0.561525     0.000785515    0.0634688       100    
reco:pmtrackpid:Chi2ParticleID                        3.2423e-05    0.000257049   0.00316604    0.000125333   0.000462249      100    
reco:pmtrajfit:PMAlgTrajFitter                        0.000188023     2.51218       68.8273      0.258552       8.71193        100    
reco:pmtrajfitcalo:Calorimetry                        7.3437e-05     0.0396589      1.62564     0.00130916     0.194238        100    
reco:pmtrajfitpid:Chi2ParticleID                      3.2014e-05    0.000154729   0.000817446   0.000123171   0.000131146      100    
reco:pmtracktc:PMAlgTrackMaker                        0.00101107      3.8709        125.886      0.190725       15.5084        100    
reco:pmtracktccalo:Calorimetry                         7.576e-05     0.0066193     0.170027     0.000760543    0.020342        100    
reco:pmtracktcpid:Chi2ParticleID                      3.1588e-05    0.000226959   0.00196403    0.000133567   0.000312512      100    
reco:pmtrajfittc:PMAlgTrajFitter                      0.000170758     1.58322       40.9806       0.26964       5.00107        100    
reco:pmtrajfittccalo:Calorimetry                      7.3251e-05     0.0203941     0.774094     0.00104338     0.0895293       100    
reco:pmtrajfittcpid:Chi2ParticleID                    3.1493e-05    0.000316651   0.00373075    0.000146092   0.00055253       100    
reco:blurredcluster:BlurredClustering                 6.5802e-05     0.970369       7.53344      0.502541       1.27623        100    
reco:emtrkmichelid:EmTrackMichelId                    0.000110375     11.348        185.69        3.13562       25.7758        100    
reco:emshower:EMShower                                0.00018213     0.0284883     0.360088     0.00441143     0.0553366       100    
reco:cvnmap:CVNMapper                                 2.3061e-05    0.00909781     0.0410427    0.00947813     0.0075594       100    
reco:cvneva:CVNEvaluator                              1.7785e-05     0.498739       1.09076      0.660528      0.307341        100    
reco:energyrecnumu:EnergyReco                         0.000268827    0.0411408      1.79997     0.00354344     0.190177        100    
reco:energyrecnue:EnergyReco                          0.000155295    0.002332      0.0648523    0.000541696    0.0071472       100    
reco:energyrecnc:EnergyReco                           0.00202272    0.00421228     0.0693427     0.0023965     0.0074845       100    
reco:energyrecnumurange:EnergyReco                    0.000148176    0.039944       1.80086     0.00221075     0.190317        100    
reco:energyrecnumumcs:EnergyReco                      0.00152491     0.0410626      1.8009      0.00268866     0.190452        100    
reco:opdec:Deconvolution                               0.115653      0.329902      0.863797      0.314963      0.103812        100    
reco:ophitspe:OpHitFinderDeco                          0.190098       1.33188       2.20739       1.31817      0.465175        100    
reco:opflash:OpFlashFinder                            0.000119504   0.00118799    0.00308471    0.00117334    0.000531742      100    
reco:rns:RandomNumberSaver                            1.4907e-05    2.47773e-05   0.000241832   2.0074e-05    2.29239e-05      100    
reco:anglereconue:NuAngularReco                       9.4119e-05    0.00173554     0.0599191    0.00028658    0.00647004       100    
reco:anglereconumu:NuAngularReco                      7.7055e-05    0.00165132     0.0592031    0.000230749   0.00638655       100    
reco:anglereconuepfps:NuAngularReco                   0.000113506   0.00175315     0.0594652    0.000319041   0.00640815       100    
reco:anglereconumupfps:NuAngularReco                  0.000110915    0.0017243     0.0596278    0.00029428    0.00642052       100    
[art]:TriggerResults:TriggerResultInserter             9.316e-06    1.17223e-05   3.6335e-05    1.10595e-05   3.02764e-06      100    
end_path:out1:RootOutput                               2.336e-06    3.52669e-06   1.3503e-05    2.7525e-06    1.74875e-06      100    
end_path:out1:RootOutput(write)                        0.0100552     0.212433       1.07809      0.215255      0.158284        100    
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 8495.96 MB
  Peak resident set size usage (VmHWM): 2388.33 MB
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66020489_964_20231205T063747Z_gen_g4_detsim_hitreco__20240510T023001Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66020489_964_20231205T063747Z_gen_g4_detsim_hitreco__20240510T023001Z_reco2_reco_2024-11-23T_030944Z.log
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_66020489_964_20231205T063747Z_gen_g4_detsim_hitreco__20240510T023001Z_reco2_reco_data_2024-11-23T_030944Z.root
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work