justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 91564.83@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID91564.83@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3932
Stage ID1
User nameismerio@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-05 23:03:39
SiteUK_Durham
EntryDUNE_UK_SGridDurham_ce3
Last heartbeat2024-11-05 23:18:17
From worker nodeHostnamen192.dur.scotgrid.ac.uk
cpuinfoIntel(R) Xeon(R) Gold 5220 CPU @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statejobscript_error
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-05 23:06:30
Input filesfardet-hd:atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65996932_298_20231202T053417Z_gen_g4_detsim_hitreco__20240508T032225Z_reco2.root
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Outputting started 
Output files
Finished2024-11-05 23:18:17
Saved logsjustin-logs:91564.83-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

932 subRun: 1 event: 29822
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  05-Nov-2024 23:16:11 GMT run: 65996932 subRun: 1 event: 29822
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  05-Nov-2024 23:16:11 GMT run: 65996932 subRun: 1 event: 29822
Comparing two wires in the same plane: return failure
%MSG
%MSG-e pma::Track3D:  PMAlgTrackMaker:pmtracktc@BeginModule  05-Nov-2024 23:16:11 GMT run: 65996932 subRun: 1 event: 29822
0 enabled hits in AverageDist2 calculation.
%MSG
%MSG-e pma::Track3D:  PMAlgTrackMaker:pmtracktc@BeginModule  05-Nov-2024 23:16:11 GMT run: 65996932 subRun: 1 event: 29822
Track empty.
%MSG
%MSG-e pma::Track3D:  PMAlgTrackMaker:pmtracktc@BeginModule  05-Nov-2024 23:16:11 GMT run: 65996932 subRun: 1 event: 29822
Hit sorting problem.
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  05-Nov-2024 23:16:11 GMT run: 65996932 subRun: 1 event: 29822
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  05-Nov-2024 23:16:11 GMT run: 65996932 subRun: 1 event: 29822
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  05-Nov-2024 23:16:11 GMT run: 65996932 subRun: 1 event: 29822
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  05-Nov-2024 23:16:11 GMT run: 65996932 subRun: 1 event: 29822
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  05-Nov-2024 23:16:12 GMT run: 65996932 subRun: 1 event: 29822
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  05-Nov-2024 23:16:12 GMT run: 65996932 subRun: 1 event: 29822
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  05-Nov-2024 23:16:12 GMT run: 65996932 subRun: 1 event: 29822
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 310, 654, 539
minwire 0: 431
minwire 1: 1756
minwire 2: 352
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.024839, 0.00453349, 0.970628, 
Output 1: 0.715705, 0.224292, 0.0461391, 0.0138634, 
Output 2: 0.48355, 0.51645, 

523
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 1784!
Begin processing the 23rd record. run: 65996932 subRun: 1 event: 29823 at 05-Nov-2024 23:16:31 GMT
> Running Algorithm: Alg0001, LArPreProcessing
> Running Algorithm: Alg0002, LArDLMaster
> Running Algorithm: Alg0003, LArNeutrinoEventValidation
---RAW-MATCHING-OUTPUT--------------------------------------------------------------------------
Found: 13 with KE=0.116837 GeV, E=0.222495 GeV, p2=0.0383403
Found: 2212 with KE=0.17593 GeV, E=1.1142 GeV, p2=0.361091
CCQEL_MU_P (Nuance 1001, Nu 1, CR 0)
IsCorrectNu (NNuMatches: 2) 
Parent Neutrino: 14
Neutrino Energy: 0.45412
PrimaryId 1, Nu 1, CR 0, MCPDG 13, Energy 0.222495, Dist. 37.7835, nMCHits 122 (9, 74, 39)
-MatchedPfoId 1, Nu 1 [NuId: 1], CR 0, PDG 13, nMatchedHits 113 (0, 74, 39), nPfoHits 113 (0, 74, 39)
-(Below threshold) MatchedPfoId 2, Nu 1 [NuId: 1], CR 0, PDG 13, nMatchedHits 7 (7, 0, 0), nPfoHits 68 (25, 22, 21)
Parent Neutrino: 14
Neutrino Energy: 0.45412
PrimaryId 2, Nu 1, CR 0, MCPDG 2212, Energy 1.1142, Dist. 20.9768, nMCHits 61 (18, 22, 21)
-MatchedPfoId 2, Nu 1 [NuId: 1], CR 0, PDG 13, nMatchedHits 61 (18, 22, 21), nPfoHits 68 (25, 22, 21)

------------------------------------------------------------------------------------------------

---INTERPRETED-MATCHING-OUTPUT------------------(my version)-----------------------------------------
Found: 13 with KE=0.116837 GeV, E=0.222495 GeV, p2=0.0383403
Found: 2212 with KE=0.17593 GeV, E=1.1142 GeV, p2=0.361091
CCQEL_MU_P (Nuance 1001, Nu 1, CR 0)
IsCorrectNu (NNuMatches: 2) 
Parent Neutrino: 14
Neutrino Energy: 0.45412
PrimaryId 1, Nu 1, CR 0, MCPDG 13, Energy 0.222495, Dist. 37.7835, nMCHits 122 (9, 74, 39)
-MatchedPfoId 1, Nu 1 [NuId: 1], CR 0, PDG 13, nMatchedHits 113 (0, 74, 39), nPfoHits 113 (0, 74, 39)
Parent Neutrino: 14
Neutrino Energy: 0.45412
PrimaryId 2, Nu 1, CR 0, MCPDG 2212, Energy 1.1142, Dist. 20.9768, nMCHits 61 (18, 22, 21)
-MatchedPfoId 2, Nu 1 [NuId: 1], CR 0, PDG 13, nMatchedHits 61 (18, 22, 21), nPfoHits 68 (25, 22, 21)

---SUMMARY--------------------------------------------------------------------------------------
#CorrectNu: 1/1, Fraction: 1
------------------------------------------------------------------------------------------------

Found: 13 with KE=0.116837 GeV, E=0.222495 GeV, p2=0.0383403
Found: 2212 with KE=0.17593 GeV, E=1.1142 GeV, p2=0.361091
%MSG-e ShowerProducedPtrsHolder:   LArPandoraModularShowerCreation:pandoraShower@BeginModule  05-Nov-2024 23:16:33 GMT run: 65996932 subRun: 1 event: 29823
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  05-Nov-2024 23:16:33 GMT run: 65996932 subRun: 1 event: 29823
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtrack@BeginModule  05-Nov-2024 23:16:33 GMT run: 65996932 subRun: 1 event: 29823
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfit@BeginModule  05-Nov-2024 23:16:34 GMT run: 65996932 subRun: 1 event: 29823
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfit@BeginModule  05-Nov-2024 23:16:34 GMT run: 65996932 subRun: 1 event: 29823
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfit@BeginModule  05-Nov-2024 23:16:34 GMT run: 65996932 subRun: 1 event: 29823
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  05-Nov-2024 23:16:34 GMT run: 65996932 subRun: 1 event: 29823
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  05-Nov-2024 23:16:34 GMT run: 65996932 subRun: 1 event: 29823
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  05-Nov-2024 23:16:34 GMT run: 65996932 subRun: 1 event: 29823
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  05-Nov-2024 23:16:34 GMT run: 65996932 subRun: 1 event: 29823
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  05-Nov-2024 23:16:34 GMT run: 65996932 subRun: 1 event: 29823
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  05-Nov-2024 23:16:34 GMT run: 65996932 subRun: 1 event: 29823
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  05-Nov-2024 23:16:34 GMT run: 65996932 subRun: 1 event: 29823
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  05-Nov-2024 23:16:34 GMT run: 65996932 subRun: 1 event: 29823
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  05-Nov-2024 23:16:34 GMT run: 65996932 subRun: 1 event: 29823
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrackMaker:pmtracktc@BeginModule  05-Nov-2024 23:16:34 GMT run: 65996932 subRun: 1 event: 29823
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  05-Nov-2024 23:16:34 GMT run: 65996932 subRun: 1 event: 29823
1st wire C:0 T:10 P:2 W:810 does not exist (max wire number: 480)
%MSG
%MSG-e WireIDIntersectionCheck:  PMAlgTrajFitter:pmtrajfittc@BeginModule  05-Nov-2024 23:16:34 GMT run: 65996932 subRun: 1 event: 29823
Comparing two wires in the same plane: return failure
%MSG
Boundary wire vector sizes: 42, 111, 75
minwire 0: 850
minwire 1: 1547
minwire 2: 593
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Classifier summary: 
Output 0: 0.0253779, 0.000595179, 0.974027, 
Output 1: 0.00328184, 0.929201, 0.0670244, 0.000492271, 
Output 2: 0.969957, 0.0300433, 

571
***Wiener Filter*******ApplyPostfilter***
Running Ophitfinder with InputDigiType = 'recob'
Found hits: 2040!
Begin processing the 24th record. run: 65996932 subRun: 1 event: 29824 at 05-Nov-2024 23:16:42 GMT
=== End last 100 lines of lar log file ===
RootOutput-3a2e-5d68-ab26-55b8.root
TFileService-54b9-ace9-7bbe-ae11.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_65996932_298_20231202T053417Z_gen_g4_detsim_hitreco__20240508T032225Z_reco2_reco_2024-11-05T_230637Z.log
debugprod.log
jobscript.log
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
work
justIN time: 2024-11-17 05:37:01 UTC       justIN version: 01.01.09