Jobsub ID 293258.1@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 293258.1@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 4121 |
| Stage ID | 1 |
| User name | imawby@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 43200 (12 hours) |
| Submitted time | 2024-11-17 02:05:37 |
| Site | NL_NIKHEF |
| Entry | VIRGO_NL_NIKHEF_juk |
| Last heartbeat | 2024-11-17 05:34:48 |
| From worker node | Hostname | wn-choc-019.farm.nikhef.nl |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-11-17 02:07:35 |
| Input files | fardet-hd:nutau_dune10kt_1x2x6_1110_408_20230827T023419Z_gen_g4_detsim_hitreco__20240219T164608Z_reco2.root
|
| Jobscript | Exit code | 0 |
| Real time | 3h (12418s) |
| CPU time | 3h (12304s = 99%) |
| Outputting started | 2024-11-17 05:34:34 |
| Output files | |
| Finished | 2024-11-17 05:34:48 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
Justin processors: 1
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v09_91_02
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3
MRB_SOURCE=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/srcs
MRB_BUILDDIR=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/localProducts_larsoft_v09_91_02_e26_prof
PRODUCTS=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/localProducts_larsoft_v09_91_02_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/localProducts_larsoft_v09_91_02_e26_prof
local product directory is /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/localProducts_larsoft_v09_91_02_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/e6/f5/nutau_dune10kt_1x2x6_1110_408_20230827T023419Z_gen_g4_detsim_hitreco__20240219T164608Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Output 6: 0.998336, 0.00154793, 8.04057e-05, 3.55587e-05,
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 17-Nov-2024 06:33:27 CET run: 1110 subRun: 1 event: 40897
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 17-Nov-2024 06:33:27 CET run: 1110 subRun: 1 event: 40897
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 17-Nov-2024 06:33:27 CET run: 1110 subRun: 1 event: 40897
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 17-Nov-2024 06:33:27 CET run: 1110 subRun: 1 event: 40897
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-w Calorimetry: Calorimetry:pandoracaloRedo@BeginModule 17-Nov-2024 06:33:27 CET run: 1110 subRun: 1 event: 40897
caught exception ---- Track BEGIN
track at point #0 is almost parallel to the wires in view Z (wire direction is (0,-1,0); track direction is (0.0183411,-0.999832,0), its projection on plane C:0 T:6 P:2 is (0.999832,0)).
---- Track END
setting pitch (C) to -999
%MSG
Boundary wire vector sizes: 1328, 1947, 1777
minwire 0: 1270
minwire 1: 1650
minwire 2: 686
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary:
Output 0: 0.404447,
Output 1: 0.997097, 0.000159183, 0.00150709, 0.00123647,
Output 2: 0.00250551, 0.000856506, 0.996616, 2.19018e-05,
Output 3: 0.0514531, 0.895187, 0.0525056, 0.000854397,
Output 4: 0.65059, 0.312542, 0.0359554, 0.000912924,
Output 5: 0.0176082, 0.104357, 0.661953, 0.216081,
Output 6: 0.999487, 0.000501972, 7.9071e-06, 3.01564e-06,
PandoraContentApi::GetList(*this, m_inputHitListName, pCaloHitList) return STATUS_CODE_NOT_INITIALIZED
in function: GetVolumeIdToHitListMap
in file: /exp/dune/app/users/imawby/dunesw_v09_91_02d00/srcs/larpandoracontent/larpandoracontent/LArControlFlow/MasterAlgorithm.cc line#: 271
this->GetVolumeIdToHitListMap(volumeIdToHitListMap) return STATUS_CODE_NOT_INITIALIZED
in function: Run
in file: /exp/dune/app/users/imawby/dunesw_v09_91_02d00/srcs/larpandoracontent/larpandoracontent/LArControlFlow/MasterAlgorithm.cc line#: 165
iter->second->Run() throw STATUS_CODE_NOT_INITIALIZED
in function: RunAlgorithm
in file: /scratch/workspace/build-larbase/BUILDTYPE/prof/QUAL/s131-e26/label1/swarm/label2/SLF7/build/pandora/v03_16_00l/src/pandora-v03-16-00/PandoraSDK-v03-04-01/src/Api/PandoraContentApiImpl.cc line#: 235
Failure in algorithm Alg0002, LArDLMaster, STATUS_CODE_NOT_INITIALIZED
ElectronInitialRegionRefinementAlgorithm: unable to find track pfo list TrackParticles3D
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 17-Nov-2024 06:34:30 CET run: 1110 subRun: 1 event: 40899
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 17-Nov-2024 06:34:30 CET run: 1110 subRun: 1 event: 40899
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
ElectronInitialRegionRefinementAlgorithm: unable to find track pfo list TrackParticles3D
Boundary wire vector sizes: 190, 183, 179
minwire 0: 88
minwire 1: 2508
minwire 2: 26
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary:
Output 0: 0.752864,
Output 1: 0.00055345, 0.000147656, 9.66333e-05, 0.999202,
Output 2: 0.189096, 0.595591, 0.178448, 0.0368644,
Output 3: 0.991773, 0.00784975, 0.000302349, 7.53056e-05,
Output 4: 0.998878, 0.00106516, 5.21829e-05, 5.1337e-06,
Output 5: 0.00145753, 0.998312, 0.000220728, 9.88713e-06,
Output 6: 0.987074, 0.0104359, 0.00217814, 0.000311949,
%MSG-e DUNEAna: dunereco/FDSelections/CCNuSelection:ccnuselection@BeginModule 17-Nov-2024 06:34:33 CET run: 1110 subRun: 1 event: 40900
Failed to find product with label caldata ... returning empty vector
%MSG
%MSG-e DUNEAna: dunereco/FDSelections/CCNuSelection:ccnuselection@BeginModule 17-Nov-2024 06:34:33 CET run: 1110 subRun: 1 event: 40900
Failed to find product with label caldata ... returning empty vector
%MSG
%MSG-e DUNEAna: dunereco/FDSelections/CCNuSelection:ccnuselection@BeginModule 17-Nov-2024 06:34:33 CET run: 1110 subRun: 1 event: 40900
Failed to find product with label caldata ... returning empty vector
%MSG
%MSG-e DUNEAna: dunereco/FDSelections/CCNuSelection:ccnuselection@BeginModule 17-Nov-2024 06:34:33 CET run: 1110 subRun: 1 event: 40900
Failed to find product with label caldata ... returning empty vector
%MSG
17-Nov-2024 06:34:33 CET Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/e6/f5/nutau_dune10kt_1x2x6_1110_408_20230827T023419Z_gen_g4_detsim_hitreco__20240219T164608Z_reco2.root"
17-Nov-2024 06:34:33 CET Closed input file "root://dune.dcache.nikhef.nl:1094/pnfs/nikhef.nl/data/dune/generic/rucio/fardet-hd/e6/f5/nutau_dune10kt_1x2x6_1110_408_20230827T023419Z_gen_g4_detsim_hitreco__20240219T164608Z_reco2.root"
TrigReport ---------- Event summary -------------
TrigReport Events total = 100 passed = 100 failed = 0
TrigReport ---------- Modules in End-path ----------
TrigReport Run Success Error Name
TrigReport 100 100 0 ccnuselection
TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 12266.182713 Real = 12376.792899
MemReport ---------- Memory summary [base-10 MB] ------
MemReport VmPeak = 4180.64 VmHWM = 2727.33
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file === 