Jobsub ID 291564.10@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 291564.10@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 4116 |
| Stage ID | 1 |
| User name | imawby@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 43200 (12 hours) |
| Submitted time | 2024-11-16 13:42:49 |
| Site | NL_SURFsara |
| Entry | DUNE_SurfSARA_arc01 |
| Last heartbeat | 2024-11-16 15:25:25 |
| From worker node | Hostname | wn-lb-10.gina.surfsara.nl |
| cpuinfo | AMD EPYC 9754 128-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-11-16 13:43:47 |
| Input files | fardet-hd:nu_dune10kt_1x2x6_1102_901_20230826T071954Z_gen_g4_detsim_hitreco__20240229T183043Z_reco2.root
|
| Jobscript | Exit code | 0 |
| Real time | 1h (6074s) |
| CPU time | 1h (6042s = 99%) |
| Outputting started | 2024-11-16 15:25:02 |
| Output files | |
| Finished | 2024-11-16 15:25:25 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
Justin processors: 1
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v09_91_02
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3
MRB_SOURCE=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/srcs
MRB_BUILDDIR=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/localProducts_larsoft_v09_91_02_e26_prof
PRODUCTS=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/localProducts_larsoft_v09_91_02_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/localProducts_larsoft_v09_91_02_e26_prof
local product directory is /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/localProducts_larsoft_v09_91_02_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/7a/7a/nu_dune10kt_1x2x6_1102_901_20230826T071954Z_gen_g4_detsim_hitreco__20240229T183043Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Output 0: 0.0398725,
Output 1: 0.000188021, 0.127492, 0.0166018, 0.855718,
Output 2: 0.842656, 0.0475552, 0.0121813, 0.0976072,
Output 3: 0.779468, 0.196196, 0.0236216, 0.000714191,
Output 4: 0.996246, 0.00372939, 2.25672e-05, 2.43622e-06,
Output 5: 0.288483, 0.71148, 3.30555e-05, 3.97882e-06,
Output 6: 0.987532, 0.0120763, 0.000346467, 4.55614e-05,
%MSG-e DUNEAna: dunereco/FDSelections/CCNuSelection:ccnuselection@BeginModule 16-Nov-2024 16:15:43 CET run: 1102 subRun: 1 event: 90198
Failed to find product with label caldata ... returning empty vector
%MSG
%MSG-e DUNEAna: dunereco/FDSelections/CCNuSelection:ccnuselection@BeginModule 16-Nov-2024 16:15:43 CET run: 1102 subRun: 1 event: 90198
Failed to find product with label caldata ... returning empty vector
%MSG
%MSG-w ShowerPCADirection: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 16-Nov-2024 16:17:13 CET run: 1102 subRun: 1 event: 90199
0 spacepoints in shower, not calculating direction
%MSG
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 16-Nov-2024 16:17:13 CET run: 1102 subRun: 1 event: 90199
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 16-Nov-2024 16:17:13 CET run: 1102 subRun: 1 event: 90199
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 16-Nov-2024 16:17:13 CET run: 1102 subRun: 1 event: 90199
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 16-Nov-2024 16:17:13 CET run: 1102 subRun: 1 event: 90199
Trying to add data product: ShowerPCA. This element does not exist in the element holder
%MSG
<ERROR> : 0-th variable of the event is NaN --> return MVA value -999,
<ERROR> : that's all I can do, please fix or remove this event.
<ERROR> : 0-th variable of the event is NaN --> return MVA value -999,
<ERROR> : that's all I can do, please fix or remove this event.
<ERROR> : 0-th variable of the event is NaN --> return MVA value -999,
<ERROR> : that's all I can do, please fix or remove this event.
<ERROR> : 0-th variable of the event is NaN --> return MVA value -999,
<ERROR> : that's all I can do, please fix or remove this event.
<ERROR> : 0-th variable of the event is NaN --> return MVA value -999,
<ERROR> : that's all I can do, please fix or remove this event.
Boundary wire vector sizes: 6197, 6203, 5424
minwire 0: 1328
minwire 1: 202
minwire 2: 1405
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary:
Output 0: 0.0759621,
Output 1: 0.766322, 0.0115913, 0.154682, 0.0674052,
Output 2: 0.000571248, 0.000999549, 0.998184, 0.000245431,
Output 3: 0.11455, 0.156565, 0.189498, 0.539386,
Output 4: 0.0950164, 0.297352, 0.368012, 0.23962,
Output 5: 0.0685076, 0.288558, 0.479737, 0.163198,
Output 6: 0.998432, 0.00141383, 9.49962e-05, 5.87897e-05,
%MSG-e DUNEAna: dunereco/FDSelections/CCNuSelection:ccnuselection@BeginModule 16-Nov-2024 16:24:05 CET run: 1102 subRun: 1 event: 90199
Failed to find product with label caldata ... returning empty vector
%MSG
%MSG-e DUNEAna: dunereco/FDSelections/CCNuSelection:ccnuselection@BeginModule 16-Nov-2024 16:24:05 CET run: 1102 subRun: 1 event: 90199
Failed to find product with label caldata ... returning empty vector
%MSG
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 16-Nov-2024 16:24:29 CET run: 1102 subRun: 1 event: 90200
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 16-Nov-2024 16:24:29 CET run: 1102 subRun: 1 event: 90200
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 1165, 1647, 1612
minwire 0: 1533
minwire 1: 24
minwire 2: 1525
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary:
Output 0: 0.825267,
Output 1: 0.980497, 5.44184e-05, 0.0178382, 0.00161031,
Output 2: 0.00723288, 0.420001, 0.56772, 0.00504611,
Output 3: 0.299469, 0.685155, 0.0150613, 0.000314814,
Output 4: 0.717535, 0.281369, 0.00106703, 2.88004e-05,
Output 5: 0.0483821, 0.950795, 0.000801274, 2.18277e-05,
Output 6: 0.995989, 0.00359194, 0.000355756, 6.30555e-05,
16-Nov-2024 16:24:57 CET Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/7a/7a/nu_dune10kt_1x2x6_1102_901_20230826T071954Z_gen_g4_detsim_hitreco__20240229T183043Z_reco2.root"
16-Nov-2024 16:24:57 CET Closed input file "root://ccxrootdegee.in2p3.fr:1094/pnfs/in2p3.fr/data/dune/disk/fardet-hd/7a/7a/nu_dune10kt_1x2x6_1102_901_20230826T071954Z_gen_g4_detsim_hitreco__20240229T183043Z_reco2.root"
TrigReport ---------- Event summary -------------
TrigReport Events total = 100 passed = 100 failed = 0
TrigReport ---------- Modules in End-path ----------
TrigReport Run Success Error Name
TrigReport 100 100 0 ccnuselection
TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 6006.829184 Real = 6030.773865
MemReport ---------- Memory summary [base-10 MB] ------
MemReport VmPeak = 4070.33 VmHWM = 2284.15
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
