Jobsub ID 99049.1@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 99049.1@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 4119 |
| Stage ID | 1 |
| User name | imawby@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 43200 (12 hours) |
| Submitted time | 2024-11-16 15:06:44 |
| Site | CERN |
| Entry | CMSHTPC_T2_CH_CERN_ce513 |
| Last heartbeat | 2024-11-16 17:15:39 |
| From worker node | Hostname | b9g34p0608.cern.ch |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-11-16 15:07:49 |
| Input files | fardet-hd:nu_dune10kt_1x2x6_1100_758_20230826T035402Z_gen_g4_detsim_hitreco__20240229T184402Z_reco2.root
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7652s) |
| CPU time | 2h (7975s = 104%) |
| Outputting started | 2024-11-16 17:15:21 |
| Output files | |
| Finished | 2024-11-16 17:15:39 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
Justin processors: 1
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v09_91_02
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3
MRB_SOURCE=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/srcs
MRB_BUILDDIR=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/localProducts_larsoft_v09_91_02_e26_prof
PRODUCTS=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/localProducts_larsoft_v09_91_02_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/localProducts_larsoft_v09_91_02_e26_prof
local product directory is /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/localProducts_larsoft_v09_91_02_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/17/61/nu_dune10kt_1x2x6_1100_758_20230826T035402Z_gen_g4_detsim_hitreco__20240229T184402Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 16-Nov-2024 18:10:03 CET run: 1100 subRun: 1 event: 75898
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
<ERROR> : 0-th variable of the event is NaN --> return MVA value -999,
<ERROR> : that's all I can do, please fix or remove this event.
<ERROR> : 0-th variable of the event is NaN --> return MVA value -999,
<ERROR> : that's all I can do, please fix or remove this event.
<ERROR> : 0-th variable of the event is NaN --> return MVA value -999,
<ERROR> : that's all I can do, please fix or remove this event.
<ERROR> : 0-th variable of the event is NaN --> return MVA value -999,
<ERROR> : that's all I can do, please fix or remove this event.
<ERROR> : 0-th variable of the event is NaN --> return MVA value -999,
<ERROR> : that's all I can do, please fix or remove this event.
Boundary wire vector sizes: 165, 131, 141
minwire 0: 2625
minwire 1: 663
minwire 2: 2393
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2379, 2878
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary:
Output 0: 0.435609,
Output 1: 0.118097, 0.000284181, 0.00760158, 0.874017,
Output 2: 0.00366617, 0.827385, 0.140551, 0.0283981,
Output 3: 0.00420542, 0.0288396, 0.0676867, 0.899268,
Output 4: 0.188652, 0.617313, 0.192677, 0.00135886,
Output 5: 0.999945, 4.63071e-05, 7.12251e-06, 1.82929e-06,
Output 6: 0.997551, 0.00234178, 8.39897e-05, 2.37708e-05,
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 16-Nov-2024 18:10:27 CET run: 1100 subRun: 1 event: 75899
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 16-Nov-2024 18:10:27 CET run: 1100 subRun: 1 event: 75899
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 16-Nov-2024 18:10:27 CET run: 1100 subRun: 1 event: 75899
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 16-Nov-2024 18:10:27 CET run: 1100 subRun: 1 event: 75899
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 16-Nov-2024 18:10:27 CET run: 1100 subRun: 1 event: 75899
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
%MSG-e ShowerProducedPtrsHolder: LArPandoraModularShowerCreation:pandoraShowerRedo@BeginModule 16-Nov-2024 18:10:27 CET run: 1100 subRun: 1 event: 75899
Trying to add data product: InitialTrack. This element does not exist in the element holder
%MSG
Boundary wire vector sizes: 3755, 4184, 4284
minwire 0: 435
minwire 1: 683
minwire 2: 0
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary:
Output 0: 0.096468,
Output 1: 0.947403, 6.58285e-05, 0.0495787, 0.00295226,
Output 2: 0.000590305, 0.00125875, 0.998091, 5.98526e-05,
Output 3: 0.181177, 0.653849, 0.157453, 0.00752102,
Output 4: 0.02917, 0.0645989, 0.374518, 0.531714,
Output 5: 0.0492297, 0.919585, 0.0309548, 0.000230836,
Output 6: 0.999062, 0.000878228, 4.17407e-05, 1.85889e-05,
Boundary wire vector sizes: 541, 606, 550
minwire 0: 1074
minwire 1: 1499
minwire 2: 951
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2277, 2776
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary:
Output 0: 0.112632,
Output 1: 0.00522965, 0.660713, 0.26877, 0.0652876,
Output 2: 0.0859993, 0.585615, 0.208273, 0.120112,
Output 3: 0.000719134, 0.0073346, 0.867555, 0.124391,
Output 4: 0.114647, 0.882452, 0.00288801, 1.27946e-05,
Output 5: 0.908941, 0.091035, 2.19139e-05, 2.03224e-06,
Output 6: 0.999811, 0.000183902, 4.47924e-06, 1.02287e-06,
16-Nov-2024 18:15:20 CET Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/17/61/nu_dune10kt_1x2x6_1100_758_20230826T035402Z_gen_g4_detsim_hitreco__20240229T184402Z_reco2.root"
16-Nov-2024 18:15:20 CET Closed input file "root://xrootd.echo.stfc.ac.uk:1094/dune:/protodune/RSE/fardet-hd/17/61/nu_dune10kt_1x2x6_1100_758_20230826T035402Z_gen_g4_detsim_hitreco__20240229T184402Z_reco2.root"
TrigReport ---------- Event summary -------------
TrigReport Events total = 100 passed = 100 failed = 0
TrigReport ---------- Modules in End-path ----------
TrigReport Run Success Error Name
TrigReport 100 100 0 ccnuselection
TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 7929.423420 Real = 7598.747994
MemReport ---------- Memory summary [base-10 MB] ------
MemReport VmPeak = 3959.37 VmHWM = 2332.96
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
