Jobsub ID 100554.1@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 100554.1@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 4118 |
| Stage ID | 1 |
| User name | imawby@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 43200 (12 hours) |
| Submitted time | 2024-11-17 01:25:02 |
| Site | NL_SURFsara |
| Entry | DUNE_SurfSARA_arc01 |
| Last heartbeat | 2024-11-17 05:05:26 |
| From worker node | Hostname | wn-ha-12.gina.surfsara.nl |
| cpuinfo | AMD EPYC 7551 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 129600 (36 hours) |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-11-17 01:27:06 |
| Input files | fardet-hd:nutau_dune10kt_1x2x6_1420_942_20230827T084053Z_gen_g4_detsim_hitreco__20240219T202149Z_reco2.root
|
| Jobscript | Exit code | 0 |
| Real time | 3h (13080s) |
| CPU time | 3h (13002s = 99%) |
| Outputting started | 2024-11-17 05:05:06 |
| Output files | |
| Finished | 2024-11-17 05:05:26 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
Justin processors: 1
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v09_91_02
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3
MRB_SOURCE=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/srcs
MRB_BUILDDIR=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/localProducts_larsoft_v09_91_02_e26_prof
PRODUCTS=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/localProducts_larsoft_v09_91_02_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/localProducts_larsoft_v09_91_02_e26_prof
local product directory is /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/baeee8261a966c7bf48ffdcd205bcc1e0b341bf3/localProducts_larsoft_v09_91_02_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
Input PFN = root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/6e/80/nutau_dune10kt_1x2x6_1420_942_20230827T084053Z_gen_g4_detsim_hitreco__20240219T202149Z_reco2.root
lar exit code 0
=== Start last 100 lines of lar log file ===
<ERROR> : 0-th variable of the event is NaN --> return MVA value -999,
<ERROR> : that's all I can do, please fix or remove this event.
<ERROR> : 0-th variable of the event is NaN --> return MVA value -999,
<ERROR> : that's all I can do, please fix or remove this event.
<ERROR> : 0-th variable of the event is NaN --> return MVA value -999,
<ERROR> : that's all I can do, please fix or remove this event.
<ERROR> : 0-th variable of the event is NaN --> return MVA value -999,
<ERROR> : that's all I can do, please fix or remove this event.
<ERROR> : 0-th variable of the event is NaN --> return MVA value -999,
<ERROR> : that's all I can do, please fix or remove this event.
Boundary wire vector sizes: 1438, 1324, 1453
minwire 0: 1881
minwire 1: 381
minwire 2: 2021
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary:
Output 0: 0.0845083,
Output 1: 0.162287, 0.0730055, 0.0717541, 0.692954,
Output 2: 0.367899, 0.053842, 0.570323, 0.00793524,
Output 3: 0.54207, 0.446986, 0.0102531, 0.000690684,
Output 4: 0.111538, 0.451038, 0.289767, 0.147657,
Output 5: 0.161026, 0.660525, 0.173971, 0.00447796,
Output 6: 0.999576, 0.00033563, 5.48086e-05, 3.33936e-05,
%MSG-e DUNEAna: dunereco/FDSelections/CCNuSelection:ccnuselection@BeginModule 17-Nov-2024 06:04:40 CET run: 1420 subRun: 1 event: 94298
Failed to find product with label caldata ... returning empty vector
%MSG
%MSG-e DUNEAna: dunereco/FDSelections/CCNuSelection:ccnuselection@BeginModule 17-Nov-2024 06:04:40 CET run: 1420 subRun: 1 event: 94298
Failed to find product with label caldata ... returning empty vector
%MSG
Boundary wire vector sizes: 122, 167, 160
minwire 0: 974
minwire 1: 1236
minwire 2: 992
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max wires due to vertex determination failure: 2379, 2878
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary:
Output 0: 0.380766,
Output 1: 0.000978764, 1.10685e-05, 0.000244474, 0.998766,
Output 2: 0.0753343, 0.352184, 0.110572, 0.461909,
Output 3: 0.162418, 0.497952, 0.337775, 0.00185582,
Output 4: 0.964184, 0.0354174, 0.000382854, 1.54638e-05,
Output 5: 0.999555, 0.000433071, 9.29463e-06, 2.25264e-06,
Output 6: 0.99431, 0.00510313, 0.000507605, 7.91443e-05,
%MSG-e DUNEAna: dunereco/FDSelections/CCNuSelection:ccnuselection@BeginModule 17-Nov-2024 06:04:59 CET run: 1420 subRun: 1 event: 94299
Failed to find product with label caldata ... returning empty vector
%MSG
%MSG-e DUNEAna: dunereco/FDSelections/CCNuSelection:ccnuselection@BeginModule 17-Nov-2024 06:04:59 CET run: 1420 subRun: 1 event: 94299
Failed to find product with label caldata ... returning empty vector
%MSG
Boundary wire vector sizes: 214, 398, 326
minwire 0: 1517
minwire 1: 740
minwire 2: 1037
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 499
Classifier summary:
Output 0: 0.12474,
Output 1: 0.070717, 0.000936463, 0.0121065, 0.91624,
Output 2: 0.240792, 0.530114, 0.186278, 0.0428155,
Output 3: 0.199704, 0.777565, 0.0218689, 0.000863095,
Output 4: 0.195786, 0.798943, 0.00520878, 6.16475e-05,
Output 5: 0.672333, 0.327595, 6.60226e-05, 5.67081e-06,
Output 6: 0.998347, 0.00150132, 0.000126307, 2.54675e-05,
%MSG-e DUNEAna: dunereco/FDSelections/CCNuSelection:ccnuselection@BeginModule 17-Nov-2024 06:05:03 CET run: 1420 subRun: 1 event: 94300
Failed to find product with label caldata ... returning empty vector
%MSG
%MSG-e DUNEAna: dunereco/FDSelections/CCNuSelection:ccnuselection@BeginModule 17-Nov-2024 06:05:03 CET run: 1420 subRun: 1 event: 94300
Failed to find product with label caldata ... returning empty vector
%MSG
%MSG-e DUNEAna: dunereco/FDSelections/CCNuSelection:ccnuselection@BeginModule 17-Nov-2024 06:05:04 CET run: 1420 subRun: 1 event: 94300
Failed to find product with label caldata ... returning empty vector
%MSG
%MSG-e DUNEAna: dunereco/FDSelections/CCNuSelection:ccnuselection@BeginModule 17-Nov-2024 06:05:04 CET run: 1420 subRun: 1 event: 94300
Failed to find product with label caldata ... returning empty vector
%MSG
17-Nov-2024 06:05:04 CET Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/6e/80/nutau_dune10kt_1x2x6_1420_942_20230827T084053Z_gen_g4_detsim_hitreco__20240219T202149Z_reco2.root"
17-Nov-2024 06:05:04 CET Closed input file "root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/fardet-hd/6e/80/nutau_dune10kt_1x2x6_1420_942_20230827T084053Z_gen_g4_detsim_hitreco__20240219T202149Z_reco2.root"
TrigReport ---------- Event summary -------------
TrigReport Events total = 100 passed = 100 failed = 0
TrigReport ---------- Modules in End-path ----------
TrigReport Run Success Error Name
TrigReport 100 100 0 ccnuselection
TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 12954.944160 Real = 13020.644412
MemReport ---------- Memory summary [base-10 MB] ------
MemReport VmPeak = 3962.31 VmHWM = 2251.75
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
