justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 358067.46@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID358067.46@justin-prod-sched01.dune.hep.ac.uk
Workflow ID5747
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-03-27 11:14:50
SiteUK_Glasgow
EntryCLAS12_T3_UK_ScotGrid_GLA_ce04_scitok
Last heartbeat2025-03-27 11:42:02
From worker nodeHostnamewn-d22-007.beowulf.cluster
cpuinfoAMD EPYC 7513 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes6815744000 (6500 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-03-27 11:26:57
Input files
JobscriptExit code0
Real time1m (90s)
CPU time0m (6s = 6%)
Max RSS bytes41332736 (39 MiB)
Outputting started2025-03-27 11:28:27
Output files
Finished2025-03-27 11:42:02
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

nsciencegrid.org/products -q e26:prof
SETUP_CETLIB=cetlib v3_18_02 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
SETUP_FHICLCPP=fhiclcpp v4_18_04 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
OPENBLAS_INC=/cvmfs/larsoft.opensciencegrid.org/products/openblas/v0_3_23/Linux64bit+3.10-2.17-e26/include
PYTHON_INCLUDE=/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/include/python3.9
_=/usr/bin/env
DUNE specific env vars
DUNEDATAPREP_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v10_04_01d00/slf7.x86_64.e26.prof
DUNEDAQDATAFORMATS_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunedaqdataformats/v4_4_4/include
DUNESIM_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunesim/v10_04_01d00/include
DUNEPDLEGACY_VERSION=v1_01_04
DUNECORE_VERSION=v10_04_01d00
DUNECALIB_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunecalib/v10_04_01d00/slf7.x86_64.e26.prof/lib
DUNEDETDATAFORMATS_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunedetdataformats/v4_4_4
DUNESW_VERSION=v10_04_01d00
DUNEDATAPREP_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v10_04_01d00
DUNERECO_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_04_01d00/slf7.x86_64.e26.prof/lib
SETUP_DUNEDETDATAFORMATS=dunedetdataformats v4_4_4 -f NULL -z /cvmfs/dune.opensciencegrid.org/products/dune
DUNEDAQDATAFORMATS_VERSION=v4_4_4
DUNEANAOBJ_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneanaobj/v03_05_00/slf7.x86_64.e26.prof
DUNEANAOBJ_INC=/cvmfs/dune.opensciencegrid.org/products/dune/duneanaobj/v03_05_00/include
DUNETRIGGER_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_04_01d00/include
DUNECALIB_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunecalib/v10_04_01d00
DUNEOPDET_INC=/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v10_04_01d00/include
DUNEANA_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v10_04_01d00/slf7.x86_64.e26.prof
DUNEANA_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v10_04_01d00
SETUP_DUNEEXAMPLES=duneexamples v10_04_01d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNEANA_INC=/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v10_04_01d00/include
DUNECORE_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_04_01d00/slf7.x86_64.e26.prof
DUNEPDLEGACY_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04/slf7.x86_64.e26.prof
DUNEEXAMPLES_INC=/cvmfs/dune.opensciencegrid.org/products/dune/duneexamples/v10_04_01d00/include
DUNEANAOBJ_VERSION=v03_05_00
DUNE_PARDATA_VERSION=v0_02_00
DUNEANAOBJ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneanaobj/v03_05_00
DUNEDAQDATAFORMATS_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunedaqdataformats/v4_4_4
SETUP_DUNERECO=dunereco v10_04_01d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
PROTODUNEANA_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_04_01d00
DUNEDATAPREP_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v10_04_01d00/include
DUNESW_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v10_04_01d00/slf7.x86_64.e26.prof
SETUP_DUNEUTIL=duneutil v10_04_01d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNESW_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v10_04_01d00
DUNE_PARDATA_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dune_pardata/v01_84_00
DUNETRIGGER_VERSION=v10_04_01d00
DUNESIM_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunesim/v10_04_01d00
DUNEOPDET_VERSION=v10_04_01d00
SETUP_DUNE_PARDATA=dune_pardata v01_84_00 -f NULL -z /cvmfs/dune.opensciencegrid.org/products/dune
DUNERECO_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_04_01d00/slf7.x86_64.e26.prof
DUNEEXAMPLES_VERSION=v10_04_01d00
DUNERECO_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_04_01d00/include
DUNEUTIL_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_04_01d00
DUNEPDLEGACY_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04
DUNECORE_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_04_01d00
DUNECALIB_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunecalib/v10_04_01d00/slf7.x86_64.e26.prof
DUNEANA_VERSION=v10_04_01d00
DUNETRIGGER_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_04_01d00
DUNEPROTOTYPES_VERSION=v10_04_01d00
DUNEOPDET_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v10_04_01d00
DUNEPROTOTYPES_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v10_04_01d00
SETUP_DUNEDATAPREP=dunedataprep v10_04_01d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNETRIGGER_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_04_01d00/slf7.x86_64.e26.prof
DUNEOPDET_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v10_04_01d00/slf7.x86_64.e26.prof
PROTODUNEANA_VERSION=v10_04_01d00
SETUP_DUNEPROTOTYPES=duneprototypes v10_04_01d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNEEXAMPLES_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneexamples/v10_04_01d00/slf7.x86_64.e26.prof
DUNEDATAPREP_VERSION=v10_04_01d00
DUNECORE_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_04_01d00/include
DUNEPDLEGACY_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04/include
SETUP_DUNEANA=duneana v10_04_01d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNEPROTOTYPES_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v10_04_01d00/slf7.x86_64.e26.prof/lib
DUNEDETDATAFORMATS_VERSION=v4_4_4
DUNEUTIL_VERSION=v10_04_01d00
DUNESW_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v10_04_01d00/slf7.x86_64.e26.prof/lib
SETUP_PROTODUNEANA=protoduneana v10_04_01d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
SETUP_DUNESIM=dunesim v10_04_01d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
PROTODUNEANA_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_04_01d00/slf7.x86_64.e26.prof
DUNESIM_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunesim/v10_04_01d00/slf7.x86_64.e26.prof/lib
SETUP_DUNEOPDET=duneopdet v10_04_01d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNESIM_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunesim/v10_04_01d00/slf7.x86_64.e26.prof
SETUP_DUNEPDLEGACY=dunepdlegacy v1_01_04 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNECALIB_VERSION=v10_04_01d00
SETUP_DUNEDAQDATAFORMATS=dunedaqdataformats v4_4_4 -f NULL -z /cvmfs/dune.opensciencegrid.org/products/dune
DUNEEXAMPLES_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneexamples/v10_04_01d00
DUNECORE_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_04_01d00/slf7.x86_64.e26.prof/lib
DUNEPDLEGACY_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04/slf7.x86_64.e26.prof/lib
SETUP_DUNETRIGGER=dunetrigger v10_04_01d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNEANA_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v10_04_01d00/slf7.x86_64.e26.prof/lib
SETUP_DUNECORE=dunecore v10_04_01d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
SETUP_DUNEANAOBJ=duneanaobj v03_05_00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNETRIGGER_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_04_01d00/slf7.x86_64.e26.prof/lib
DUNESIM_VERSION=v10_04_01d00
DUNECALIB_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunecalib/v10_04_01d00/include
DUNEOPDET_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v10_04_01d00/slf7.x86_64.e26.prof/lib
DUNEUTIL_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_04_01d00/slf7.x86_64.e26.prof
DUNEANAOBJ_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/duneanaobj/v03_05_00/slf7.x86_64.e26.prof/lib
DUNEPROTOTYPES_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v10_04_01d00/slf7.x86_64.e26.prof
PROTODUNEANA_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_04_01d00/slf7.x86_64.e26.prof/lib
DUNEPROTOTYPES_INC=/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v10_04_01d00/include
DUNEEXAMPLES_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/duneexamples/v10_04_01d00/slf7.x86_64.e26.prof/lib
DUNESW_TAR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/8e14053062785f80c03da35c9e53597243e9b1b5
SETUP_DUNECALIB=dunecalib v10_04_01d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNERECO_VERSION=v10_04_01d00
DUNEDETDATAFORMATS_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunedetdataformats/v4_4_4/include
SETUP_DUNESW=dunesw v10_04_01d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
PROTODUNEANA_INC=/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_04_01d00/include
DUNEDATAPREP_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v10_04_01d00/slf7.x86_64.e26.prof/lib
DUNERECO_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_04_01d00
Installing yaml
Collecting pyyaml
  Downloading PyYAML-6.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (737 kB)
Installing collected packages: pyyaml
Successfully installed pyyaml-6.0.2
WARNING: You are using pip version 21.2.4; however, version 25.0.1 is available.
You should consider upgrading via the '/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python3 -m pip install --upgrade pip' command.
Done
Will use justin-get-file
No files available from this stage
Could not get file
justIN time: 2025-04-03 08:20:45 UTC       justIN version: 01.03.00