justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 228626.41@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID228626.41@justin-prod-sched02.dune.hep.ac.uk
Workflow ID7889
Stage ID1
User nameykermaid@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6815744000 (6500 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-24 13:43:54
SiteUK_Bristol
EntryCMSHTPC_T2_UK_SGrid_Bristol_lcgce02
Last heartbeat2025-06-24 13:56:49
From worker nodeHostnamehd82.dice.priv
cpuinfoAMD EPYC 7551P 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes6815744000 (6500 MiB)
Wall seconds limit259200 (72 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-24 13:54:47
Input filesmonte-carlo-007889-000049
JobscriptExit code0
Real time0m (18s)
CPU time0m (8s = 44%)
Max RSS bytes51609600 (49 MiB)
Outputting started2025-06-24 13:55:05
Output files
Finished2025-06-24 13:56:49
Saved logsjustin-logs:228626.41-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_06_00d01/include
DUNECALIB_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunecalib/v10_06_00d01
DUNEOPDET_INC=/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v10_06_00d01/include
DUNEANA_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v10_06_00d01/slf7.x86_64.e26.prof
DUNEANA_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v10_06_00d01
SETUP_DUNEEXAMPLES=duneexamples v10_06_00d01 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNEANA_INC=/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v10_06_00d01/include
DUNECORE_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_06_00d01/slf7.x86_64.e26.prof
DUNEPDLEGACY_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04/slf7.x86_64.e26.prof
DUNEEXAMPLES_INC=/cvmfs/dune.opensciencegrid.org/products/dune/duneexamples/v10_06_00d01/include
DUNEANAOBJ_VERSION=v03_08_00
DUNE_PARDATA_VERSION=v0_02_00
DUNEANAOBJ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneanaobj/v03_08_00
DUNEDAQDATAFORMATS_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunedaqdataformats/v4_4_5
SETUP_DUNERECO=dunereco v10_06_00d01 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
PROTODUNEANA_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_06_00d01
DUNEDATAPREP_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v10_06_00d01/include
DUNESW_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v10_06_00d01/slf7.x86_64.e26.prof
SETUP_DUNEUTIL=duneutil v10_06_00d01 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNESW_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v10_06_00d01
DUNE_PARDATA_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dune_pardata/v01_84_00
DUNETRIGGER_VERSION=v10_06_00d01
DUNESIM_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunesim/v10_06_00d01
DUNEOPDET_VERSION=v10_06_00d01
SETUP_DUNE_PARDATA=dune_pardata v01_84_00 -f NULL -z /cvmfs/dune.opensciencegrid.org/products/dune
DUNERECO_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_06_00d01/slf7.x86_64.e26.prof
DUNEEXAMPLES_VERSION=v10_06_00d01
DUNERECO_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_06_00d01/include
DUNEUTIL_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_06_00d01
DUNEPDLEGACY_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04
DUNECORE_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_06_00d01
DUNECALIB_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunecalib/v10_06_00d01/slf7.x86_64.e26.prof
DUNEANA_VERSION=v10_06_00d01
DUNETRIGGER_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_06_00d01
DUNEPROTOTYPES_VERSION=v10_06_00d01
DUNEOPDET_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v10_06_00d01
DUNEPROTOTYPES_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v10_06_00d01
SETUP_DUNEDATAPREP=dunedataprep v10_06_00d01 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNETRIGGER_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_06_00d01/slf7.x86_64.e26.prof
DUNEOPDET_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v10_06_00d01/slf7.x86_64.e26.prof
PROTODUNEANA_VERSION=v10_06_00d01
SETUP_DUNEPROTOTYPES=duneprototypes v10_06_00d01 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNEEXAMPLES_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneexamples/v10_06_00d01/slf7.x86_64.e26.prof
DUNEDATAPREP_VERSION=v10_06_00d01
DUNECORE_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_06_00d01/include
DUNEPDLEGACY_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04/include
SETUP_DUNEANA=duneana v10_06_00d01 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNEPROTOTYPES_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v10_06_00d01/slf7.x86_64.e26.prof/lib
DUNEDETDATAFORMATS_VERSION=v4_4_5
DUNEUTIL_VERSION=v10_06_00d01
DUNESW_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunesw/v10_06_00d01/slf7.x86_64.e26.prof/lib
SETUP_PROTODUNEANA=protoduneana v10_06_00d01 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
SETUP_DUNESIM=dunesim v10_06_00d01 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
PROTODUNEANA_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_06_00d01/slf7.x86_64.e26.prof
DUNESIM_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunesim/v10_06_00d01/slf7.x86_64.e26.prof/lib
SETUP_DUNEOPDET=duneopdet v10_06_00d01 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNESIM_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunesim/v10_06_00d01/slf7.x86_64.e26.prof
SETUP_DUNEPDLEGACY=dunepdlegacy v1_01_04 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNECALIB_VERSION=v10_06_00d01
SETUP_DUNEDAQDATAFORMATS=dunedaqdataformats v4_4_5 -f NULL -z /cvmfs/dune.opensciencegrid.org/products/dune
DUNEEXAMPLES_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneexamples/v10_06_00d01
DUNECORE_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunecore/v10_06_00d01/slf7.x86_64.e26.prof/lib
DUNEPDLEGACY_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunepdlegacy/v1_01_04/slf7.x86_64.e26.prof/lib
SETUP_DUNETRIGGER=dunetrigger v10_06_00d01 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNEANA_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/duneana/v10_06_00d01/slf7.x86_64.e26.prof/lib
SETUP_DUNECORE=dunecore v10_06_00d01 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
SETUP_DUNEANAOBJ=duneanaobj v03_08_00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNETRIGGER_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunetrigger/v10_06_00d01/slf7.x86_64.e26.prof/lib
DUNESIM_VERSION=v10_06_00d01
DUNECALIB_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunecalib/v10_06_00d01/include
DUNEOPDET_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/duneopdet/v10_06_00d01/slf7.x86_64.e26.prof/lib
DUNEUTIL_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_06_00d01/slf7.x86_64.e26.prof
DUNEANAOBJ_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/duneanaobj/v03_08_00/slf7.x86_64.e26.prof/lib
DUNEPROTOTYPES_FQ_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v10_06_00d01/slf7.x86_64.e26.prof
PROTODUNEANA_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_06_00d01/slf7.x86_64.e26.prof/lib
DUNEPROTOTYPES_INC=/cvmfs/dune.opensciencegrid.org/products/dune/duneprototypes/v10_06_00d01/include
DUNEEXAMPLES_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/duneexamples/v10_06_00d01/slf7.x86_64.e26.prof/lib
DUNESW_TAR=/cvmfs/fifeuser2.opensciencegrid.org/sw/dune/ae229bfd2a69ee0e3604cead136839fda551355d
SETUP_DUNECALIB=dunecalib v10_06_00d01 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
DUNERECO_VERSION=v10_06_00d01
DUNEDETDATAFORMATS_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunedetdataformats/v4_4_5/include
SETUP_DUNESW=dunesw v10_06_00d01 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
PROTODUNEANA_INC=/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_06_00d01/include
DUNEDATAPREP_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v10_06_00d01/slf7.x86_64.e26.prof/lib
DUNERECO_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_06_00d01
Installing yaml
Collecting pyyaml
  Downloading PyYAML-6.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (737 kB)
Installing collected packages: pyyaml
Successfully installed pyyaml-6.0.2
WARNING: You are using pip version 21.2.4; however, version 25.1.1 is available.
You should consider upgrading via the '/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/bin/python3 -m pip install --upgrade pip' command.
Done
Will use justin-get-file
input file: monte-carlo-007889-000049
jobsub_id: 228626.41@justin-prod-sched02.dune.hep.ac.uk
MCJob: 1
nevents: 20
input flag: 
Will execute:
python -m beam_job_utils run_job       --json /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ad1d407c16c06af249beccc1aeb395c50aa19143/pdhd_LE_test.json       --overrides core.data_tier=full-reconstructed   core.application.version=v10_06_00d01   core.application.name=reco   core.application.family=dunesw   core.application=dunesw.reco         --run 228626       --subrun 41       --yaml /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ad1d407c16c06af249beccc1aeb395c50aa19143/prod_scan_0to10MeV_alpha_protodunehd.fcl       --nevents 20       --event 0       
Traceback (most recent call last):
  File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/lib/python3.9/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ad1d407c16c06af249beccc1aeb395c50aa19143/beam_job_utils.py", line 374, in <module>
    routines[args.routine](args)
  File "/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ad1d407c16c06af249beccc1aeb395c50aa19143/beam_job_utils.py", line 251, in run_job
    with open(args.yaml) as fin:
FileNotFoundError: [Errno 2] No such file or directory: '/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ad1d407c16c06af249beccc1aeb395c50aa19143/prod_scan_0to10MeV_alpha_protodunehd.fcl'
ls: cannot access *_reco_*.root: No such file or directory
Output files:
   Reco: 
Forming reco metadata
justIN time: 2025-08-14 18:00:06 UTC       justIN version: 01.03.02