Jobsub ID 290635.4@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID	290635.4@justin-prod-sched01.dune.hep.ac.uk
Workflow ID	4109
Stage ID	1
User name	lavaut@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2024-11-15 14:13:18
Site	CZ_FZU
Entry	Nova_CZ_FZU_osgce2
Last heartbeat	2024-11-15 14:59:24
From worker node	Hostname	milan02.farm.particle.cz
	cpuinfo	AMD EPYC 7543 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	Inner Apptainer?	True
Job state	outputting_failed
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2024-11-15 14:13:51
Input files	hd-protodune-det-reco:np04hd_raw_run028850_0044_dataflow5_datawriter_0_20240822T125644_reco_stage1_reco_stage2_20240822T150458_keepup.root hd-protodune-det-reco:np04hd_raw_run028850_0029_dataflow0_datawriter_0_20240822T124926_reco_stage1_reco_stage2_20240822T150413_keepup.root hd-protodune-det-reco:np04hd_raw_run028850_0040_dataflow0_datawriter_0_20240822T125442_reco_stage1_reco_stage2_20240822T150608_keepup.root hd-protodune-det-reco:np04hd_raw_run028850_0081_dataflow6_datawriter_0_20240822T131412_reco_stage1_reco_stage2_20240822T150812_keepup.root hd-protodune-det-reco:np04hd_raw_run028850_0032_dataflow3_datawriter_0_20240822T125051_reco_stage1_reco_stage2_20240824T151015_keepup.root hd-protodune-det-reco:np04hd_raw_run028850_0083_dataflow5_datawriter_0_20240822T131514_reco_stage1_reco_stage2_20240822T161802_keepup.root
Jobscript	Exit code	0
	Real time	45m (2716s)
	CPU time	43m (2638s = 97%)
Outputting started	2024-11-15 14:59:07
Output files
Finished	2024-11-15 14:59:24
List job events Wrapper job log

Jobscript log (last 10,000 characters)

No files available from this stage
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Input PFN = 
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
PRODUCTS: /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
DUNESW_DIR: 
DUNESW_DIR: /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/dunesw/v10_00_02d00
PROTODUNEANA_DIR: /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/protoduneana/v10_00_02d00
DUNEPROTOTYPES_DIR: /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/duneprototypes/v10_00_02d00

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v10_00_02d00
MRB_QUALS=prof:e26
MRB_TOP=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f
MRB_SOURCE=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/srcs
MRB_BUILDDIR=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/localProducts_larsoft_v10_00_02d00_prof_e26

PRODUCTS=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/localProducts_larsoft_v10_00_02d00_prof_e26:/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/localProducts_larsoft_v10_00_02d00_prof_e26

 VERSION ACTIVE =  VERSION ACTIVE =  VERSION ACTIVE = 
duneprototypes    v10_00_02d00    -f Linux64bit+3.10-2.17 -q e26:prof        -z /cvmfs/dune.opensciencegrid.org/products/dune
dunesw            v10_00_02d00    -f Linux64bit+3.10-2.17 -q e26:prof        -z /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/localProducts_larsoft_v10_00_02d00_prof_e26
local product directory is /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/localProducts_larsoft_v10_00_02d00_prof_e26
----------- this block should be empty ------------------
---------------------------------------------------------
lar exit code 0
.:
total 884
-rw-r--r-- 1 fermilab users 677874 Nov 15 15:59 _singleHit_2024-11-15T_141359Z.root
-rw-r--r-- 1 fermilab users 135168 Nov 15 15:59 mem.db
-rw-r--r-- 1 fermilab users  36864 Nov 15 15:59 time.db
-rw-r--r-- 1 fermilab users  18582 Nov 15 15:59 _singleHit2024-11-15T_141359Z.log
-rw-r--r-- 1 fermilab users   2859 Nov 15 15:59 jobscript.log
-rw-r--r-- 1 fermilab users   1297 Nov 15 15:13 file.list
-rw-r--r-- 1 fermilab users    835 Nov 15 15:13 all-input-dids.txt
-rw-r--r-- 1 fermilab users    834 Nov 15 15:13 did.list
-rw-r--r-- 1 fermilab users      1 Nov 15 15:59 justin-processed-pfns.txt