Jobsub ID 97994.2@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID	97994.2@justin-prod-sched02.dune.hep.ac.uk
Workflow ID	4109
Stage ID	1
User name	lavaut@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2024-11-15 14:42:19
Site	CZ_FZU
Entry	Nova_CZ_FZU_osgce2
Last heartbeat	2024-11-15 15:28:53
From worker node	Hostname	mff2104.farm.particle.cz
	cpuinfo	AMD EPYC 7352 24-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	172800 (48 hours)
	Inner Apptainer?	True
Job state	outputting_failed
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2024-11-15 14:43:00
Input files	hd-protodune-det-reco:np04hd_raw_run028850_0077_dataflow7_datawriter_0_20240822T131217_reco_stage1_reco_stage2_20240822T145907_keepup.root hd-protodune-det-reco:np04hd_raw_run028850_0047_dataflow1_datawriter_0_20240822T125807_reco_stage1_reco_stage2_20240822T152045_keepup.root hd-protodune-det-reco:np04hd_raw_run028850_0062_dataflow1_datawriter_0_20240822T130508_reco_stage1_reco_stage2_20240822T152349_keepup.root hd-protodune-det-reco:np04hd_raw_run028850_0054_dataflow2_datawriter_0_20240822T130121_reco_stage1_reco_stage2_20240822T153008_keepup.root hd-protodune-det-reco:np04hd_raw_run028850_0070_dataflow1_datawriter_0_20240822T130901_reco_stage1_reco_stage2_20240822T152858_keepup.root hd-protodune-det-reco:np04hd_raw_run028850_0022_dataflow6_datawriter_0_20240822T124604_reco_stage1_reco_stage2_20240822T152939_keepup.root hd-protodune-det-reco:np04hd_raw_run028850_0018_dataflow0_datawriter_0_20240822T124413_reco_stage1_reco_stage2_20240822T153108_keepup.root hd-protodune-det-reco:np04hd_raw_run028850_0082_dataflow7_datawriter_0_20240822T131443_reco_stage1_reco_stage2_20240822T153203_keepup.root
Jobscript	Exit code	1
	Real time	0m (0s)
	CPU time	0m (0s = 0%)
Outputting started
Output files
Finished	2024-11-15 15:28:53
List job events Wrapper job log

Jobscript log (last 10,000 characters)

No files available from this stage
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Input PFN = 
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
PRODUCTS: /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
DUNESW_DIR: 
DUNESW_DIR: /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/dunesw/v10_00_02d00
PROTODUNEANA_DIR: /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/protoduneana/v10_00_02d00
DUNEPROTOTYPES_DIR: /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/duneprototypes/v10_00_02d00

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v10_00_02d00
MRB_QUALS=prof:e26
MRB_TOP=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f
MRB_SOURCE=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/srcs
MRB_BUILDDIR=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/localProducts_larsoft_v10_00_02d00_prof_e26

PRODUCTS=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/localProducts_larsoft_v10_00_02d00_prof_e26:/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/localProducts_larsoft_v10_00_02d00_prof_e26

 VERSION ACTIVE =  VERSION ACTIVE =  VERSION ACTIVE = 
duneprototypes    v10_00_02d00    -f Linux64bit+3.10-2.17 -q e26:prof        -z /cvmfs/dune.opensciencegrid.org/products/dune
dunesw            v10_00_02d00    -f Linux64bit+3.10-2.17 -q e26:prof        -z /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/localProducts_larsoft_v10_00_02d00_prof_e26
local product directory is /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/localProducts_larsoft_v10_00_02d00_prof_e26
----------- this block should be empty ------------------
---------------------------------------------------------
lar exit code 1
.:
total 584
-rw-r--r-- 1 fermilab users 431143 Nov 15 16:28 _singleHit_2024-11-15T_144309Z.root
-rw-r--r-- 1 fermilab users  94208 Nov 15 16:28 mem.db
-rw-r--r-- 1 fermilab users  24576 Nov 15 16:28 time.db
-rw-r--r-- 1 fermilab users  17933 Nov 15 16:28 _singleHit2024-11-15T_144309Z.log
-rw-r--r-- 1 fermilab users   2751 Nov 15 16:28 jobscript.log
-rw-r--r-- 1 fermilab users   1678 Nov 15 15:43 file.list
-rw-r--r-- 1 fermilab users   1113 Nov 15 15:43 all-input-dids.txt
-rw-r--r-- 1 fermilab users   1112 Nov 15 15:43 did.list
-rw-r--r-- 1 fermilab users      1 Nov 15 16:28 justin-processed-pfns.txt