Jobsub ID 98027.1@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID	98027.1@justin-prod-sched02.dune.hep.ac.uk
Workflow ID	4107
Stage ID	1
User name	lavaut@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2024-11-15 15:04:50
Site	NL_SURFsara
Entry	DUNE_SurfSARA_arc03
Last heartbeat	2024-11-15 16:36:45
From worker node	Hostname	wn-ha-47.gina.surfsara.nl
	cpuinfo	AMD EPYC 7551 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	129600 (36 hours)
	Inner Apptainer?	True
Job state	outputting_failed
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2024-11-15 15:05:51
Input files	hd-protodune-det-reco:np04hd_raw_run029186_0060_dataflow3_datawriter_0_20240914T132240_reco_stage1_reco_stage2_20240916T141612_keepup.root hd-protodune-det-reco:np04hd_raw_run029186_0203_dataflow5_datawriter_0_20240914T172638_reco_stage1_reco_stage2_20240916T140223_keepup.root hd-protodune-det-reco:np04hd_raw_run029186_0709_dataflow4_datawriter_0_20240915T083155_reco_stage1_reco_stage2_20240916T144921_keepup.root hd-protodune-det-reco:np04hd_raw_run029186_0181_dataflow4_datawriter_0_20240914T165354_reco_stage1_reco_stage2_20240916T164721_keepup.root hd-protodune-det-reco:np04hd_raw_run029186_0515_dataflow3_datawriter_0_20240915T023033_reco_stage1_reco_stage2_20240916T163828_keepup.root hd-protodune-det-reco:np04hd_raw_run029186_0734_dataflow6_datawriter_0_20240915T092052_reco_stage1_reco_stage2_20240916T153323_keepup.root hd-protodune-det-reco:np04hd_raw_run029186_0127_dataflow5_datawriter_0_20240914T151924_reco_stage1_reco_stage2_20240916T150159_keepup.root hd-protodune-det-reco:np04hd_raw_run029186_0528_dataflow2_datawriter_0_20240915T025245_reco_stage1_reco_stage2_20240916T153840_keepup.root
Jobscript	Exit code	0
	Real time	1h (5434s)
	CPU time	1h (5386s = 99%)
Outputting started	2024-11-15 16:36:26
Output files
Finished	2024-11-15 16:36:45
List job events Wrapper job log

Jobscript log (last 10,000 characters)

No files available from this stage
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Input PFN = 
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
PRODUCTS: /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
DUNESW_DIR: 
DUNESW_DIR: /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/dunesw/v10_00_02d00
PROTODUNEANA_DIR: /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/protoduneana/v10_00_02d00
DUNEPROTOTYPES_DIR: /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/duneprototypes/v10_00_02d00

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v10_00_02d00
MRB_QUALS=prof:e26
MRB_TOP=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f
MRB_SOURCE=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/srcs
MRB_BUILDDIR=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/localProducts_larsoft_v10_00_02d00_prof_e26

PRODUCTS=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/localProducts_larsoft_v10_00_02d00_prof_e26:/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/localProducts_larsoft_v10_00_02d00_prof_e26

 VERSION ACTIVE =  VERSION ACTIVE =  VERSION ACTIVE = 
duneprototypes    v10_00_02d00    -f Linux64bit+3.10-2.17 -q e26:prof        -z /cvmfs/dune.opensciencegrid.org/products/dune
dunesw            v10_00_02d00    -f Linux64bit+3.10-2.17 -q e26:prof        -z /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/localProducts_larsoft_v10_00_02d00_prof_e26
local product directory is /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/localProducts_larsoft_v10_00_02d00_prof_e26
----------- this block should be empty ------------------
---------------------------------------------------------
lar exit code 0
.:
total 1172
-rw-r--r--. 1 dune003 dune 943316 Nov 15 17:36 _singleHit_2024-11-15T_150606Z.root
-rw-r--r--. 1 dune003 dune 167936 Nov 15 17:36 mem.db
-rw-r--r--. 1 dune003 dune  45056 Nov 15 17:36 time.db
-rw-r--r--. 1 dune003 dune  20017 Nov 15 17:36 _singleHit2024-11-15T_150606Z.log
-rw-r--r--. 1 dune003 dune   2751 Nov 15 17:36 jobscript.log
-rw-r--r--. 1 dune003 dune   1614 Nov 15 16:05 file.list
-rw-r--r--. 1 dune003 dune   1113 Nov 15 16:05 all-input-dids.txt
-rw-r--r--. 1 dune003 dune   1112 Nov 15 16:05 did.list
-rw-r--r--. 1 dune003 dune      1 Nov 15 17:36 justin-processed-pfns.txt