Jobsub ID 290649.156@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID	290649.156@justin-prod-sched01.dune.hep.ac.uk
Workflow ID	4108
Stage ID	1
User name	lavaut@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2024-11-15 14:24:33
Site	ES_PIC
Entry	DUNE_T1_ES_PIC_ce13-multicore
Last heartbeat	2024-11-15 14:58:15
From worker node	Hostname	tdm003.pic.es
	cpuinfo	AMD EPYC 7662 64-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	4194304000 (4000 MiB)
	Wall seconds limit	216000 (60 hours)
	Inner Apptainer?	True
Job state	outputting_failed
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2024-11-15 14:26:23
Input files	hd-protodune-det-reco:np04hd_raw_run029186_0076_dataflow3_datawriter_0_20240914T135035_reco_stage1_reco_stage2_20240916T144735_keepup.root hd-protodune-det-reco:np04hd_raw_run029186_0437_dataflow0_datawriter_0_20240915T001434_reco_stage1_reco_stage2_20240916T154015_keepup.root hd-protodune-det-reco:np04hd_raw_run029186_0441_dataflow1_datawriter_0_20240915T002151_reco_stage1_reco_stage2_20240916T153020_keepup.root hd-protodune-det-reco:np04hd_raw_run029186_0646_dataflow0_datawriter_0_20240915T062237_reco_stage1_reco_stage2_20240916T152329_keepup.root hd-protodune-det-reco:np04hd_raw_run029186_0364_dataflow3_datawriter_0_20240914T215842_reco_stage1_reco_stage2_20240916T142602_keepup.root hd-protodune-det-reco:np04hd_raw_run029186_0662_dataflow5_datawriter_0_20240915T065117_reco_stage1_reco_stage2_20240916T145603_keepup.root hd-protodune-det-reco:np04hd_raw_run029186_0638_dataflow7_datawriter_0_20240915T060830_reco_stage1_reco_stage2_20240916T141213_keepup.root
Jobscript	Exit code	0
	Real time	31m (1895s)
	CPU time	29m (1760s = 92%)
Outputting started	2024-11-15 14:57:59
Output files
Finished	2024-11-15 14:58:15
List job events Wrapper job log

Jobscript log (last 10,000 characters)

No files available from this stage
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Could not get file
No files available from this stage
Input PFN = 
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
PRODUCTS: /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
DUNESW_DIR: 
DUNESW_DIR: /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/dunesw/v10_00_02d00
PROTODUNEANA_DIR: /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/protoduneana/v10_00_02d00
DUNEPROTOTYPES_DIR: /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/duneprototypes/v10_00_02d00

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v10_00_02d00
MRB_QUALS=prof:e26
MRB_TOP=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f
MRB_SOURCE=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/srcs
MRB_BUILDDIR=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/localProducts_larsoft_v10_00_02d00_prof_e26

PRODUCTS=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/localProducts_larsoft_v10_00_02d00_prof_e26:/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/localProducts_larsoft_v10_00_02d00_prof_e26

 VERSION ACTIVE =  VERSION ACTIVE =  VERSION ACTIVE = 
duneprototypes    v10_00_02d00    -f Linux64bit+3.10-2.17 -q e26:prof        -z /cvmfs/dune.opensciencegrid.org/products/dune
dunesw            v10_00_02d00    -f Linux64bit+3.10-2.17 -q e26:prof        -z /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/localProducts_larsoft_v10_00_02d00_prof_e26
local product directory is /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/b45eb38553651f97b6c3d6135486f05ed5eb726f/localProducts_larsoft_v10_00_02d00_prof_e26
----------- this block should be empty ------------------
---------------------------------------------------------
lar exit code 0
.:
total 1060
-rw-r--r-- 1 dune001 dune 831994 Nov 15 15:57 _singleHit_2024-11-15T_142631Z.root
-rw-r--r-- 1 dune001 dune 151552 Nov 15 15:57 mem.db
-rw-r--r-- 1 dune001 dune  45056 Nov 15 15:57 time.db
-rw-r--r-- 1 dune001 dune  19436 Nov 15 15:57 _singleHit2024-11-15T_142631Z.log
-rw-r--r-- 1 dune001 dune   2805 Nov 15 15:57 jobscript.log
-rw-r--r-- 1 dune001 dune   1460 Nov 15 15:26 file.list
-rw-r--r-- 1 dune001 dune    974 Nov 15 15:26 all-input-dids.txt
-rw-r--r-- 1 dune001 dune    973 Nov 15 15:26 did.list
-rw-r--r-- 1 dune001 dune      1 Nov 15 15:57 justin-processed-pfns.txt