justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 301218.10@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID301218.10@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4201
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes2096103424 (1999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-22 17:02:17
SiteCA_SFU
EntryDUNE_CA_SFU_lcg-ce3
Last heartbeat2024-11-23 00:12:16
From worker nodeHostnamecdr2.int.cedar.computecanada.ca
cpuinfoIntel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2096103424 (1999 MiB)
Wall seconds limit84598 (23 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-22 17:22:20
Input fileshd-protodune:np04hd_raw_run028023_0337_dataflow1_datawriter_0_20240716T204752.hdf5
hd-protodune:np04hd_raw_run028023_0359_dataflow7_datawriter_0_20240716T210102.hdf5
hd-protodune:np04hd_raw_run028023_0334_dataflow4_datawriter_0_20240716T204612.hdf5
hd-protodune:np04hd_raw_run028023_0336_dataflow7_datawriter_0_20240716T204724.hdf5
hd-protodune:np04hd_raw_run028023_0334_dataflow2_datawriter_0_20240716T204612.hdf5
JobscriptExit code0
Real time6h (24189s)
CPU time0m (39s = 0%)
Outputting started2024-11-23 00:05:30
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/beamevent/112024/neg1/04201/1/np04hd_raw_run028023_0334_dataflow2_datawriter_0_20240716T204612_beam.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/beamevent/112024/neg1/04201/1/beamana_301218_10_1_4201_20241122T172228Z.root
Finished2024-11-23 00:12:16
Saved logsjustin-logs:301218.10-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ucts/cetlib_except/v1_09_01
CATCH_FQ=Linux64bit+3.10-2.17-e26
LIBXML2_VERSION=v2_9_12
MRB_FQ_DIR=/cvmfs/larsoft.opensciencegrid.org/products/mrb/v6_09_07/slf7.x86_64
SETUP_MRB=mrb v6_09_07 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products
JUSTIN_RSS_MIB=1999
VALGRIND_INC=/cvmfs/larsoft.opensciencegrid.org/products/valgrind/v3_17_0/Linux64bit+3.10-2.17/include
LARSOFTOBJ_LIB=/cvmfs/larsoft.opensciencegrid.org/products/larsoftobj/v10_00_00/slf7.x86_64.e26.prof/lib
BXDECAY0_DIR=/cvmfs/larsoft.opensciencegrid.org/products/bxdecay0/v1_1_0
DELAUNATOR_VERSION=v1_0_0
NUEVDB_DIR=/cvmfs/larsoft.opensciencegrid.org/products/nuevdb/v1_09_08
LARANA_INC=/cvmfs/larsoft.opensciencegrid.org/products/larana/v10_00_03/include
SETUP_RSTARTREE=rstartree v2016_07 -f NULL -z /cvmfs/larsoft.opensciencegrid.org/products
IFDHC_LIB=/cvmfs/larsoft.opensciencegrid.org/products/ifdhc/v2_7_2/Linux64bit+3.10-2.17-e26-p3915-prof/lib
GENIE=/cvmfs/larsoft.opensciencegrid.org/products/genie/v3_04_02/Linux64bit+3.10-2.17-e26-prof/GENIE-Generator
LHAPDF_VERSION=v6_5_4
LARDATA_INC=/cvmfs/larsoft.opensciencegrid.org/products/lardata/v10_00_01/include
LARDATAALG_INC=/cvmfs/larsoft.opensciencegrid.org/products/lardataalg/v10_00_00/include
SETUP_LARCOREALG=larcorealg v10_00_00 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
SETUP_G4TENDL=g4tendl v1_3_2 -f NULL -z /cvmfs/larsoft.opensciencegrid.org/products
CATCH_VERSION=v3_3_2
CLHEP_LIB=CLHEP-2.4.7.1
SETUP_POSTGRESQL=postgresql v15_3 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q p3915
SQLITE_FQ=Linux64bit+3.10-2.17
PROTOBUF_VERSION=v3_21_12a
GMP_DIR=/cvmfs/larsoft.opensciencegrid.org/products/gmp/v6_2_1
PRODUCTS=/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
GENIE_XSEC_TUNE=AR23_20i_00_000
SETUP_DUNECALIB=dunecalib v10_01_01d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
CRYDATAPATH=/cvmfs/larsoft.opensciencegrid.org/products/cry/v1_7q/Linux64bit+3.10-2.17-e26-prof/cry_v1.7/data
LHAPDF_LIB=/cvmfs/larsoft.opensciencegrid.org/products/lhapdf/v6_5_4/Linux64bit+3.10-2.17-e26-p3915-prof/lib
G4INCLDATA=/cvmfs/larsoft.opensciencegrid.org/products/g4incl/v1_0/G4INCL1.0
HEP_CONCURRENCY_FQ_DIR=/cvmfs/larsoft.opensciencegrid.org/products/hep_concurrency/v1_09_02/slf7.x86_64.e26.prof
CETLIB_DIR=/cvmfs/larsoft.opensciencegrid.org/products/cetlib/v3_18_02
CATCH_LIB=/cvmfs/larsoft.opensciencegrid.org/products/catch/v3_3_2/Linux64bit+3.10-2.17-e26/lib
SETUP_SCITOKENS_CPP=scitokens_cpp v1_0_1a -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:sql34001
PROTOBUF_LIB=/cvmfs/larsoft.opensciencegrid.org/products/protobuf/v3_21_12a/Linux64bit+3.10-2.17-e26/lib
ROOT_INC=/cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/include
HUB_DIR=/cvmfs/larsoft.opensciencegrid.org/products/hub/v2_14_2
GEANT4REWEIGHT_DIR=/cvmfs/larsoft.opensciencegrid.org/products/geant4reweight/v01_20_08
DUNERECO_VERSION=v10_01_01d00
LARPANDORA_LIB=/cvmfs/larsoft.opensciencegrid.org/products/larpandora/v10_00_05/slf7.x86_64.e26.prof/lib
IFDH_ART_INC=/cvmfs/larsoft.opensciencegrid.org/products/ifdh_art/v2_17_07/slf7.x86_64.e26.prof/inc
MARLEY_LIB=/cvmfs/larsoft.opensciencegrid.org/products/marley/v1_2_1d/Linux64bit+3.10-2.17-e26-prof/lib
SETUP_LAREVT=larevt v10_00_01 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
HDF5_INC=/cvmfs/larsoft.opensciencegrid.org/products/hdf5/v1_12_2a/Linux64bit+3.10-2.17-e26-prof/include
SETUP_CANVAS=canvas v3_16_04 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
DUNEDETDATAFORMATS_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunedetdataformats/v4_4_4/include
SETUP_TBB=tbb v2021_9_0 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26
PYTHIA_INC=/cvmfs/larsoft.opensciencegrid.org/products/pythia/v6_4_28x/Linux64bit+3.10-2.17-e26-prof/include
SETUP_DUNESW=dunesw v10_01_01d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof
PERL_MM_OPT=INSTALL_BASE=/cvmfs/larsoft.opensciencegrid.org/products/mrb/v6_09_07/slf7.x86_64/CPAN
GIT_EXEC_PATH=/cvmfs/larsoft.opensciencegrid.org/products/git/v2_45_1/Linux64bit+3.10-2.17/libexec/git-core
PROTODUNEANA_INC=/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_01_01d00/include
DUNEDATAPREP_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v10_01_01d00/slf7.x86_64.e26.prof/lib
DUNERECO_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_01_01d00
WIRECELL_LIB=/cvmfs/larsoft.opensciencegrid.org/products/wirecell/v0_29_1/Linux64bit+3.10-2.17-e26-prof/lib
TRITON_INC=/cvmfs/larsoft.opensciencegrid.org/products/triton/v2_25_0d/Linux64bit+3.10-2.17-e26/include
LIBJPEG_TURBO_INC=/cvmfs/larsoft.opensciencegrid.org/products/libjpeg_turbo/v2_1_0/Linux64bit+3.10-2.17/include
LAREVENTDISPLAY_LIB=/cvmfs/larsoft.opensciencegrid.org/products/lareventdisplay/v10_00_03/slf7.x86_64.e26.prof/lib
PPFX_VERSION=v02_20_04
NUG4_VERSION=v1_16_06
SETUP_LARDATAALG=lardataalg v10_00_00 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
LARCOREALG_INC=/cvmfs/larsoft.opensciencegrid.org/products/larcorealg/v10_00_00/include
G4PARTICLEHPDATA=/cvmfs/larsoft.opensciencegrid.org/products/g4tendl/v1_3_2/G4TENDL1.3.2
SETUP_LARANA=larana v10_00_03 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
SETUP_LARSOFT=larsoft v10_01_01 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
SETUP_CETLIB=cetlib v3_18_02 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
SETUP_FHICLCPP=fhiclcpp v4_18_04 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof
OPENBLAS_INC=/cvmfs/larsoft.opensciencegrid.org/products/openblas/v0_3_23/Linux64bit+3.10-2.17-e26/include
PYTHON_INCLUDE=/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/include/python3.9
_=/usr/bin/env
Justin specific env vars
JUSTIN_SCOPE=usertests
JUSTIN_WALL_SECONDS=80000
JUSTIN_ALLOCATOR=https://justin-allocator-pro.dune.hep.ac.uk/api/allocator/
JUSTIN_SITE_NAME=CA_SFU
JUSTIN_SAM_WEB_URI=https://justin.dune.hep.ac.uk/api/samweb/301218.10@justin-prod-sched01.dune.hep.ac.uk/0eravZmZW6n1wW0cYuRIergKUHetigfuhO4WBmlH698LrOealSHPvo23BDGUnRa3z6L9X4U6VlyLqsWKvXPdyA
JUSTIN_PROCESSORS=1
JUSTIN_JOBSCRIPT_SECRET=0eravZmZW6n1wW0cYuRIergKUHetigfuhO4WBmlH698LrOealSHPvo23BDGUnRa3z6L9X4U6VlyLqsWKvXPdyA
JUSTIN_PATH=/home
JUSTIN_TIMESTAMP=1732296140
JUSTIN_JOBSUB_ID=301218.10@justin-prod-sched01.dune.hep.ac.uk
JUSTIN_WORKFLOW_ID=4201
JUSTIN_STAGE_ID=1
JUSTIN_RSS_MIB=1999
Will use justin-get-file
Return code 0
Stdout b'hd-protodune:np04hd_raw_run028023_0337_dataflow1_datawriter_0_20240716T204752.hdf5 root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/hd-protodune/2f/a6/np04hd_raw_run028023_0337_dataflow1_datawriter_0_20240716T204752.hdf5 DUNE_US_BNL_SDCC'
Stderr b''
Return code 0
Stdout b'hd-protodune:np04hd_raw_run028023_0359_dataflow7_datawriter_0_20240716T210102.hdf5 root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/hd-protodune/a8/60/np04hd_raw_run028023_0359_dataflow7_datawriter_0_20240716T210102.hdf5 DUNE_US_BNL_SDCC'
Stderr b''
Return code 0
Stdout b'hd-protodune:np04hd_raw_run028023_0334_dataflow4_datawriter_0_20240716T204612.hdf5 root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/hd-protodune/22/94/np04hd_raw_run028023_0334_dataflow4_datawriter_0_20240716T204612.hdf5 DUNE_US_BNL_SDCC'
Stderr b''
Return code 0
Stdout b'hd-protodune:np04hd_raw_run028023_0336_dataflow7_datawriter_0_20240716T204724.hdf5 root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/hd-protodune/8e/f8/np04hd_raw_run028023_0336_dataflow7_datawriter_0_20240716T204724.hdf5 DUNE_US_BNL_SDCC'
Stderr b''
Return code 0
Stdout b'hd-protodune:np04hd_raw_run028023_0334_dataflow2_datawriter_0_20240716T204612.hdf5 root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/hd-protodune/cb/26/np04hd_raw_run028023_0334_dataflow2_datawriter_0_20240716T204612.hdf5 DUNE_US_BNL_SDCC'
Stderr b''
root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/hd-protodune/2f/a6/np04hd_raw_run028023_0337_dataflow1_datawriter_0_20240716T204752.hdf5 root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/hd-protodune/a8/60/np04hd_raw_run028023_0359_dataflow7_datawriter_0_20240716T210102.hdf5 root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/hd-protodune/22/94/np04hd_raw_run028023_0334_dataflow4_datawriter_0_20240716T204612.hdf5 root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/hd-protodune/8e/f8/np04hd_raw_run028023_0336_dataflow7_datawriter_0_20240716T204724.hdf5 root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/hd-protodune/cb/26/np04hd_raw_run028023_0334_dataflow2_datawriter_0_20240716T204612.hdf5
Files retrieved: 5
PFN list:
root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/hd-protodune/2f/a6/np04hd_raw_run028023_0337_dataflow1_datawriter_0_20240716T204752.hdf5 root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/hd-protodune/a8/60/np04hd_raw_run028023_0359_dataflow7_datawriter_0_20240716T210102.hdf5 root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/hd-protodune/22/94/np04hd_raw_run028023_0334_dataflow4_datawriter_0_20240716T204612.hdf5 root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/hd-protodune/8e/f8/np04hd_raw_run028023_0336_dataflow7_datawriter_0_20240716T204724.hdf5 root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/hd-protodune/cb/26/np04hd_raw_run028023_0334_dataflow2_datawriter_0_20240716T204612.hdf5
Running pdspana
Ran successfully
formed
justIN time: 2024-11-23 11:23:32 UTC       justIN version: 01.01.09