Jobsub ID 105737.2@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 105737.2@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 4188 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| RSS bytes | 2096103424 (1999 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2024-11-21 09:03:09 | |
| Site | CERN | |
| Entry | CMSHTPC_T2_CH_CERN_ce503 | |
| Last heartbeat | 2024-11-21 10:47:30 | |
| From worker node | Hostname | b9p10p3694.cern.ch |
| cpuinfo | AMD EPYC 7543 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 2096103424 (1999 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| Inner Apptainer? | True | |
| Job state | outputting_failed | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2024-11-21 09:03:52 | |
| Input files | hd-protodune:np04hd_raw_run028085_0014_dataflow3_datawriter_0_20240720T194316.hdf5 hd-protodune:np04hd_raw_run028085_0015_dataflow4_datawriter_0_20240720T194359.hdf5 hd-protodune:np04hd_raw_run028085_0014_dataflow1_datawriter_0_20240720T194303.hdf5 hd-protodune:np04hd_raw_run028085_0015_dataflow7_datawriter_0_20240720T194359.hdf5 hd-protodune:np04hd_raw_run028085_0015_dataflow3_datawriter_0_20240720T194359.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 1h (6176s) | |
| CPU time | 0m (41s = 0%) | |
| Outputting started | 2024-11-21 10:46:49 | |
| Output files | ||
| Finished | 2024-11-21 10:47:30 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
larsoft.opensciencegrid.org/products/g4particlexs/v2_1/G4NDL4.6 XERCES_C_VERSION=v3_2_3e GEANT4_FQ_DIR=/cvmfs/larsoft.opensciencegrid.org/products/geant4/v4_10_6_p01g/Linux64bit+3.10-2.17-e26-prof CETLIB_EXCEPT_DIR=/cvmfs/larsoft.opensciencegrid.org/products/cetlib_except/v1_09_01 CATCH_FQ=Linux64bit+3.10-2.17-e26 LIBXML2_VERSION=v2_9_12 MRB_FQ_DIR=/cvmfs/larsoft.opensciencegrid.org/products/mrb/v6_09_07/slf7.x86_64 SETUP_MRB=mrb v6_09_07 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products JUSTIN_RSS_MIB=1999 VALGRIND_INC=/cvmfs/larsoft.opensciencegrid.org/products/valgrind/v3_17_0/Linux64bit+3.10-2.17/include LARSOFTOBJ_LIB=/cvmfs/larsoft.opensciencegrid.org/products/larsoftobj/v10_00_00/slf7.x86_64.e26.prof/lib BXDECAY0_DIR=/cvmfs/larsoft.opensciencegrid.org/products/bxdecay0/v1_1_0 DELAUNATOR_VERSION=v1_0_0 NUEVDB_DIR=/cvmfs/larsoft.opensciencegrid.org/products/nuevdb/v1_09_08 LARANA_INC=/cvmfs/larsoft.opensciencegrid.org/products/larana/v10_00_03/include SETUP_RSTARTREE=rstartree v2016_07 -f NULL -z /cvmfs/larsoft.opensciencegrid.org/products IFDHC_LIB=/cvmfs/larsoft.opensciencegrid.org/products/ifdhc/v2_7_2/Linux64bit+3.10-2.17-e26-p3915-prof/lib GENIE=/cvmfs/larsoft.opensciencegrid.org/products/genie/v3_04_02/Linux64bit+3.10-2.17-e26-prof/GENIE-Generator LHAPDF_VERSION=v6_5_4 LARDATA_INC=/cvmfs/larsoft.opensciencegrid.org/products/lardata/v10_00_01/include LARDATAALG_INC=/cvmfs/larsoft.opensciencegrid.org/products/lardataalg/v10_00_00/include SETUP_LARCOREALG=larcorealg v10_00_00 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof SETUP_G4TENDL=g4tendl v1_3_2 -f NULL -z /cvmfs/larsoft.opensciencegrid.org/products CATCH_VERSION=v3_3_2 CLHEP_LIB=CLHEP-2.4.7.1 SETUP_POSTGRESQL=postgresql v15_3 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q p3915 SQLITE_FQ=Linux64bit+3.10-2.17 PROTOBUF_VERSION=v3_21_12a GMP_DIR=/cvmfs/larsoft.opensciencegrid.org/products/gmp/v6_2_1 PRODUCTS=/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/ GENIE_XSEC_TUNE=AR23_20i_00_000 SETUP_DUNECALIB=dunecalib v10_01_01d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof CRYDATAPATH=/cvmfs/larsoft.opensciencegrid.org/products/cry/v1_7q/Linux64bit+3.10-2.17-e26-prof/cry_v1.7/data LHAPDF_LIB=/cvmfs/larsoft.opensciencegrid.org/products/lhapdf/v6_5_4/Linux64bit+3.10-2.17-e26-p3915-prof/lib G4INCLDATA=/cvmfs/larsoft.opensciencegrid.org/products/g4incl/v1_0/G4INCL1.0 HEP_CONCURRENCY_FQ_DIR=/cvmfs/larsoft.opensciencegrid.org/products/hep_concurrency/v1_09_02/slf7.x86_64.e26.prof CETLIB_DIR=/cvmfs/larsoft.opensciencegrid.org/products/cetlib/v3_18_02 CATCH_LIB=/cvmfs/larsoft.opensciencegrid.org/products/catch/v3_3_2/Linux64bit+3.10-2.17-e26/lib SETUP_SCITOKENS_CPP=scitokens_cpp v1_0_1a -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:sql34001 PROTOBUF_LIB=/cvmfs/larsoft.opensciencegrid.org/products/protobuf/v3_21_12a/Linux64bit+3.10-2.17-e26/lib ROOT_INC=/cvmfs/larsoft.opensciencegrid.org/products/root/v6_28_12/Linux64bit+3.10-2.17-e26-p3915-prof/include HUB_DIR=/cvmfs/larsoft.opensciencegrid.org/products/hub/v2_14_2 GEANT4REWEIGHT_DIR=/cvmfs/larsoft.opensciencegrid.org/products/geant4reweight/v01_20_08 DUNERECO_VERSION=v10_01_01d00 LARPANDORA_LIB=/cvmfs/larsoft.opensciencegrid.org/products/larpandora/v10_00_05/slf7.x86_64.e26.prof/lib IFDH_ART_INC=/cvmfs/larsoft.opensciencegrid.org/products/ifdh_art/v2_17_07/slf7.x86_64.e26.prof/inc MARLEY_LIB=/cvmfs/larsoft.opensciencegrid.org/products/marley/v1_2_1d/Linux64bit+3.10-2.17-e26-prof/lib SETUP_LAREVT=larevt v10_00_01 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof HDF5_INC=/cvmfs/larsoft.opensciencegrid.org/products/hdf5/v1_12_2a/Linux64bit+3.10-2.17-e26-prof/include SETUP_CANVAS=canvas v3_16_04 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof DUNEDETDATAFORMATS_INC=/cvmfs/dune.opensciencegrid.org/products/dune/dunedetdataformats/v4_4_4/include SETUP_TBB=tbb v2021_9_0 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26 PYTHIA_INC=/cvmfs/larsoft.opensciencegrid.org/products/pythia/v6_4_28x/Linux64bit+3.10-2.17-e26-prof/include SETUP_DUNESW=dunesw v10_01_01d00 -f Linux64bit+3.10-2.17 -z /cvmfs/dune.opensciencegrid.org/products/dune -q e26:prof PERL_MM_OPT=INSTALL_BASE=/cvmfs/larsoft.opensciencegrid.org/products/mrb/v6_09_07/slf7.x86_64/CPAN GIT_EXEC_PATH=/cvmfs/larsoft.opensciencegrid.org/products/git/v2_45_1/Linux64bit+3.10-2.17/libexec/git-core PROTODUNEANA_INC=/cvmfs/dune.opensciencegrid.org/products/dune/protoduneana/v10_01_01d00/include DUNEDATAPREP_LIB=/cvmfs/dune.opensciencegrid.org/products/dune/dunedataprep/v10_01_01d00/slf7.x86_64.e26.prof/lib DUNERECO_DIR=/cvmfs/dune.opensciencegrid.org/products/dune/dunereco/v10_01_01d00 WIRECELL_LIB=/cvmfs/larsoft.opensciencegrid.org/products/wirecell/v0_29_1/Linux64bit+3.10-2.17-e26-prof/lib TRITON_INC=/cvmfs/larsoft.opensciencegrid.org/products/triton/v2_25_0d/Linux64bit+3.10-2.17-e26/include LIBJPEG_TURBO_INC=/cvmfs/larsoft.opensciencegrid.org/products/libjpeg_turbo/v2_1_0/Linux64bit+3.10-2.17/include LAREVENTDISPLAY_LIB=/cvmfs/larsoft.opensciencegrid.org/products/lareventdisplay/v10_00_03/slf7.x86_64.e26.prof/lib PPFX_VERSION=v02_20_04 NUG4_VERSION=v1_16_06 SETUP_LARDATAALG=lardataalg v10_00_00 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof LARCOREALG_INC=/cvmfs/larsoft.opensciencegrid.org/products/larcorealg/v10_00_00/include G4PARTICLEHPDATA=/cvmfs/larsoft.opensciencegrid.org/products/g4tendl/v1_3_2/G4TENDL1.3.2 SETUP_LARANA=larana v10_00_03 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof SETUP_LARSOFT=larsoft v10_01_01 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof SETUP_CETLIB=cetlib v3_18_02 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof SETUP_FHICLCPP=fhiclcpp v4_18_04 -f Linux64bit+3.10-2.17 -z /cvmfs/larsoft.opensciencegrid.org/products -q e26:prof OPENBLAS_INC=/cvmfs/larsoft.opensciencegrid.org/products/openblas/v0_3_23/Linux64bit+3.10-2.17-e26/include PYTHON_INCLUDE=/cvmfs/larsoft.opensciencegrid.org/products/python/v3_9_15/Linux64bit+3.10-2.17/include/python3.9 _=/usr/bin/env Justin specific env vars JUSTIN_SCOPE=usertests JUSTIN_WALL_SECONDS=80000 JUSTIN_ALLOCATOR=https://justin-allocator-pro.dune.hep.ac.uk/api/allocator/ JUSTIN_SITE_NAME=CERN JUSTIN_SAM_WEB_URI=https://justin.dune.hep.ac.uk/api/samweb/105737.2@justin-prod-sched02.dune.hep.ac.uk/Q6Qexg6In5Dt7dPGSE7yxPEPEUxsyVSEBoqQjDjHPeEXH5MYeFzrHUdAnSdowtRVgCb57peifAx-7K4CDieyCA JUSTIN_PROCESSORS=1 JUSTIN_JOBSCRIPT_SECRET=Q6Qexg6In5Dt7dPGSE7yxPEPEUxsyVSEBoqQjDjHPeEXH5MYeFzrHUdAnSdowtRVgCb57peifAx-7K4CDieyCA JUSTIN_PATH=/home JUSTIN_TIMESTAMP=1732179832 JUSTIN_JOBSUB_ID=105737.2@justin-prod-sched02.dune.hep.ac.uk JUSTIN_WORKFLOW_ID=4188 JUSTIN_STAGE_ID=1 JUSTIN_RSS_MIB=1999 Will use justin-get-file Return code 0 Stdout b'hd-protodune:np04hd_raw_run028085_0014_dataflow3_datawriter_0_20240720T194316.hdf5 root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/hd-protodune/2b/b5/np04hd_raw_run028085_0014_dataflow3_datawriter_0_20240720T194316.hdf5 DUNE_ES_PIC' Stderr b'' Return code 0 Stdout b'hd-protodune:np04hd_raw_run028085_0015_dataflow4_datawriter_0_20240720T194359.hdf5 root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/hd-protodune/88/ad/np04hd_raw_run028085_0015_dataflow4_datawriter_0_20240720T194359.hdf5 DUNE_ES_PIC' Stderr b'' Return code 0 Stdout b'hd-protodune:np04hd_raw_run028085_0014_dataflow1_datawriter_0_20240720T194303.hdf5 root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/hd-protodune/b2/14/np04hd_raw_run028085_0014_dataflow1_datawriter_0_20240720T194303.hdf5 DUNE_ES_PIC' Stderr b'' Return code 0 Stdout b'hd-protodune:np04hd_raw_run028085_0015_dataflow7_datawriter_0_20240720T194359.hdf5 root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/hd-protodune/22/b4/np04hd_raw_run028085_0015_dataflow7_datawriter_0_20240720T194359.hdf5 DUNE_ES_PIC' Stderr b'' Return code 0 Stdout b'hd-protodune:np04hd_raw_run028085_0015_dataflow3_datawriter_0_20240720T194359.hdf5 root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/hd-protodune/05/fb/np04hd_raw_run028085_0015_dataflow3_datawriter_0_20240720T194359.hdf5 DUNE_ES_PIC' Stderr b'' root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/hd-protodune/2b/b5/np04hd_raw_run028085_0014_dataflow3_datawriter_0_20240720T194316.hdf5 root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/hd-protodune/88/ad/np04hd_raw_run028085_0015_dataflow4_datawriter_0_20240720T194359.hdf5 root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/hd-protodune/b2/14/np04hd_raw_run028085_0014_dataflow1_datawriter_0_20240720T194303.hdf5 root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/hd-protodune/22/b4/np04hd_raw_run028085_0015_dataflow7_datawriter_0_20240720T194359.hdf5 root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/hd-protodune/05/fb/np04hd_raw_run028085_0015_dataflow3_datawriter_0_20240720T194359.hdf5 Files retrieved: 5 PFN list: root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/hd-protodune/2b/b5/np04hd_raw_run028085_0014_dataflow3_datawriter_0_20240720T194316.hdf5 root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/hd-protodune/88/ad/np04hd_raw_run028085_0015_dataflow4_datawriter_0_20240720T194359.hdf5 root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/hd-protodune/b2/14/np04hd_raw_run028085_0014_dataflow1_datawriter_0_20240720T194303.hdf5 root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/hd-protodune/22/b4/np04hd_raw_run028085_0015_dataflow7_datawriter_0_20240720T194359.hdf5 root://xrootd.pic.es:1094/pnfs/pic.es/data/dune/RSE/hd-protodune/05/fb/np04hd_raw_run028085_0015_dataflow3_datawriter_0_20240720T194359.hdf5 Running pdspana Ran successfully formed