Jobsub ID 76422.12@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 76422.12@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3354 |
| Stage ID | 1 |
| User name | lavaut@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2024-09-23 21:04:48 |
| Site | US_NotreDame |
| Entry | CMSHTPC_T3_US_NotreDame_deepthought |
| Last heartbeat | 2024-09-23 21:17:54 |
| From worker node | Hostname | d12chas567.crc.nd.edu |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-23 21:06:56 |
| Input files | vd-protodune:prod_cosmics_protodunevd_20240420T064820Z_000119_gen_g4_stage1_g4_stage2_detsim_reco.root
|
| Jobscript | Exit code | 137 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-23 21:17:54 |
| Saved logs | justin-logs:76422.12-justin-prod-sched02.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
Input PFN = root://dcdndoor.sdcc.bnl.gov:1094//pnfs/sdcc.bnl.gov/data/dune/RSE/vd-protodune/4c/a3/prod_cosmics_protodunevd_20240420T064820Z_000119_gen_g4_stage1_g4_stage2_detsim_reco.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
PRODUCTS: /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ed56c5aa6c5a4bd564439c6c69e5094508bf46a1:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
DUNESW_DIR:
DUNESW_DIR: /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ed56c5aa6c5a4bd564439c6c69e5094508bf46a1/dunesw/v09_91_00d00
PROTODUNEANA_DIR: /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ed56c5aa6c5a4bd564439c6c69e5094508bf46a1/protoduneana/v09_91_00d00
DUNEPROTOTYPES_DIR: /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ed56c5aa6c5a4bd564439c6c69e5094508bf46a1/duneprototypes/v09_91_00d00
MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v09_91_00d00
MRB_QUALS=prof:e26
MRB_TOP=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ed56c5aa6c5a4bd564439c6c69e5094508bf46a1
MRB_SOURCE=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ed56c5aa6c5a4bd564439c6c69e5094508bf46a1/srcs
MRB_BUILDDIR=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ed56c5aa6c5a4bd564439c6c69e5094508bf46a1/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ed56c5aa6c5a4bd564439c6c69e5094508bf46a1/localProducts_larsoft_v09_91_00d00_prof_e26
PRODUCTS=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ed56c5aa6c5a4bd564439c6c69e5094508bf46a1/localProducts_larsoft_v09_91_00d00_prof_e26:/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ed56c5aa6c5a4bd564439c6c69e5094508bf46a1:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ed56c5aa6c5a4bd564439c6c69e5094508bf46a1/localProducts_larsoft_v09_91_00d00_prof_e26
VERSION ACTIVE = VERSION ACTIVE = VERSION ACTIVE =
duneprototypes v09_91_00d00 -f Linux64bit+3.10-2.17 -q e26:prof -z /cvmfs/dune.opensciencegrid.org/products/dune
dunesw v09_91_00d00 -f Linux64bit+5.14-2.17 -q e26:prof -z /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ed56c5aa6c5a4bd564439c6c69e5094508bf46a1/localProducts_larsoft_v09_91_00d00_prof_e26
local product directory is /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ed56c5aa6c5a4bd564439c6c69e5094508bf46a1/localProducts_larsoft_v09_91_00d00_prof_e26
----------- this block should be empty ------------------
---------------------------------------------------------
../justin-jobscript: line 108: 1525 Killed ( lar -c ${INPUT_TAR_DIR_LOCAL}/myfcl/$FCL_FILE $events_option -T $outFile "$pfn" > ${fname}_singleHit${now}.log 2>&1 )
lar exit code 137
.:
total 2788
-rw-r--r-- 1 dune osgusers 2785285 Sep 23 17:17 TFileService-ccff-5173-0100-3bd0.root
-rw-r--r-- 1 dune osgusers 28672 Sep 23 17:15 mem.db
-rw-r--r-- 1 dune osgusers 16384 Sep 23 17:15 time.db
-rw-r--r-- 1 dune osgusers 6836 Sep 23 17:17 prod_cosmics_protodunevd_20240420T064820Z_000119_gen_g4_stage1_g4_stage2_detsim_reco_singleHit2024-09-23T_210707Z.log
-rw-r--r-- 1 dune osgusers 2966 Sep 23 17:17 jobscript.log
-rw-r--r-- 1 dune osgusers 206 Sep 23 17:07 all-input-dids.txt
-rw-r--r-- 1 dune osgusers 176 Sep 23 17:17 justin-processed-pfns.txt 