Jobsub ID 76292.17@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 76292.17@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3351 |
| Stage ID | 1 |
| User name | lavaut@fnal.gov |
| HTCondor Group | group_dune |
| Requested | Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2024-09-23 16:41:29 |
| Site | US_NotreDame |
| Entry | CMSHTPC_T3_US_NotreDame_deepthought |
| Last heartbeat | 2024-09-23 17:19:05 |
| From worker node | Hostname | d12chas567.crc.nd.edu |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4194304000 (4000 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-23 17:17:57 |
| Input files | vd-protodune:prod_cosmics_protodunevd_20240418T061242Z_000409_gen_g4_stage1_g4_stage2_detsim_reco.root
|
| Jobscript | Exit code | 137 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-23 17:19:05 |
| Saved logs | justin-logs:76292.17-justin-prod-sched02.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
Input PFN = root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/vd-protodune/5e/8f/prod_cosmics_protodunevd_20240418T061242Z_000409_gen_g4_stage1_g4_stage2_detsim_reco.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
PRODUCTS: /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/fce81791ed400b772709387022918166c3fc6e61:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
DUNESW_DIR:
DUNESW_DIR: /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/fce81791ed400b772709387022918166c3fc6e61/dunesw/v09_91_00d00
PROTODUNEANA_DIR: /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/fce81791ed400b772709387022918166c3fc6e61/protoduneana/v09_91_00d00
DUNEPROTOTYPES_DIR: /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/fce81791ed400b772709387022918166c3fc6e61/duneprototypes/v09_91_00d00
MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v09_91_00d00
MRB_QUALS=prof:e26
MRB_TOP=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/fce81791ed400b772709387022918166c3fc6e61
MRB_SOURCE=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/fce81791ed400b772709387022918166c3fc6e61/srcs
MRB_BUILDDIR=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/fce81791ed400b772709387022918166c3fc6e61/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/fce81791ed400b772709387022918166c3fc6e61/localProducts_larsoft_v09_91_00d00_prof_e26
PRODUCTS=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/fce81791ed400b772709387022918166c3fc6e61/localProducts_larsoft_v09_91_00d00_prof_e26:/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/fce81791ed400b772709387022918166c3fc6e61:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/fce81791ed400b772709387022918166c3fc6e61/localProducts_larsoft_v09_91_00d00_prof_e26
VERSION ACTIVE = VERSION ACTIVE = VERSION ACTIVE =
duneprototypes v09_91_00d00 -f Linux64bit+3.10-2.17 -q e26:prof -z /cvmfs/dune.opensciencegrid.org/products/dune
dunesw v09_91_00d00 -f Linux64bit+5.14-2.17 -q e26:prof -z /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/fce81791ed400b772709387022918166c3fc6e61/localProducts_larsoft_v09_91_00d00_prof_e26
local product directory is /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/fce81791ed400b772709387022918166c3fc6e61/localProducts_larsoft_v09_91_00d00_prof_e26
----------- this block should be empty ------------------
---------------------------------------------------------
../justin-jobscript: line 108: 1525 Killed ( lar -c ${INPUT_TAR_DIR_LOCAL}/myfcl/$FCL_FILE $events_option -T $outFile "$pfn" > ${fname}_singleHit${now}.log 2>&1 )
lar exit code 137
.:
total 68
-rw-r--r-- 1 dune osgusers 28672 Sep 23 13:18 mem.db
-rw-r--r-- 1 dune osgusers 16384 Sep 23 13:18 time.db
-rw-r--r-- 1 dune osgusers 4717 Sep 23 13:18 prod_cosmics_protodunevd_20240418T061242Z_000409_gen_g4_stage1_g4_stage2_detsim_reco_singleHit2024-09-23T_171801Z.log
-rw-r--r-- 1 dune osgusers 2969 Sep 23 13:18 jobscript.log
-rw-r--r-- 1 dune osgusers 398 Sep 23 13:18 TFileService-56b0-f788-6d48-3e08.root
-rw-r--r-- 1 dune osgusers 206 Sep 23 13:17 all-input-dids.txt
-rw-r--r-- 1 dune osgusers 179 Sep 23 13:18 justin-processed-pfns.txt 