Jobsub ID 287847.165@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 287847.165@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 4057 |
| Stage ID | 1 |
| User name | epennacc@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 80000 (22 hours) |
| Submitted time | 2024-11-12 17:09:37 |
| Site | US_UChicago |
| Entry | Engage_US_MWT2_uct2_condce_mcore |
| Last heartbeat | 2024-11-12 17:31:23 |
| From worker node | Hostname | uct2-c651.mwt2.org |
| cpuinfo | AMD EPYC 7302 16-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 86400 (24 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-11-12 17:30:47 |
| Input files | monte-carlo-004057-000481
|
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-11-12 17:31:23 |
| Saved logs | justin-logs:287847.165-justin-prod-sched01.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
Error encountered when setting up product: dunesw
ERROR: Product 'dunesw' (with qualifiers 'e26:prof'), has no v09_91_04d00 version (or may not exist)
/tmp/upsjdBT93: line 14: /cvmfs/dune.opensciencegrid.org/products/dune/ups/v6_0_7/Linux64bit+3.10-2.17/bin/setup_fail: Input/output error
printing env
Justin processors: 1
Will use justin-get-file
===============JUSTIN_JOBSUB_ID
287847
======checking====
monte-carlo-004057-000481 000481 MONTECARLO
000481
4057
0
10
4801
============generator=========================
../justin-jobscript: line 81: lar: command not found
ls: cannot access *_20241112T173101Z_*: No such file or directory
ERROR: lar (generation) exit code: 11127
output files size:
../justin-jobscript: line 94: return: can only `return' from a function or sourced script
============G4 stage1=========================
../justin-jobscript: line 106: lar: command not found
ls: cannot access *_20241112T173101Z_*: No such file or directory
ERROR: lar (geant4 step1) exit code: 21127
output files size:
../justin-jobscript: line 119: return: can only `return' from a function or sourced script
============G4 stage2=========================
../justin-jobscript: line 132: lar: command not found
ls: cannot access *_20241112T173101Z_*: No such file or directory
ERROR: lar (geant4 step2) exit code: 31127
output files size:
../justin-jobscript: line 145: return: can only `return' from a function or sourced script
============detsim=========================
../justin-jobscript: line 155: lar: command not found
ls: cannot access *_20241112T173101Z_*: No such file or directory
ERROR: lar (detsim) exit code: 31127
output files size:
../justin-jobscript: line 168: return: can only `return' from a function or sourced script
============reco =========================
../justin-jobscript: line 180: lar: command not found
ls: cannot access *_20241112T173101Z_*: No such file or directory
ERROR: lar (reco) exit code: 51127
output files size:
../justin-jobscript: line 194: return: can only `return' from a function or sourced script
../justin-jobscript: line 200: extractor_prod.py: command not found
ERROR: metadata generation 52127
output files size:
prodbackground_radiological_decay0_dunevd10kt_1x8x14_20241112T173101Z_gen_000481_supernova_g4stage1_g4stage2_detsim_reco.root.ext.json 0
../justin-jobscript: line 213: return: can only `return' from a function or sourced script
python: can't open file '/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/9227c25e1635d18779282cfab801fcdc7cd063b1/pdjson2metadata': [Errno 5] Input/output error
ERROR: metadata writing 52002
output files size:
prodbackground_radiological_decay0_dunevd10kt_1x8x14_20241112T173101Z_gen_000481_supernova_g4stage1_g4stage2_detsim_reco.root.ext.json 0
prodbackground_radiological_decay0_dunevd10kt_1x8x14_20241112T173101Z_gen_000481_supernova_g4stage1_g4stage2_detsim_reco.root.json 0
../justin-jobscript: line 232: return: can only `return' from a function or sourced script
Exiting with error
../justin-jobscript: line 240: return: can only `return' from a function or sourced script
