21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 217365.0@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 217365.0@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 7524 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-06-09 20:16:38 | |
| Site | UK_Manchester | |
| Entry | UBoone_T2_UK_Manchester_ce02 | |
| Last heartbeat | 2025-06-10 05:14:10 | |
| From worker node | Hostname | wn6219300.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7702P 64-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 257400 (71 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | jobscript_error | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-06-10 02:54:33 | |
| Input files | monte-carlo-007524-000094 | |
| Jobscript | Exit code | 1 |
| Real time | 0m (0s) | |
| CPU time | 0m (0s = 0%) | |
| Max RSS bytes | 0 (0 MiB) | |
| Outputting started | ||
| Output files | ||
| Finished | 2025-06-10 05:14:10 | |
| Saved logs | justin-logs:217365.0-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
ehn1-beam-np04/1d/6f/H4_v34b_1GeV_-27.7_001082_20250607T002452Z_001082.root
hadd Source file 13: root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/ehn1-beam-np04/ed/65/H4_v34b_1GeV_-27.7_001087_20250606T222633Z_001087.root
hadd Source file 14: root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/ehn1-beam-np04/2f/8b/H4_v34b_1GeV_-27.7_001134_20250606T223234Z_001134.root
hadd Source file 15: root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/ehn1-beam-np04/da/ac/H4_v34b_1GeV_-27.7_001201_20250607T013331Z_001201.root
hadd Source file 16: root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/ehn1-beam-np04/dc/b1/H4_v34b_1GeV_-27.7_001253_20250607T014416Z_001253.root
hadd Source file 17: root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/ehn1-beam-np04/cf/1d/H4_v34b_1GeV_-27.7_001262_20250607T005031Z_001262.root
hadd Source file 18: root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/ehn1-beam-np04/0e/72/H4_v34b_1GeV_-27.7_001403_20250607T024739Z_001403.root
hadd Source file 19: root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/ehn1-beam-np04/28/ba/H4_v34b_1GeV_-27.7_001454_20250607T023302Z_001454.root
hadd Source file 20: root://meitner.tier2.hep.manchester.ac.uk:1094//cephfs/experiments/dune/RSE/ehn1-beam-np04/6c/fc/H4_v34b_1GeV_-27.7_001543_20250607T030822Z_001543.root
hadd Source file 21: root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/ehn1-beam-np04/67/1f/H4_v34b_1GeV_-27.7_001655_20250607T030905Z_001655.root
hadd Source file 22: root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/ehn1-beam-np04/30/49/H4_v34b_1GeV_-27.7_001735_20250607T013058Z_001735.root
hadd Source file 23: root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/ehn1-beam-np04/a5/4b/H4_v34b_1GeV_-27.7_001785_20250607T025303Z_001785.root
hadd Source file 24: root://eospublic.cern.ch:1094//eos/experiment/neutplatform/protodune/dune/ehn1-beam-np04/e1/b4/H4_v34b_1GeV_-27.7_001875_20250607T014225Z_001875.root
hadd Source file 25: root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/ehn1-beam-np04/bc/0d/H4_v34b_1GeV_-27.7_002176_20250607T011717Z_002176.root
hadd Source file 26: root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/ehn1-beam-np04/0f/0f/H4_v34b_1GeV_-27.7_002202_20250607T003036Z_002202.root
hadd Source file 27: root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/ehn1-beam-np04/b9/7b/H4_v34b_1GeV_-27.7_002425_20250607T033304Z_002425.root
hadd Source file 28: root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/ehn1-beam-np04/fa/be/H4_v34b_1GeV_-27.7_002530_20250607T025313Z_002530.root
hadd Source file 29: root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/ehn1-beam-np04/3f/ea/H4_v34b_1GeV_-27.7_002578_20250607T025457Z_002578.root
hadd Source file 30: root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/ehn1-beam-np04/23/92/H4_v34b_1GeV_-27.7_002887_20250607T033700Z_002887.root
hadd Source file 31: root://dcdndoor.sdcc.bnl.gov:1094/pnfs/sdcc.bnl.gov/data/dune/RSE/ehn1-beam-np04/7b/86/H4_v34b_1GeV_-27.7_002906_20250607T040112Z_002906.root
hadd Source file 32: root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/ehn1-beam-np04/af/69/H4_v34b_1GeV_-27.7_002923_20250607T041511Z_002923.root
hadd Source file 33: root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/ehn1-beam-np04/92/cd/H4_v34b_1GeV_-27.7_002950_20250607T022952Z_002950.root
hadd Source file 34: root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/ehn1-beam-np04/4e/27/H4_v34b_1GeV_-27.7_002997_20250607T024229Z_002997.root
hadd Source file 35: root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/ehn1-beam-np04/11/cd/H4_v34b_1GeV_-27.7_003053_20250607T030858Z_003053.root
hadd Source file 36: root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/ehn1-beam-np04/42/e3/H4_v34b_1GeV_-27.7_003075_20250607T025323Z_003075.root
hadd Source file 37: root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/ehn1-beam-np04/7b/a5/H4_v34b_1GeV_-27.7_003134_20250607T041823Z_003134.root
hadd Source file 38: root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/ehn1-beam-np04/a0/04/H4_v34b_1GeV_-27.7_003159_20250607T042317Z_003159.root
hadd Source file 39: root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/ehn1-beam-np04/52/94/H4_v34b_1GeV_-27.7_003324_20250607T101122Z_003324.root
hadd Source file 40: root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/ehn1-beam-np04/5a/7a/H4_v34b_1GeV_-27.7_003519_20250607T042901Z_003519.root
hadd Source file 41: root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/ehn1-beam-np04/8f/4e/H4_v34b_1GeV_-27.7_003585_20250607T024321Z_003585.root
hadd Source file 42: root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/ehn1-beam-np04/24/74/H4_v34b_1GeV_-27.7_003598_20250607T024234Z_003598.root
hadd Source file 43: root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/ehn1-beam-np04/06/39/H4_v34b_1GeV_-27.7_003688_20250607T035831Z_003688.root
hadd Source file 44: root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/ehn1-beam-np04/b5/0c/H4_v34b_1GeV_-27.7_003817_20250607T044405Z_003817.root
hadd Source file 45: root://eospublic.cern.ch:1094//eos/experiment/neutplatform/protodune/dune/ehn1-beam-np04/bb/8f/H4_v34b_1GeV_-27.7_003837_20250607T055608Z_003837.root
hadd Source file 46: root://lcg-dunese1.sfu.computecanada.ca:1094//dune/RSE/ehn1-beam-np04/aa/82/H4_v34b_1GeV_-27.7_003873_20250607T053548Z_003873.root
hadd Source file 47: root://eospublic.cern.ch:1094//eos/experiment/neutplatform/protodune/dune/ehn1-beam-np04/37/b7/H4_v34b_1GeV_-27.7_003937_20250607T061117Z_003937.root
hadd Source file 48: root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/ehn1-beam-np04/ab/9d/H4_v34b_1GeV_-27.7_003953_20250607T032417Z_003953.root
hadd Source file 49: root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/ehn1-beam-np04/3e/f2/H4_v34b_1GeV_-27.7_004205_20250607T115826Z_004205.root
hadd Source file 50: root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/ehn1-beam-np04/db/c2/H4_v34b_1GeV_-27.7_004269_20250607T063911Z_004269.root
hadd Source file 51: root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/ehn1-beam-np04/45/4f/H4_v34b_1GeV_-27.7_004441_20250607T051801Z_004441.root
hadd Source file 52: root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/ehn1-beam-np04/98/72/H4_v34b_1GeV_-27.7_004528_20250607T055350Z_004528.root
hadd Source file 53: root://mover.pp.rl.ac.uk:1094/pnfs/pp.rl.ac.uk/data/dune/ehn1-beam-np04/c2/d5/H4_v34b_1GeV_-27.7_004636_20250607T075020Z_004636.root
hadd Source file 54: root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/ehn1-beam-np04/0f/fa/H4_v34b_1GeV_-27.7_004806_20250607T074230Z_004806.root
hadd Source file 55: root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/ehn1-beam-np04/dd/90/H4_v34b_1GeV_-27.7_004845_20250607T060305Z_004845.root
hadd Source file 56: root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/ehn1-beam-np04/07/cd/H4_v34b_1GeV_-27.7_004950_20250607T084142Z_004950.root
hadd Source file 57: root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/ehn1-beam-np04/d0/bb/H4_v34b_1GeV_-27.7_005028_20250607T053208Z_005028.root
hadd Source file 58: root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/ehn1-beam-np04/a4/8c/H4_v34b_1GeV_-27.7_005098_20250607T045044Z_005098.root
hadd Source file 59: root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/ehn1-beam-np04/db/02/H4_v34b_1GeV_-27.7_005144_20250607T152154Z_005144.root
hadd Source file 60: root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/ehn1-beam-np04/96/c3/H4_v34b_1GeV_-27.7_005212_20250607T061430Z_005212.root
hadd Source file 61: root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/ehn1-beam-np04/bc/f5/H4_v34b_1GeV_-27.7_005361_20250607T064446Z_005361.root
hadd Source file 62: root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/ehn1-beam-np04/d4/bf/H4_v34b_1GeV_-27.7_005398_20250607T065050Z_005398.root
hadd Source file 63: root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/ehn1-beam-np04/02/ef/H4_v34b_1GeV_-27.7_005508_20250607T073430Z_005508.root
hadd Source file 64: root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/ehn1-beam-np04/bc/c9/H4_v34b_1GeV_-27.7_005707_20250607T083732Z_005707.root
hadd Source file 65: root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/ehn1-beam-np04/c2/88/H4_v34b_1GeV_-27.7_005712_20250607T070732Z_005712.root
hadd Source file 66: root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/ehn1-beam-np04/ad/4c/H4_v34b_1GeV_-27.7_005784_20250607T060950Z_005784.root
hadd Source file 67: root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/ehn1-beam-np04/0b/eb/H4_v34b_1GeV_-27.7_005986_20250607T071751Z_005986.root
Error in <TNetXNGFile::Open>: [FATAL] Invalid address
Error in <TFileMerger::AddFile>: cannot open file root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/ehn1-beam-np04/0b/eb/H4_v34b_1GeV_-27.7_005986_20250607T071751Z_005986.root
hadd exiting due to error in root://otter12.grid.surfsara.nl:21094/pnfs/grid.sara.nl/data/dune/disk/RSE/ehn1-beam-np04/0b/eb/H4_v34b_1GeV_-27.7_005986_20250607T071751Z_005986.root
Traceback (most recent call last):
File "/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/5a837a2f9ce0b916d8725ae4ed0b18872c84fe1f/merge_g4bl.py", line 403, in <module>
do_merge(args)
File "/cvmfs/fifeuser4.opensciencegrid.org/sw/dune/5a837a2f9ce0b916d8725ae4ed0b18872c84fe1f/merge_g4bl.py", line 119, in do_merge
raise Exception('Error in hadd')
Exception: Error in hadd
Exiting with error