Jobsub ID 168447.0@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID	168447.0@justin-prod-sched02.dune.hep.ac.uk
Workflow ID	5873
Stage ID	1
User name	twalton@fnal.gov
HTCondor Group	group_dune.prod_mcsim
Requested	Processors	1
	GPU	No
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	3600 (1 hours)
Submitted time	2025-04-01 20:30:45
Site	US_NERSC-CPU
Entry	dune_t3_us_nersc_perlmutter_cpu_sl7
Last heartbeat	2025-04-01 20:33:49
From worker node	Hostname	nid006473
	cpuinfo	AMD EPYC 7763 64-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	2097152000 (2000 MiB)
	Wall seconds limit	84600 (23 hours)
	GPU
	Inner Apptainer?	False
Job state	jobscript_error
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2025-04-01 20:31:25
Input files	neardet-2x2-lar-charge:binary-0050011-2024_07_07_13_59_33_CDT.hdf5
Jobscript	Exit code	1
	Real time	0m (0s)
	CPU time	0m (0s = 0%)
	Max RSS bytes	0 (0 MiB)
Outputting started
Output files
Finished	2025-04-01 20:33:49
Saved logs	justin-logs:168447.0-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events Wrapper job log
Jobscript log (last 10,000 characters)

it/s]
 17%|#7        | 80/467 [00:06<00:32, 11.95it/s]
 18%|#7        | 82/467 [00:06<00:32, 11.93it/s]
 18%|#7        | 84/467 [00:07<00:32, 11.90it/s]
 18%|#8        | 86/467 [00:07<00:31, 11.94it/s]
 19%|#8        | 88/467 [00:07<00:31, 11.95it/s]
 19%|#9        | 90/467 [00:07<00:31, 11.91it/s]
 20%|#9        | 92/467 [00:07<00:31, 11.92it/s]
 20%|##        | 94/467 [00:07<00:31, 11.95it/s]
 21%|##        | 96/467 [00:08<00:31, 11.93it/s]
 21%|##        | 98/467 [00:08<00:30, 11.90it/s]
 21%|##1       | 100/467 [00:08<00:30, 11.93it/s]
 22%|##1       | 102/467 [00:08<00:30, 11.93it/s]
 22%|##2       | 104/467 [00:08<00:30, 11.88it/s]
 23%|##2       | 106/467 [00:08<00:30, 11.91it/s]
 23%|##3       | 108/467 [00:09<00:30, 11.89it/s]
 24%|##3       | 110/467 [00:09<00:30, 11.86it/s]
 24%|##3       | 112/467 [00:09<00:29, 11.90it/s]
 24%|##4       | 114/467 [00:09<00:29, 11.92it/s]
 25%|##4       | 116/467 [00:09<00:29, 11.89it/s]
 25%|##5       | 118/467 [00:09<00:30, 11.63it/s]
 26%|##5       | 120/467 [00:10<00:29, 11.82it/s]
 26%|##6       | 122/467 [00:10<00:29, 11.86it/s]
 27%|##6       | 124/467 [00:10<00:28, 11.88it/s]
 27%|##6       | 126/467 [00:10<00:28, 11.90it/s]
 27%|##7       | 128/467 [00:10<00:28, 11.87it/s]
 28%|##7       | 130/467 [00:10<00:28, 11.73it/s]
 28%|##8       | 132/467 [00:11<00:28, 11.79it/s]
 29%|##8       | 134/467 [00:11<00:28, 11.85it/s]
 29%|##9       | 136/467 [00:11<00:27, 11.87it/s]
 30%|##9       | 138/467 [00:11<00:27, 11.91it/s]
 30%|##9       | 140/467 [00:11<00:27, 11.91it/s]
 30%|###       | 142/467 [00:11<00:27, 11.88it/s]
 31%|###       | 144/467 [00:12<00:27, 11.85it/s]
 31%|###1      | 146/467 [00:12<00:27, 11.86it/s]
 32%|###1      | 148/467 [00:12<00:26, 11.86it/s]
 32%|###2      | 150/467 [00:12<00:26, 11.91it/s]
 33%|###2      | 152/467 [00:12<00:26, 11.85it/s]
 33%|###2      | 154/467 [00:12<00:26, 11.83it/s]
 33%|###3      | 156/467 [00:13<00:26, 11.84it/s]
 34%|###3      | 158/467 [00:13<00:27, 11.27it/s]
 34%|###4      | 160/467 [00:13<00:26, 11.80it/s]
 35%|###4      | 162/467 [00:13<00:26, 11.65it/s]
 35%|###5      | 164/467 [00:13<00:25, 11.81it/s]
 36%|###5      | 166/467 [00:13<00:25, 11.87it/s]
 36%|###5      | 168/467 [00:14<00:25, 11.87it/s]
 36%|###6      | 170/467 [00:14<00:25, 11.59it/s]
 37%|###6      | 172/467 [00:14<00:24, 11.93it/s]
 37%|###7      | 174/467 [00:14<00:23, 12.37it/s]
 38%|###7      | 176/467 [00:14<00:23, 12.40it/s]
 38%|###8      | 178/467 [00:14<00:23, 12.25it/s]
 39%|###8      | 180/467 [00:15<00:23, 12.40it/s]
 39%|###8      | 182/467 [00:15<00:23, 12.35it/s]
 39%|###9      | 184/467 [00:15<00:22, 12.36it/s]
 40%|###9      | 186/467 [00:15<00:22, 12.36it/s]
 40%|####      | 188/467 [00:15<00:22, 12.38it/s]
 41%|####      | 190/467 [00:15<00:22, 12.32it/s]
 41%|####1     | 192/467 [00:16<00:22, 12.35it/s]
 42%|####1     | 194/467 [00:16<00:22, 12.38it/s]
 42%|####1     | 196/467 [00:16<00:21, 12.37it/s]
 42%|####2     | 198/467 [00:16<00:21, 12.36it/s]
 43%|####2     | 200/467 [00:16<00:21, 12.42it/s]
 43%|####3     | 202/467 [00:16<00:21, 12.39it/s]
 44%|####3     | 204/467 [00:17<00:21, 12.36it/s]
 44%|####4     | 206/467 [00:17<00:21, 12.36it/s]
 45%|####4     | 208/467 [00:17<00:20, 12.39it/s]
 45%|####4     | 210/467 [00:17<00:20, 12.37it/s]
 45%|####5     | 212/467 [00:17<00:20, 12.36it/s]
 46%|####5     | 214/467 [00:17<00:20, 12.37it/s]
 46%|####6     | 216/467 [00:18<00:20, 12.28it/s]
 47%|####6     | 218/467 [00:18<00:20, 12.37it/s]
 47%|####7     | 220/467 [00:18<00:19, 12.41it/s]
 48%|####7     | 222/467 [00:18<00:19, 12.39it/s]
 48%|####7     | 224/467 [00:18<00:19, 12.37it/s]
 48%|####8     | 226/467 [00:18<00:19, 12.40it/s]
 49%|####8     | 228/467 [00:19<00:19, 12.17it/s]
 49%|####9     | 230/467 [00:19<00:19, 12.39it/s]
 50%|####9     | 232/467 [00:19<00:18, 12.40it/s]
 50%|#####     | 234/467 [00:19<00:18, 12.37it/s]
 51%|#####     | 236/467 [00:19<00:18, 12.35it/s]
 51%|#####     | 238/467 [00:19<00:18, 12.38it/s]
 51%|#####1    | 240/467 [00:19<00:18, 12.09it/s]
 52%|#####1    | 242/467 [00:20<00:18, 12.17it/s]
 52%|#####2    | 244/467 [00:20<00:18, 12.37it/s]
 53%|#####2    | 246/467 [00:20<00:17, 12.31it/s]
 53%|#####3    | 248/467 [00:20<00:17, 12.39it/s]
 54%|#####3    | 250/467 [00:20<00:17, 12.40it/s]
 54%|#####3    | 252/467 [00:20<00:17, 12.40it/s]
 54%|#####4    | 254/467 [00:21<00:17, 12.37it/s]
 55%|#####4    | 256/467 [00:21<00:17, 12.40it/s]
 55%|#####5    | 258/467 [00:21<00:16, 12.44it/s]
 56%|#####5    | 260/467 [00:21<00:16, 12.43it/s]
 56%|#####6    | 262/467 [00:21<00:16, 12.42it/s]
 57%|#####6    | 264/467 [00:21<00:16, 12.39it/s]
 57%|#####6    | 266/467 [00:22<00:16, 12.40it/s]
 57%|#####7    | 268/467 [00:22<00:16, 12.40it/s]
 58%|#####7    | 270/467 [00:22<00:16, 12.24it/s]
 58%|#####8    | 272/467 [00:22<00:15, 12.38it/s]
 59%|#####8    | 274/467 [00:22<00:15, 12.36it/s]
 59%|#####9    | 276/467 [00:22<00:15, 12.37it/s]
 60%|#####9    | 278/467 [00:23<00:15, 12.38it/s]
 60%|#####9    | 280/467 [00:23<00:15, 12.27it/s]
 60%|######    | 282/467 [00:23<00:14, 12.39it/s]
 61%|######    | 284/467 [00:23<00:14, 12.41it/s]
 61%|######1   | 286/467 [00:23<00:14, 12.37it/s]
 62%|######1   | 288/467 [00:23<00:14, 12.39it/s]
 62%|######2   | 290/467 [00:24<00:14, 12.34it/s]
 63%|######2   | 292/467 [00:24<00:14, 12.39it/s]
 63%|######2   | 294/467 [00:24<00:13, 12.40it/s]
 63%|######3   | 296/467 [00:24<00:13, 12.40it/s]
 64%|######3   | 298/467 [00:24<00:13, 12.38it/s]
 64%|######4   | 300/467 [00:24<00:13, 12.39it/s]
 65%|######4   | 302/467 [00:24<00:13, 12.41it/s]
 65%|######5   | 304/467 [00:25<00:13, 12.43it/s]
 66%|######5   | 306/467 [00:25<00:12, 12.40it/s]
 66%|######5   | 308/467 [00:25<00:12, 12.39it/s]
 66%|######6   | 310/467 [00:25<00:12, 12.42it/s]
 67%|######6   | 312/467 [00:25<00:12, 12.38it/s]
 67%|######7   | 314/467 [00:25<00:12, 12.39it/s]
 68%|######7   | 316/467 [00:26<00:12, 12.36it/s]
 68%|######8   | 318/467 [00:26<00:12, 12.38it/s]
 69%|######8   | 320/467 [00:26<00:11, 12.35it/s]
 69%|######8   | 322/467 [00:26<00:11, 12.38it/s]
 69%|######9   | 324/467 [00:26<00:11, 12.36it/s]
 70%|######9   | 326/467 [00:26<00:11, 12.37it/s]
 70%|#######   | 328/467 [00:27<00:11, 12.38it/s]
 71%|#######   | 330/467 [00:27<00:11, 12.39it/s]
 71%|#######1  | 332/467 [00:27<00:11, 12.13it/s]
 72%|#######1  | 334/467 [00:27<00:10, 12.16it/s]
 72%|#######1  | 336/467 [00:27<00:10, 12.35it/s]
 72%|#######2  | 338/467 [00:27<00:10, 12.36it/s]
 73%|#######2  | 340/467 [00:28<00:10, 12.39it/s]
 73%|#######3  | 342/467 [00:28<00:10, 12.35it/s]
 74%|#######3  | 344/467 [00:28<00:09, 12.33it/s]
 74%|#######4  | 346/467 [00:28<00:09, 12.41it/s]
 75%|#######4  | 348/467 [00:28<00:09, 12.37it/s]
 75%|#######4  | 350/467 [00:28<00:09, 12.38it/s]
 75%|#######5  | 352/467 [00:29<00:09, 12.37it/s]
 76%|#######5  | 354/467 [00:29<00:09, 12.32it/s]
 76%|#######6  | 356/467 [00:29<00:08, 12.40it/s]
 77%|#######6  | 358/467 [00:29<00:08, 12.37it/s]
 77%|#######7  | 360/467 [00:29<00:08, 12.36it/s]
 78%|#######7  | 362/467 [00:29<00:08, 12.38it/s]
 78%|#######7  | 364/467 [00:30<00:08, 12.34it/s]
 78%|#######8  | 366/467 [00:30<00:08, 12.39it/s]
 79%|#######8  | 368/467 [00:30<00:08, 12.34it/s]
 79%|#######9  | 370/467 [00:30<00:07, 12.35it/s]
 80%|#######9  | 372/467 [00:30<00:07, 12.39it/s]
 80%|########  | 374/467 [00:30<00:07, 12.38it/s]
 81%|########  | 376/467 [00:30<00:07, 12.38it/s]
 81%|########  | 378/467 [00:31<00:07, 12.41it/s]
 81%|########1 | 380/467 [00:31<00:07, 12.35it/s]
 82%|########1 | 382/467 [00:31<00:06, 12.34it/s]
 82%|########2 | 384/467 [00:31<00:06, 12.33it/s]
 83%|########2 | 386/467 [00:31<00:06, 12.36it/s]
 83%|########3 | 388/467 [00:31<00:06, 12.38it/s]
 84%|########3 | 390/467 [00:32<00:06, 12.36it/s]
 84%|########3 | 392/467 [00:32<00:06, 12.37it/s]
 84%|########4 | 394/467 [00:32<00:05, 12.38it/s]
 85%|########4 | 396/467 [00:32<00:05, 12.33it/s]
 85%|########5 | 398/467 [00:32<00:05, 12.37it/s]
 86%|########5 | 400/467 [00:32<00:05, 12.39it/s]
 86%|########6 | 402/467 [00:33<00:05, 12.43it/s]
 87%|########6 | 404/467 [00:33<00:05, 12.42it/s]
 87%|########6 | 406/467 [00:33<00:04, 12.39it/s]
 87%|########7 | 408/467 [00:33<00:04, 12.32it/s]
 88%|########7 | 410/467 [00:33<00:04, 12.34it/s]
 88%|########8 | 412/467 [00:33<00:04, 12.41it/s]
 89%|########8 | 414/467 [00:34<00:04, 12.41it/s]
 89%|########9 | 416/467 [00:34<00:04, 12.38it/s]
 90%|########9 | 418/467 [00:34<00:03, 12.39it/s]
 90%|########9 | 420/467 [00:34<00:03, 12.40it/s]
 90%|######### | 422/467 [00:34<00:03, 12.39it/s]
 91%|######### | 424/467 [00:34<00:03, 12.40it/s]
 91%|#########1| 426/467 [00:35<00:03, 12.26it/s]
 92%|#########1| 428/467 [00:35<00:03, 12.39it/s]
 92%|#########2| 430/467 [00:35<00:02, 12.37it/s]
 93%|#########2| 432/467 [00:35<00:02, 12.02it/s]
 93%|#########2| 434/467 [00:35<00:02, 12.21it/s]
 93%|#########3| 436/467 [00:35<00:02, 12.37it/s]
 94%|#########3| 438/467 [00:35<00:02, 12.35it/s]
 94%|#########4| 440/467 [00:36<00:02, 12.34it/s]
 95%|#########4| 442/467 [00:36<00:02, 12.38it/s]
 95%|#########5| 444/467 [00:36<00:01, 11.95it/s]
 96%|#########5| 446/467 [00:36<00:01, 12.34it/s]
 96%|#########5| 448/467 [00:36<00:01, 11.97it/s]
 96%|#########6| 450/467 [00:36<00:01, 12.27it/s]
 97%|#########6| 452/467 [00:37<00:01, 11.94it/s]
 97%|#########7| 454/467 [00:37<00:01, 12.36it/s]
 98%|#########7| 456/467 [00:37<00:00, 12.31it/s]
 98%|#########8| 458/467 [00:37<00:00, 12.31it/s]
 99%|#########8| 460/467 [00:37<00:00, 11.99it/s]
 99%|#########8| 462/467 [00:37<00:00, 12.36it/s]
 99%|#########9| 464/467 [00:38<00:00, 12.36it/s]
100%|#########9| 466/467 [00:38<00:00, 12.42it/s]
100%|##########| 467/467 [00:38<00:00, 12.17it/s]
		For the light+charge combination workflow, the LIGHT_EVENT_RANGE is [ start is 5 :: end is 5604 ]
	Moving the light file(s) to the outfiles directory
FATAL::The file [packet-0050011-2024_07_07_13_59_33_CDT.FLOW.hdf5] does not exist! Will not continue.