Jobsub ID 277418.0@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID	277418.0@justin-prod-sched01.dune.hep.ac.uk
Workflow ID	3681
Stage ID	1
User name	amoor@fnal.gov
HTCondor Group	group_dune
Requested	Processors	1
	RSS bytes	5242880000 (5000 MiB)
	Wall seconds limit	80000 (22 hours)
Submitted time	2024-10-19 12:32:07
Site	UK_RAL-Tier1
Entry	LIGO_UK_RAL_arc_ce01
Last heartbeat	2024-10-19 12:34:35
From worker node	Hostname	dune001-3293108.0-lcg2546.gridpp.rl.ac.uk
	cpuinfo	AMD EPYC 7452 32-Core Processor
	OS release	Scientific Linux release 7.9 (Nitrogen)
	Processors	1
	RSS bytes	5242880000 (5000 MiB)
	Wall seconds limit	216000 (60 hours)
	Inner Apptainer?	True
Job state	jobscript_error
Allocator name	justin-allocator-pro.dune.hep.ac.uk
Started	2024-10-19 12:33:31
Input files	usertests:000569_reco_data_2024-10-07T_115757Z_reco_data_2024-10-08T_104657Z_reco_data_2024-10-09T_100846Z_reco_data_2024-10-10T_153346Z.root
Jobscript	Exit code	1
	Real time	0m (0s)
	CPU time	0m (0s = 0%)
Outputting started
Output files
Finished	2024-10-19 12:34:35
Saved logs	justin-logs:277418.0-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events Wrapper job log

Jobscript log (last 10,000 characters)

AFM reco2 jobscript.
Input PFN = root://golias100.farm.particle.cz:1094/dpm/farm.particle.cz/home/dune/RSE/usertests/97/07/000569_reco_data_2024-10-07T_115757Z_reco_data_2024-10-08T_104657Z_reco_data_2024-10-09T_100846Z_reco_data_2024-10-10T_153346Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e20-p3913-prof/lib/libXrdPosixPreload.so
=== Start last 50 lines of lar log file ===
Failed to parse the configuration file '/cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ebe6880ca58d3059757e664073b29560962a72ff/standard_reco2_dune10kt_1x2x6_cosmic_slim.fcl' with exception
---- Can't locate or can't open specified file: BEGIN
  /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ebe6880ca58d3059757e664073b29560962a72ff/standard_reco2_dune10kt_1x2x6_cosmic_slim.fcl => /cvmfs/fifeuser1.opensciencegrid.org/sw/dune/ebe6880ca58d3059757e664073b29560962a72ff/standard_reco2_dune10kt_1x2x6_cosmic_slim.fcl
---- Can't locate or can't open specified file: END

Art has completed and will exit with status 90.
=== End last 50 lines of lar log file ===
lar exit code 0
Traceback (most recent call last):
  File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_03d00/bin/extractor_prod.py", line 434, in <module>
    main()
  File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_03d00/bin/extractor_prod.py", line 373, in main
    mddict = expSpecificMetadata.getmetadata()
  File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_03d00/bin/extractor_prod.py", line 344, in getmetadata
    jobt = self.get_job(proc)
  File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_03d00/bin/extractor_prod.py", line 69, in get_job
    raise RuntimeError('sam_metadata_dumper returned nonzero exit status {}.'.format(rc))
RuntimeError: sam_metadata_dumper returned nonzero exit status 1.
extractor_prod.py exit code 1
Error reading metadata from file: Expecting value: line 1 column 1 (char 0)
pdjson2metadata exit code 1
.:
total 12
-rw-r--r-- 1 dune001 dune 2132 Oct 19 12:34 jobscript.log
-rw-r--r-- 1 dune001 dune  612 Oct 19 12:33 000569_reco_data_2024-10-07T_115757Z_reco_data_2024-10-08T_104657Z_reco_data_2024-10-09T_100846Z_reco_data_2024-10-10T_153346Z_reco_2024-10-19T_123349Z.log
-rw-r--r-- 1 dune001 dune  284 Oct 19 12:33 all-input-dids.txt
-rw-r--r-- 1 dune001 dune    0 Oct 19 12:33 000569_reco_data_2024-10-07T_115757Z_reco_data_2024-10-08T_104657Z_reco_data_2024-10-09T_100846Z_reco_data_2024-10-10T_153346Z_reco_data_2024-10-19T_123349Z.root.ext.json
-rw-r--r-- 1 dune001 dune    0 Oct 19 12:34 000569_reco_data_2024-10-07T_115757Z_reco_data_2024-10-08T_104657Z_reco_data_2024-10-09T_100846Z_reco_data_2024-10-10T_153346Z_reco_data_2024-10-19T_123349Z.root.json