justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 362978.66@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID362978.66@justin-prod-sched01.dune.hep.ac.uk
Workflow ID6004
Stage ID1
User nameamoor@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes6291456000 (6000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-04-07 10:42:14
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce506
Last heartbeat2025-04-07 10:44:56
From worker nodeHostnameb9p02p1378.cern.ch
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes6291456000 (6000 MiB)
Wall seconds limit343800 (95 hours)
GPU
Inner Apptainer?True
Job statejobscript_error
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-04-07 10:44:00
Input filesusertests:000218_reco_data_2025-04-02T_082509Z_reco_data_2025-04-02T_135740Z_reco_data_2025-04-04T_090442Z.root
JobscriptExit code1
Real time0m (0s)
CPU time0m (0s = 0%)
Max RSS bytes0 (0 MiB)
Outputting started 
Output files
Finished2025-04-07 10:44:56
Saved logsjustin-logs:362978.66-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

AFM reco1 jobscript.
Input PFN = root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/usertests/5b/74/000218_reco_data_2025-04-02T_082509Z_reco_data_2025-04-02T_135740Z_reco_data_2025-04-04T_090442Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 50 lines of lar log file ===
GeoApaChannelGroupService::ctor: Group 146 (apa146) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 147 (apa147) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 148 (apa148) has 2560 channels from 4/4 readout planes.
GeoApaChannelGroupService::ctor: Group 149 (apa149) has 2560 channels from 4/4 readout planes.
DuneToolManager::fclFilename: Taking fcl name from command line: lar -c standard_reco1_dune10kt.fcl -n -1 -o 000218_reco_data_2025-04-02T_082509Z_reco_data_2025-04-02T_135740Z_reco_data_2025-04-04T_090442Z_reco_data_2025-04-07T_104407Z.root root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/usertests/5b/74/000218_reco_data_2025-04-02T_082509Z_reco_data_2025-04-02T_135740Z_reco_data_2025-04-04T_090442Z.root
AcdDigitReader::ctor:     LogLevel: 1
DuneToolManager::getPrivate: ERROR: Tool name is blank
StandardRawDigitExtractService::ctor: Retrieved digit read tool digitReader
StandardRawDigitExtractService::ctor: StandardRawDigitExtractService:
StandardRawDigitExtractService::ctor:         LogLevel: 1
StandardRawDigitExtractService::ctor:    DigitReadTool: digitReader
StandardRawDigitExtractService::ctor:   PedestalOption: 1
StandardRawDigitExtractService::ctor:     FlagStuckOff: 0
StandardRawDigitExtractService::ctor:      FlagStuckOn: 0
StandardRawDigitPrepService::ctor: Fetching extract service.
StandardRawDigitPrepService::ctor: Fetching channel status provider.
StandardRawDigitPrepService::ctor:   Channel status provider: @0x9a0ae80
StandardRawDigitPrepService::ctor:   Extract service: @0xa1cfb60
StandardRawDigitPrepService::ctor: Fetching deconvolution service.
StandardRawDigitPrepService::ctor:   Deconvolution service: @0x3cde1d0
StandardRawDigitPrepService::ctor: Fetching ROI building service.
StandardRawDigitPrepService::ctor:   ROI building service: @0x3cd68c0
StandardRawDigitPrepService::ctor: Fetching wire building service.
StandardRawDigitPrepService::ctor:   Wire building service: @0x3cdb890
StandardRawDigitPrepService::ctor: StandardRawDigitPrepService:
StandardRawDigitPrepService::ctor:              LogLevel: 1
StandardRawDigitPrepService::ctor:               SkipBad: 1
StandardRawDigitPrepService::ctor:             SkipNoisy: 0
StandardRawDigitPrepService::ctor:   ChannelStatusOnline: 0
StandardRawDigitPrepService::ctor:          DoMitigation: 0
StandardRawDigitPrepService::ctor:  DoEarlySignalFinding: 0
StandardRawDigitPrepService::ctor:        DoNoiseRemoval: 0
StandardRawDigitPrepService::ctor:       DoDeconvolution: 1
StandardRawDigitPrepService::ctor:  DoPedestalAdjustment: 0
StandardRawDigitPrepService::ctor:                 DoROI: 1
StandardRawDigitPrepService::ctor:               DoWires: 1
StandardRawDigitPrepService::ctor:                DoDump: 0
StandardRawDigitPrepService::ctor:  DoIntermediateStates: 0
StandardRawDigitPrepService::ctor: No display tools.
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_U (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_V (Potential memory leak).
Warning in <TFile::Append>: Replacing existing TH1: FieldResponse_Y (Potential memory leak).
07-Apr-2025 12:44:35 CEST  Initiating request to open input file "root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/usertests/5b/74/000218_reco_data_2025-04-02T_082509Z_reco_data_2025-04-02T_135740Z_reco_data_2025-04-04T_090442Z.root"
%MSG-s ArtException:  TriggerResultInserter:TriggerResults@Construction  07-Apr-2025 12:44:36 CEST ModuleConstruction
cet::exception caught in art
---- FileOpenError BEGIN
  RootInputFileSequence::initFile(): Input file root://cephc02.gla.scotgrid.ac.uk:1094//cephfs/dune/RSE/usertests/5b/74/000218_reco_data_2025-04-02T_082509Z_reco_data_2025-04-02T_135740Z_reco_data_2025-04-04T_090442Z.root was not found or could not be opened.
---- FileOpenError END
%MSG
Art has completed and will exit with status 20.
=== End last 50 lines of lar log file ===
lar exit code 0
Traceback (most recent call last):
  File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_04_06d00/bin/extractor_prod.py", line 434, in <module>
    main()
  File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_04_06d00/bin/extractor_prod.py", line 373, in main
    mddict = expSpecificMetadata.getmetadata()
  File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_04_06d00/bin/extractor_prod.py", line 344, in getmetadata
    jobt = self.get_job(proc)
  File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v10_04_06d00/bin/extractor_prod.py", line 69, in get_job
    raise RuntimeError('sam_metadata_dumper returned nonzero exit status {}.'.format(rc))
RuntimeError: sam_metadata_dumper returned nonzero exit status 1.
extractor_prod.py exit code 1
Error reading metadata from file: Expecting value: line 1 column 1 (char 0)
pdjson2metadata exit code 1
.:
total 36
-rw-r--r--. 1 duneprd np-comp 20046 Apr  7 12:44 000218_reco_data_2025-04-02T_082509Z_reco_data_2025-04-02T_135740Z_reco_data_2025-04-04T_090442Z_reco_2025-04-07T_104407Z.log
-rw-r--r--. 1 duneprd np-comp  5411 Apr  7 12:44 jobscript.log
-rw-r--r--. 1 duneprd np-comp   519 Apr  7 12:44 reco1_hist.root
-rw-r--r--. 1 duneprd np-comp   224 Apr  7 12:44 all-input-dids.txt
-rw-r--r--. 1 duneprd np-comp     0 Apr  7 12:44 000218_reco_data_2025-04-02T_082509Z_reco_data_2025-04-02T_135740Z_reco_data_2025-04-04T_090442Z_reco_data_2025-04-07T_104407Z.root.ext.json
-rw-r--r--. 1 duneprd np-comp     0 Apr  7 12:44 000218_reco_data_2025-04-02T_082509Z_reco_data_2025-04-02T_135740Z_reco_data_2025-04-04T_090442Z_reco_data_2025-04-07T_104407Z.root.json
-rw-r--r--. 1 duneprd np-comp     0 Apr  7 12:44 debugprod.log
justIN time: 2025-05-20 04:55:55 UTC       justIN version: 01.03.01