Jobsub ID 66569.35@justin-prod-sched02.dune.hep.ac.uk
Jobscript log (last 10,000 characters)
AFM reco2 jobscript.
Input PFN = root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/33/62/000719_reco_data_2024-08-16T_162754Z_reco_data_2024-08-19T_105833Z_reco_data_2024-08-20T_105800Z_reco_data_2024-08-22T_093309Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e20-p3913-prof/lib/libXrdPosixPreload.so
=== Start last 50 lines of lar log file ===
reco:pmtrack:PMAlgTrackMaker 0.000863731 76.9079 153.815 76.9079 76.907 2
reco:pmtrackcalo:Calorimetry 8.7566e-05 0.499974 0.999861 0.499974 0.499886 2
reco:pmtrackpid:Chi2ParticleID 3.5046e-05 0.00206797 0.0041009 0.00206797 0.00203293 2
reco:pmtrajfit:PMAlgTrajFitter 0.0221548 14.1617 28.3013 14.1617 14.1396 2
reco:pmtrajfitcalo:Calorimetry 0.000324353 1.01211 2.0239 1.01211 1.01179 2
reco:pmtrajfitpid:Chi2ParticleID 7.426e-05 0.00273591 0.00539757 0.00273591 0.00266165 2
reco:pmtracktc:PMAlgTrackMaker 0.000962057 91.6218 183.243 91.6218 91.6208 2
reco:pmtracktccalo:Calorimetry 9.2535e-05 0.309906 0.619719 0.309906 0.309813 2
reco:pmtracktcpid:Chi2ParticleID 3.2812e-05 0.0024962 0.00495959 0.0024962 0.00246339 2
reco:pmtrajfittc:PMAlgTrajFitter 0.000247117 48.5928 97.1854 48.5928 48.5926 2
reco:pmtrajfittccalo:Calorimetry 7.2517e-05 0.736329 1.47259 0.736329 0.736256 2
reco:pmtrajfittcpid:Chi2ParticleID 2.8563e-05 0.00412057 0.00821257 0.00412057 0.00409201 2
reco:cvnmap:CVNMapper 2.3274e-05 0.0585654 0.117108 0.0585654 0.0585421 2
reco:cvneva:CVNEvaluator 2.3314e-05 4.8962 9.79238 4.8962 4.89618 2
reco:energyrecnumu:EnergyReco 5.26444 5.26444 5.26444 5.26444 0 1
reco:energyrecnue:EnergyReco 2.00991 2.00991 2.00991 2.00991 0 1
reco:energyrecnc:EnergyReco 1.83879 1.83879 1.83879 1.83879 0 1
reco:ophit:OpHitFinder 0.301665 0.301665 0.301665 0.301665 0 1
reco:opflash:OpFlashFinder 0.00491158 0.00491158 0.00491158 0.00491158 0 1
reco:rns:RandomNumberSaver 0.000396419 0.000396419 0.000396419 0.000396419 0 1
[art]:TriggerResults:TriggerResultInserter 5.297e-05 5.297e-05 5.297e-05 5.297e-05 0 1
end_path:out1:RootOutput 3.1119e-05 3.1119e-05 3.1119e-05 3.1119e-05 0 1
end_path:out1:RootOutput(write) 1.94524 1.94524 1.94524 1.94524 0 1
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3902.91 MB
Peak resident set size usage (VmHWM): 2279.69 MB
====================================================================================================
%MSG-s ArtException: PostEndJob 05-Sep-2024 10:59:47 CDT ModuleEndJob
---- EventProcessorFailure BEGIN
EventProcessor: an exception occurred during current event processing
---- ScheduleExecutionFailure BEGIN
Path: ProcessingStopped.
---- StdException BEGIN
An exception was thrown while processing module EnergyReco/energyrecnumu run: 20000031 subRun: 0 event: 108
vector::_M_range_check: __n (which is 7) >= this->size() (which is 7)
---- StdException END
Exception going through path reco
---- ScheduleExecutionFailure END
---- EventProcessorFailure END
---- FatalRootError BEGIN
Fatal Root Error: TTree::SetEntries
Tree branches have different numbers of entries, eg EventAuxiliary has 1 entries while sim::OpDetDivRecs_opdigi__detsim. has 14 entries.
ROOT severity: 2000
---- FatalRootError END
%MSG
Art has completed and will exit with status 1.
=== End last 50 lines of lar log file ===
lar exit code 0
Traceback (most recent call last):
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_03d00/bin/extractor_prod.py", line 434, in <module>
main()
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_03d00/bin/extractor_prod.py", line 373, in main
mddict = expSpecificMetadata.getmetadata()
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_03d00/bin/extractor_prod.py", line 344, in getmetadata
jobt = self.get_job(proc)
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_03d00/bin/extractor_prod.py", line 69, in get_job
raise RuntimeError('sam_metadata_dumper returned nonzero exit status {}.'.format(rc))
RuntimeError: sam_metadata_dumper returned nonzero exit status 1.
extractor_prod.py exit code 1
Error reading metadata from file: Expecting value: line 1 column 1 (char 0)
pdjson2metadata exit code 1
.:
total 582964
-rw-r--r-- 1 slot1_8 slot1_8 594422464 Sep 5 10:59 RootOutput-3f78-e64f-3341-0335.root
-rw-r--r-- 1 slot1_8 slot1_8 2501422 Sep 5 10:59 000719_reco_data_2024-08-16T_162754Z_reco_data_2024-08-19T_105833Z_reco_data_2024-08-20T_105800Z_reco_data_2024-08-22T_093309Z_reco_2024-09-05T_152025Z.log
-rw-r--r-- 1 slot1_8 slot1_8 7560 Sep 5 10:59 reco2_hist.root
-rw-r--r-- 1 slot1_8 slot1_8 6003 Sep 5 10:59 jobscript.log
-rw-r--r-- 1 slot1_8 slot1_8 284 Sep 5 10:19 all-input-dids.txt
-rw-r--r-- 1 slot1_8 slot1_8 0 Sep 5 10:59 000719_reco_data_2024-08-16T_162754Z_reco_data_2024-08-19T_105833Z_reco_data_2024-08-20T_105800Z_reco_data_2024-08-22T_093309Z_reco_data_2024-09-05T_152025Z.root.ext.json
-rw-r--r-- 1 slot1_8 slot1_8 0 Sep 5 10:59 000719_reco_data_2024-08-16T_162754Z_reco_data_2024-08-19T_105833Z_reco_data_2024-08-20T_105800Z_reco_data_2024-08-22T_093309Z_reco_data_2024-09-05T_152025Z.root.json
-rw-r--r-- 1 slot1_8 slot1_8 0 Sep 5 10:20 debugprod.log 