Jobsub ID 66569.61@justin-prod-sched02.dune.hep.ac.uk
Jobscript log (last 10,000 characters)
AFM reco2 jobscript.
Input PFN = root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/f1/6c/000590_reco_data_2024-08-16T_162554Z_reco_data_2024-08-19T_112741Z_reco_data_2024-08-20T_123408Z_reco_data_2024-08-22T_093256Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e20-p3913-prof/lib/libXrdPosixPreload.so
=== Start last 50 lines of lar log file ===
reco:pmtrack:PMAlgTrackMaker 0.000771533 22.0278 206.321 0.516733 61.4964 10
reco:pmtrackcalo:Calorimetry 5.6767e-05 0.0764711 0.69314 0.000455914 0.206069 10
reco:pmtrackpid:Chi2ParticleID 2.3824e-05 0.000588828 0.00458168 0.000104207 0.00134157 10
reco:pmtrajfit:PMAlgTrajFitter 0.000183707 4.0306 27.1084 1.05928 7.93427 10
reco:pmtrajfitcalo:Calorimetry 5.4492e-05 0.165394 1.55453 0.0047802 0.463408 10
reco:pmtrajfitpid:Chi2ParticleID 2.4536e-05 0.000720355 0.00528353 0.000172264 0.00153804 10
reco:pmtracktc:PMAlgTrackMaker 0.000662889 22.2733 207.734 0.470004 61.916 10
reco:pmtracktccalo:Calorimetry 5.6075e-05 0.0340349 0.278931 0.000580479 0.0825082 10
reco:pmtracktcpid:Chi2ParticleID 2.2843e-05 0.000449843 0.003222 0.000125822 0.000934468 10
reco:pmtrajfittc:PMAlgTrajFitter 0.000145013 10.5718 97.067 0.570772 28.8591 10
reco:pmtrajfittccalo:Calorimetry 5.2599e-05 0.137426 1.31587 0.00251248 0.392959 10
reco:pmtrajfittcpid:Chi2ParticleID 2.1931e-05 0.00077544 0.0061308 0.000145028 0.00179475 10
reco:cvnmap:CVNMapper 1.569e-05 0.0345648 0.0896436 0.043821 0.0283448 10
reco:cvneva:CVNEvaluator 1.4538e-05 0.721081 2.15009 0.829007 0.608171 10
reco:energyrecnumu:EnergyReco 0.00155869 0.260874 1.92017 0.0120658 0.59211 9
reco:energyrecnue:EnergyReco 0.000233209 0.178373 1.55058 0.00198931 0.485342 9
reco:energyrecnc:EnergyReco 0.00185495 0.174217 1.49891 0.00301578 0.468558 9
reco:ophit:OpHitFinder 0.0274624 0.0556472 0.124366 0.0513126 0.0264613 9
reco:opflash:OpFlashFinder 0.000125056 0.000927187 0.0043893 0.000478461 0.00127537 9
reco:rns:RandomNumberSaver 1.3826e-05 8.32513e-05 0.000295968 3.18e-05 0.000106994 9
[art]:TriggerResults:TriggerResultInserter 8.526e-06 1.89668e-05 4.5465e-05 1.2403e-05 1.35525e-05 9
end_path:out1:RootOutput 3.396e-06 8.27211e-06 2.0859e-05 5.561e-06 6.20898e-06 9
end_path:out1:RootOutput(write) 0.00487426 0.401985 1.39978 0.338113 0.386033 9
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3868.32 MB
Peak resident set size usage (VmHWM): 2047.57 MB
====================================================================================================
%MSG-s ArtException: PostEndJob 05-Sep-2024 11:11:03 CDT ModuleEndJob
---- EventProcessorFailure BEGIN
EventProcessor: an exception occurred during current event processing
---- ScheduleExecutionFailure BEGIN
Path: ProcessingStopped.
---- StdException BEGIN
An exception was thrown while processing module EnergyReco/energyrecnumu run: 20000031 subRun: 0 event: 663
vector::_M_range_check: __n (which is 19) >= this->size() (which is 9)
---- StdException END
Exception going through path reco
---- ScheduleExecutionFailure END
---- EventProcessorFailure END
---- FatalRootError BEGIN
Fatal Root Error: TTree::SetEntries
Tree branches have different numbers of entries, eg EventAuxiliary has 9 entries while sim::OpDetDivRecs_opdigi__detsim. has 16 entries.
ROOT severity: 2000
---- FatalRootError END
%MSG
Art has completed and will exit with status 1.
=== End last 50 lines of lar log file ===
lar exit code 0
Traceback (most recent call last):
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_03d00/bin/extractor_prod.py", line 434, in <module>
main()
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_03d00/bin/extractor_prod.py", line 373, in main
mddict = expSpecificMetadata.getmetadata()
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_03d00/bin/extractor_prod.py", line 344, in getmetadata
jobt = self.get_job(proc)
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_03d00/bin/extractor_prod.py", line 69, in get_job
raise RuntimeError('sam_metadata_dumper returned nonzero exit status {}.'.format(rc))
RuntimeError: sam_metadata_dumper returned nonzero exit status 1.
extractor_prod.py exit code 1
Error reading metadata from file: Expecting value: line 1 column 1 (char 0)
pdjson2metadata exit code 1
.:
total 908856
-rw-r--r--. 1 dune osgvo 925842175 Sep 5 11:11 RootOutput-3e1d-0d3a-d447-8320.root
-rw-r--r--. 1 dune osgvo 4794634 Sep 5 11:11 000590_reco_data_2024-08-16T_162554Z_reco_data_2024-08-19T_112741Z_reco_data_2024-08-20T_123408Z_reco_data_2024-08-22T_093256Z_reco_2024-09-05T_152536Z.log
-rw-r--r--. 1 dune osgvo 7560 Sep 5 11:11 reco2_hist.root
-rw-r--r--. 1 dune osgvo 6004 Sep 5 11:11 jobscript.log
-rw-r--r--. 1 dune osgvo 284 Sep 5 10:25 all-input-dids.txt
-rw-r--r--. 1 dune osgvo 0 Sep 5 11:11 000590_reco_data_2024-08-16T_162554Z_reco_data_2024-08-19T_112741Z_reco_data_2024-08-20T_123408Z_reco_data_2024-08-22T_093256Z_reco_data_2024-09-05T_152536Z.root.ext.json
-rw-r--r--. 1 dune osgvo 0 Sep 5 11:11 000590_reco_data_2024-08-16T_162554Z_reco_data_2024-08-19T_112741Z_reco_data_2024-08-20T_123408Z_reco_data_2024-08-22T_093256Z_reco_data_2024-09-05T_152536Z.root.json
-rw-r--r--. 1 dune osgvo 0 Sep 5 10:25 debugprod.log 