Jobsub ID 66569.89@justin-prod-sched02.dune.hep.ac.uk
Jobscript log (last 10,000 characters)
AFM reco2 jobscript.
Input PFN = root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/67/39/000537_reco_data_2024-08-16T_162447Z_reco_data_2024-08-19T_110241Z_reco_data_2024-08-20T_101432Z_reco_data_2024-08-22T_092657Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e20-p3913-prof/lib/libXrdPosixPreload.so
=== Start last 50 lines of lar log file ===
reco:pmtrack:PMAlgTrackMaker 0.000499439 34.0558 162.207 3.48019 64.0947 5
reco:pmtrackcalo:Calorimetry 5.2899e-05 0.22884 1.1284 0.00136377 0.449813 5
reco:pmtrackpid:Chi2ParticleID 2.4035e-05 0.000920594 0.00396576 0.00018634 0.00152731 5
reco:pmtrajfit:PMAlgTrajFitter 0.00879923 6.91857 25.4878 4.03083 9.42986 5
reco:pmtrajfitcalo:Calorimetry 9.3165e-05 0.43075 2.0863 0.0148508 0.827973 5
reco:pmtrajfitpid:Chi2ParticleID 3.0628e-05 0.00124583 0.00495362 0.000317707 0.00187011 5
reco:pmtracktc:PMAlgTrackMaker 0.000473019 38.4201 183.437 4.03271 72.5301 5
reco:pmtracktccalo:Calorimetry 6.0835e-05 0.0762011 0.364048 0.00106384 0.144027 5
reco:pmtracktcpid:Chi2ParticleID 2.0298e-05 0.000688214 0.0027915 0.000176112 0.00105715 5
reco:pmtrajfittc:PMAlgTrajFitter 0.000154931 19.5884 91.0797 2.42645 35.7668 5
reco:pmtrajfittccalo:Calorimetry 4.6697e-05 0.29331 1.43261 0.0138821 0.569695 5
reco:pmtrajfittcpid:Chi2ParticleID 1.9868e-05 0.00126222 0.00543891 0.000269657 0.00209421 5
reco:cvnmap:CVNMapper 2.2262e-05 0.0201444 0.0442451 0.0192491 0.0149556 5
reco:cvneva:CVNEvaluator 1.1572e-05 0.833013 2.01659 0.718985 0.653788 5
reco:energyrecnumu:EnergyReco 0.00409065 0.511741 1.94842 0.0472255 0.829931 4
reco:energyrecnue:EnergyReco 0.000352063 0.412405 1.60987 0.0196992 0.691444 4
reco:energyrecnc:EnergyReco 0.00144086 0.41521 1.61882 0.0202895 0.69499 4
reco:ophit:OpHitFinder 0.0583583 0.0744142 0.0900556 0.0746214 0.012621 4
reco:opflash:OpFlashFinder 0.000261502 0.000977625 0.00254099 0.000554002 0.000913947 4
reco:rns:RandomNumberSaver 2.3595e-05 6.51327e-05 0.000186041 2.54475e-05 6.98108e-05 4
[art]:TriggerResults:TriggerResultInserter 8.837e-06 1.3756e-05 2.8013e-05 9.087e-06 8.23202e-06 4
end_path:out1:RootOutput 2.695e-06 6.85775e-06 1.4898e-05 4.919e-06 4.76645e-06 4
end_path:out1:RootOutput(write) 0.222622 0.486427 1.08398 0.319553 0.347332 4
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4020.29 MB
Peak resident set size usage (VmHWM): 2438.84 MB
====================================================================================================
%MSG-s ArtException: PostEndJob 05-Sep-2024 12:12:45 EDT ModuleEndJob
---- EventProcessorFailure BEGIN
EventProcessor: an exception occurred during current event processing
---- ScheduleExecutionFailure BEGIN
Path: ProcessingStopped.
---- StdException BEGIN
An exception was thrown while processing module EnergyReco/energyrecnumu run: 20000031 subRun: 0 event: 132
vector::_M_range_check: __n (which is 14) >= this->size() (which is 9)
---- StdException END
Exception going through path reco
---- ScheduleExecutionFailure END
---- EventProcessorFailure END
---- FatalRootError BEGIN
Fatal Root Error: TTree::SetEntries
Tree branches have different numbers of entries, eg EventAuxiliary has 4 entries while sim::OpDetDivRecs_opdigi__detsim. has 10 entries.
ROOT severity: 2000
---- FatalRootError END
%MSG
Art has completed and will exit with status 1.
=== End last 50 lines of lar log file ===
lar exit code 0
Traceback (most recent call last):
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_03d00/bin/extractor_prod.py", line 434, in <module>
main()
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_03d00/bin/extractor_prod.py", line 373, in main
mddict = expSpecificMetadata.getmetadata()
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_03d00/bin/extractor_prod.py", line 344, in getmetadata
jobt = self.get_job(proc)
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_03d00/bin/extractor_prod.py", line 69, in get_job
raise RuntimeError('sam_metadata_dumper returned nonzero exit status {}.'.format(rc))
RuntimeError: sam_metadata_dumper returned nonzero exit status 1.
extractor_prod.py exit code 1
Error reading metadata from file: Expecting value: line 1 column 1 (char 0)
pdjson2metadata exit code 1
.:
total 831092
-rw-r--r-- 1 dune osgvo 846598430 Sep 5 12:12 RootOutput-09a0-8b23-584d-b780.root
-rw-r--r-- 1 dune osgvo 4405886 Sep 5 12:12 000537_reco_data_2024-08-16T_162447Z_reco_data_2024-08-19T_110241Z_reco_data_2024-08-20T_101432Z_reco_data_2024-08-22T_092657Z_reco_2024-09-05T_152633Z.log
-rw-r--r-- 1 dune osgvo 7560 Sep 5 12:12 reco2_hist.root
-rw-r--r-- 1 dune osgvo 6004 Sep 5 12:12 jobscript.log
-rw-r--r-- 1 dune osgvo 284 Sep 5 11:26 all-input-dids.txt
-rw-r--r-- 1 dune osgvo 0 Sep 5 12:12 000537_reco_data_2024-08-16T_162447Z_reco_data_2024-08-19T_110241Z_reco_data_2024-08-20T_101432Z_reco_data_2024-08-22T_092657Z_reco_data_2024-09-05T_152633Z.root.ext.json
-rw-r--r-- 1 dune osgvo 0 Sep 5 12:12 000537_reco_data_2024-08-16T_162447Z_reco_data_2024-08-19T_110241Z_reco_data_2024-08-20T_101432Z_reco_data_2024-08-22T_092657Z_reco_data_2024-09-05T_152633Z.root.json
-rw-r--r-- 1 dune osgvo 0 Sep 5 11:26 debugprod.log 