Jobsub ID 66569.34@justin-prod-sched02.dune.hep.ac.uk
Jobscript log (last 10,000 characters)
AFM reco2 jobscript.
Input PFN = root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/usertests/9e/49/000732_reco_data_2024-08-16T_162803Z_reco_data_2024-08-19T_140943Z_reco_data_2024-08-20T_124959Z_reco_data_2024-08-22T_093236Z.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e20-p3913-prof/lib/libXrdPosixPreload.so
=== Start last 50 lines of lar log file ===
reco:pmtrack:PMAlgTrackMaker 0.000855125 6.26433 18.4742 1.52339 7.85985 6
reco:pmtrackcalo:Calorimetry 6.8289e-05 0.0128763 0.0530846 0.00448845 0.0186648 6
reco:pmtrackpid:Chi2ParticleID 2.8062e-05 0.000460936 0.00164993 0.000181193 0.000565007 6
reco:pmtrajfit:PMAlgTrajFitter 0.0177916 3.12031 12.9619 0.688505 4.61254 6
reco:pmtrajfitcalo:Calorimetry 0.000327649 0.065259 0.329891 0.00663719 0.119452 6
reco:pmtrajfitpid:Chi2ParticleID 7.8147e-05 0.000888971 0.00337567 0.000274168 0.00116793 6
reco:pmtracktc:PMAlgTrackMaker 0.0023688 5.74203 23.4238 0.88957 8.53446 6
reco:pmtracktccalo:Calorimetry 0.000132931 0.00787533 0.0192447 0.00494899 0.00793483 6
reco:pmtracktcpid:Chi2ParticleID 4.8813e-05 0.00039795 0.00104541 0.000205232 0.000375439 6
reco:pmtrajfittc:PMAlgTrajFitter 0.0296088 2.55461 9.75858 0.804649 3.49269 6
reco:pmtrajfittccalo:Calorimetry 0.000226358 0.0266962 0.130469 0.00399104 0.0469839 6
reco:pmtrajfittcpid:Chi2ParticleID 6.6766e-05 0.000646286 0.0025599 0.000191592 0.000884266 6
reco:cvnmap:CVNMapper 2.9676e-05 0.0389897 0.0680174 0.0398854 0.0266969 6
reco:cvneva:CVNEvaluator 1.5961e-05 1.25972 3.20757 1.08079 0.957781 6
reco:energyrecnumu:EnergyReco 0.00443549 0.39129 1.79805 0.0566565 0.703857 5
reco:energyrecnue:EnergyReco 0.000584484 0.062311 0.270238 0.00470812 0.104764 5
reco:energyrecnc:EnergyReco 0.00296447 0.0653384 0.274843 0.00722078 0.10554 5
reco:ophit:OpHitFinder 0.186887 0.229856 0.270566 0.238236 0.0279642 5
reco:opflash:OpFlashFinder 0.000256835 0.00103318 0.00266653 0.000805461 0.000862294 5
reco:rns:RandomNumberSaver 2.2683e-05 7.75524e-05 0.000248499 3.8693e-05 8.57031e-05 5
[art]:TriggerResults:TriggerResultInserter 1.062e-05 1.63286e-05 3.6229e-05 1.1471e-05 9.96012e-06 5
end_path:out1:RootOutput 2.845e-06 8.6344e-06 2.0649e-05 6.793e-06 6.54751e-06 5
end_path:out1:RootOutput(write) 0.448004 0.586694 0.842719 0.53324 0.136649 5
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3426.45 MB
Peak resident set size usage (VmHWM): 1906.84 MB
====================================================================================================
%MSG-s ArtException: PostEndJob 05-Sep-2024 10:25:20 CDT ModuleEndJob
---- EventProcessorFailure BEGIN
EventProcessor: an exception occurred during current event processing
---- ScheduleExecutionFailure BEGIN
Path: ProcessingStopped.
---- StdException BEGIN
An exception was thrown while processing module EnergyReco/energyrecnumu run: 20000031 subRun: 0 event: 623
vector::_M_range_check: __n (which is 37) >= this->size() (which is 19)
---- StdException END
Exception going through path reco
---- ScheduleExecutionFailure END
---- EventProcessorFailure END
---- FatalRootError BEGIN
Fatal Root Error: TTree::SetEntries
Tree branches have different numbers of entries, eg EventAuxiliary has 5 entries while sim::OpDetDivRecs_opdigi__detsim. has 15 entries.
ROOT severity: 2000
---- FatalRootError END
%MSG
Art has completed and will exit with status 1.
=== End last 50 lines of lar log file ===
lar exit code 0
Traceback (most recent call last):
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_03d00/bin/extractor_prod.py", line 434, in <module>
main()
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_03d00/bin/extractor_prod.py", line 373, in main
mddict = expSpecificMetadata.getmetadata()
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_03d00/bin/extractor_prod.py", line 344, in getmetadata
jobt = self.get_job(proc)
File "/cvmfs/dune.opensciencegrid.org/products/dune/duneutil/v09_75_03d00/bin/extractor_prod.py", line 69, in get_job
raise RuntimeError('sam_metadata_dumper returned nonzero exit status {}.'.format(rc))
RuntimeError: sam_metadata_dumper returned nonzero exit status 1.
extractor_prod.py exit code 1
Error reading metadata from file: Expecting value: line 1 column 1 (char 0)
pdjson2metadata exit code 1
.:
total 223072
-rw-r--r-- 1 slot1_8 slot1_8 227538519 Sep 5 10:25 RootOutput-a777-04b2-9537-b8dc.root
-rw-r--r-- 1 slot1_8 slot1_8 856454 Sep 5 10:25 000732_reco_data_2024-08-16T_162803Z_reco_data_2024-08-19T_140943Z_reco_data_2024-08-20T_124959Z_reco_data_2024-08-22T_093236Z_reco_2024-09-05T_152025Z.log
-rw-r--r-- 1 slot1_8 slot1_8 7560 Sep 5 10:25 reco2_hist.root
-rw-r--r-- 1 slot1_8 slot1_8 6005 Sep 5 10:25 jobscript.log
-rw-r--r-- 1 slot1_8 slot1_8 284 Sep 5 10:20 all-input-dids.txt
-rw-r--r-- 1 slot1_8 slot1_8 0 Sep 5 10:25 000732_reco_data_2024-08-16T_162803Z_reco_data_2024-08-19T_140943Z_reco_data_2024-08-20T_124959Z_reco_data_2024-08-22T_093236Z_reco_data_2024-09-05T_152025Z.root.ext.json
-rw-r--r-- 1 slot1_8 slot1_8 0 Sep 5 10:25 000732_reco_data_2024-08-16T_162803Z_reco_data_2024-08-19T_140943Z_reco_data_2024-08-20T_124959Z_reco_data_2024-08-22T_093236Z_reco_data_2024-09-05T_152025Z.root.json
-rw-r--r-- 1 slot1_8 slot1_8 0 Sep 5 10:20 debugprod.log 