Jobsub ID 108779.38@justin-prod-sched02.dune.hep.ac.uk
Jobscript log (last 10,000 characters)
11:12 GMT run: 50261805 subRun: 1 event: 12102
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrackMaker:pmtracktc@BeginModule 23-Nov-2024 05:11:12 GMT run: 50261805 subRun: 1 event: 12102
Comparing two wires in the same plane: return failure
%MSG
%MSG-e WireIDIntersectionCheck: PMAlgTrajFitter:pmtrajfittc@BeginModule 23-Nov-2024 05:11:12 GMT run: 50261805 subRun: 1 event: 12102
1st wire C:0 T:1 P:2 W:871 does not exist (max wire number: 480)
%MSG
Boundary wire vector sizes: 38, 39, 36
minwire 0: 716
minwire 1: 2684
minwire 2: 5
Used alternate method to get min and max wires due to vertex determination failure: 31, 230
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 246, 445
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Used alternate method to get min and max wires due to vertex determination failure: 95, 294
Used alternate method to get min and max tdcs due to vertex determination failure: 0, 199
Could not find serving_default in model signatures.
[libprotobuf FATAL /cvmfs/larsoft.opensciencegrid.org/products/protobuf/v3_21_12a/Linux64bit+3.10-2.17-e26/include/google/protobuf/map.h:1300] CHECK failed: it != end(): key not found: serving_default
23-Nov-2024 05:11:37 GMT Closed input file "root://xrootd1.esc.qmul.ac.uk:1094//dune/RSE/fardet-hd/3f/09/atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50261805_121_20231122T093319Z_gen_g4_detsim_hitreco__20240503T055927Z_reco2.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 0.00321609 115.094 230.185 115.094 115.091 2
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00321609 0.0067391 0.0102621 0.0067391 0.00352301 2
reco:linecluster:LineCluster 0.0331424 0.059664 0.0861855 0.059664 0.0265216 2
reco:trajcluster:TrajCluster 0.0109329 0.0837436 0.156554 0.0837436 0.0728106 2
reco:pandora:StandardPandora 0.0404127 113.989 227.937 113.989 113.948 2
reco:pandoraTrack:LArPandoraTrackCreation 0.000116938 0.00130737 0.00249779 0.00130737 0.00119043 2
reco:pandoraShower:LArPandoraModularShowerCreation 0.00024057 0.00175027 0.00325998 0.00175027 0.0015097 2
reco:pandoracalo:Calorimetry 0.000101239 0.000690697 0.00128015 0.000690697 0.000589457 2
reco:pandorapid:Chi2ParticleID 3.8512e-05 0.000382385 0.000726258 0.000382385 0.000343873 2
reco:trkshowersplit:TrackShowerHits 0.000230231 0.00115104 0.00207186 0.00115104 0.000920812 2
reco:pmtrack:PMAlgTrackMaker 0.0191368 0.020925 0.0227132 0.020925 0.0017882 2
reco:pmtrackcalo:Calorimetry 0.00042215 0.00122061 0.00201908 0.00122061 0.000798464 2
reco:pmtrackpid:Chi2ParticleID 9.4006e-05 0.000500176 0.000906345 0.000500176 0.00040617 2
reco:pmtrajfit:PMAlgTrajFitter 0.000212568 0.000987718 0.00176287 0.000987718 0.000775149 2
reco:pmtrajfitcalo:Calorimetry 6.456e-05 6.7446e-05 7.0332e-05 6.7446e-05 2.886e-06 2
reco:pmtrajfitpid:Chi2ParticleID 2.7862e-05 2.9385e-05 3.0908e-05 2.9385e-05 1.523e-06 2
reco:pmtracktc:PMAlgTrackMaker 0.00775051 0.0182479 0.0287454 0.0182479 0.0104974 2
reco:pmtracktccalo:Calorimetry 0.000152355 0.000221794 0.000291234 0.000221794 6.94395e-05 2
reco:pmtracktcpid:Chi2ParticleID 5.2308e-05 6.50415e-05 7.7775e-05 6.50415e-05 1.27335e-05 2
reco:pmtrajfittc:PMAlgTrajFitter 0.0118198 0.0408661 0.0699123 0.0408661 0.0290462 2
reco:pmtrajfittccalo:Calorimetry 0.00018174 0.000276722 0.000371705 0.000276722 9.49825e-05 2
reco:pmtrajfittcpid:Chi2ParticleID 5.6435e-05 7.4389e-05 9.2343e-05 7.4389e-05 1.7954e-05 2
reco:blurredcluster:BlurredClustering 0.0427492 0.160731 0.278714 0.160731 0.117982 2
reco:emtrkmichelid:EmTrackMichelId 0.221987 0.581593 0.941199 0.581593 0.359606 2
reco:emshower:EMShower 0.000254525 0.00151764 0.00278076 0.00151764 0.00126312 2
reco:cvnmap:CVNMapper 0.000189093 0.00938574 0.0185824 0.00938574 0.00919665 2
reco:cvneva:CVNEvaluator 0.000238456 0.000238456 0.000238456 0.000238456 0 1
reco:energyrecnumu:EnergyReco 0.00462399 0.00462399 0.00462399 0.00462399 0 1
reco:energyrecnue:EnergyReco 0.00244293 0.00244293 0.00244293 0.00244293 0 1
reco:energyrecnc:EnergyReco 0.00239673 0.00239673 0.00239673 0.00239673 0 1
reco:energyrecnumurange:EnergyReco 0.0024833 0.0024833 0.0024833 0.0024833 0 1
reco:energyrecnumumcs:EnergyReco 0.00248007 0.00248007 0.00248007 0.00248007 0 1
reco:opdec:Deconvolution 0.234053 0.234053 0.234053 0.234053 0 1
reco:ophitspe:OpHitFinderDeco 1.35154 1.35154 1.35154 1.35154 0 1
reco:opflash:OpFlashFinder 0.00396413 0.00396413 0.00396413 0.00396413 0 1
reco:rns:RandomNumberSaver 0.000291074 0.000291074 0.000291074 0.000291074 0 1
reco:anglereconue:NuAngularReco 0.000892479 0.000892479 0.000892479 0.000892479 0 1
reco:anglereconumu:NuAngularReco 0.000159659 0.000159659 0.000159659 0.000159659 0 1
reco:anglereconuepfps:NuAngularReco 0.00123838 0.00123838 0.00123838 0.00123838 0 1
reco:anglereconumupfps:NuAngularReco 0.000200214 0.000200214 0.000200214 0.000200214 0 1
[art]:TriggerResults:TriggerResultInserter 4.9873e-05 4.9873e-05 4.9873e-05 4.9873e-05 0 1
end_path:out1:RootOutput 1.7372e-05 1.7372e-05 1.7372e-05 1.7372e-05 0 1
end_path:out1:RootOutput(write) 0.0645952 0.0645952 0.0645952 0.0645952 0 1
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 37136.2 MB
Peak resident set size usage (VmHWM): 1147.02 MB
====================================================================================================
%MSG-s ArtException: PostEndJob 23-Nov-2024 05:11:37 GMT ModuleEndJob
---- EventProcessorFailure BEGIN
EventProcessor: an exception occurred during current event processing
---- ScheduleExecutionFailure BEGIN
Path: ProcessingStopped.
---- StdException BEGIN
An exception was thrown while processing module CVNEvaluator/cvneva run: 50261805 subRun: 1 event: 12102
CHECK failed: it != end(): key not found: serving_default
---- StdException END
Exception going through path reco
---- ScheduleExecutionFailure END
---- EventProcessorFailure END
---- FatalRootError BEGIN
Fatal Root Error: TTree::SetEntries
Tree branches have different numbers of entries, eg EventAuxiliary has 1 entries while sim::OpDetDivRecs_opdigi__detsim. has 100 entries.
ROOT severity: 2000
---- FatalRootError END
%MSG
Art has completed and will exit with status 1.
=== End last 100 lines of lar log file ===
RootOutput-7bb1-039b-672a-2f04.root
Validation_ccnc_atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50261805_121_20231122T093319Z_gen_g4_detsim_hitreco__20240503T055927Z_reco2.root
all-input-dids.txt
atmnu_max_weighted_randompolicy_dune10kt_1x2x6_50261805_121_20231122T093319Z_gen_g4_detsim_hitreco__20240503T055927Z_reco2_reco_2024-11-23T_050529Z.log
debugprod.log
jobscript.log
justin-processed-pfns.txt
reco2_hist.root
MyPandoraSettings_Master_Atmos_DUNEFD.xml
MyPandoraSettings_Master_DUNEFD.xml
build_slf7.x86_64
localProducts_larsoft_v09_91_02_e26_prof
setup_env-testreco.sh
srcs
temp.txt
temp2.txt
test
work 