justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 277415.2@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID277415.2@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3718
Stage ID1
User namebbehera@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes8388608000 (8000 MiB)
Wall seconds limit14600 (4 hours)
Submitted time2024-10-19 11:47:39
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2024-10-19 14:00:51
From worker nodeHostnamewn1206240.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes8388608000 (8000 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-19 11:49:27
Input filesmonte-carlo-003718-000007
JobscriptExit code0
Real time2h (7846s)
CPU time2h (7572s = 96%)
Outputting started2024-10-19 14:00:14
Output files
Finished2024-10-19 14:00:51
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = 000007
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/

ERROR: MRB_INSTALL is not defined - please source localProducts_XXX/setup

/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
../justin-jobscript: line 94:  1562 Aborted                 (core dumped) lar -c $FCL_ANA -n -1 -s $outFile_reco -o $outFile_ana -T $outFile_ana_hist > ${fname}_ana_${now}.log 2>&1
=== Start last 100 lines of lar log file ===
  Max cluster timespan      : 50.0 ticks
  Min cluster overlap       :  0.5
  Clust match sigma-factor  :  0.8
  Clust match max dT        :  2.0 ticks
  Charge diff limit         : 10.0e3
  Charge ratio min          : 0.2
  pl0 matches per cand      : 1.02
  pl1 matches per cand      : 1.03

BlipAna Summary

  Total events                : 43
  Blips per evt, total        : 17.256
                 3 planes     : 13.395
  MC-matched blips per evt    : 15.302
  MC blip purity              : 0.887
  MC blip purity, 3 planes    : 0.891
  Charge completeness, total  : 0.0378 +/- 0.0029
  Mean blip charge            : 33262 e-

  Plane 0 -------------------------
   * total hits/evt           : 137.51
   * untracked hits/evt       : 137.51 (23.19 plane-matched)
   * true-matched hits/evt    : 134.74 (23.16 plane-matched)
   * hit purity               : 0.9776
  Plane 1 -------------------------
   * total hits/evt           : 320.12
   * untracked hits/evt       : 320.12 (24.51 plane-matched)
   * true-matched hits/evt    : 319.58 (24.49 plane-matched)
   * hit purity               : 0.9983
  Plane 2 -------------------------
   * total hits/evt           : 359.44
   * untracked hits/evt       : 359.44 (28.51 plane-matched)
   * true-matched hits/evt    : 359.40 (28.49 plane-matched)
   * hit purity               : 0.9999

***********************************************
19-Oct-2024 15:00:13 BST  Closed input file "000007_reco_2024-10-19T_114934Z.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                        0.00030278     0.103765      0.208168      0.0969816     0.0378057       43     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000260611   0.000348569    0.0010312    0.000322436   0.000114503      43     
end_path:pdblipana:BlipAna         0.0546115     0.105272      0.207326      0.096395      0.0346393       42     
end_path:out:RootOutput            4.999e-06    5.80979e-06    1.052e-05    5.6155e-06    8.34649e-07      42     
end_path:out:RootOutput(write)    0.000275268   0.000409032   0.00201026    0.00031364    0.000280692      42     
====================================================================================================================
%MSG-i NuRandomService:  BlipAna:pdblipana@EndJob 19-Oct-2024 15:00:13 BST  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'random'
  master seed: 569893832
  seed within: [ 1 ; 900000000 ]

%MSG

TrigReport ---------- Event summary -------------
TrigReport Events total = 43 passed = 43 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         43         42          1 pdblipana
TrigReport         42         42          0 out

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 30.054504 Real = 89.826078

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 18898.4 VmHWM = 770.474

%MSG-s ArtException:  PostEndJob 19-Oct-2024 15:00:13 BST ModuleEndJob
---- EventProcessorFailure BEGIN
  EventProcessor: an exception occurred during current event processing
  ---- EventProcessorFailure BEGIN
    EndPathExecutor: an exception occurred during current event processing
    ---- ScheduleExecutionFailure BEGIN
      Path: ProcessingStopped.
      ---- StdException BEGIN
        An exception was thrown while processing module BlipAna/pdblipana run: 1 subRun: 0 event: 43
        vector::_M_range_check: __n (which is 18446744073709551615) >= this->size() (which is 16)
      ---- StdException END
      Exception going through path end_path
    ---- ScheduleExecutionFailure END
  ---- EventProcessorFailure END
---- EventProcessorFailure END
---- FatalRootError BEGIN
  Fatal Root Error: TTree::SetEntries
  Tree branches have different numbers of entries, eg EventAuxiliary has 42 entries while art::TriggerResults_TriggerResults__Reco. has 100 entries.
  ROOT severity: 2000
---- FatalRootError END
%MSG
terminate called after throwing an instance of 'cet::coded_exception<art::errors::ErrorCodes, &art::ExceptionDetail::translate[abi:cxx11]>'
  what():  ---- FatalRootError BEGIN
  Fatal Root Error: TClass::LoadClassInfo
  no interpreter information for class TF1 is available even though it has a TClass initialization routine.
  ROOT severity: 3000
---- FatalRootError END

=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2024-11-24 02:49:25 UTC       justIN version: 01.01.09