justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 88832.93@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID88832.93@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3875
Stage ID1
User namebbehera@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes8388608000 (8000 MiB)
Wall seconds limit14600 (4 hours)
Submitted time2024-10-30 14:23:18
SiteUK_Liverpool
EntryDUNE_UK_Liverpool_hepgrid5
Last heartbeat2024-10-30 21:14:46
From worker nodeHostnamer23-n04.ph.liv.ac.uk
cpuinfoIntel(R) Xeon(R) CPU E5620 @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes8388608000 (8000 MiB)
Wall seconds limit259200 (72 hours)
Inner Apptainer?True
Job stateoutputting_failed
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-30 14:40:14
Input filesmonte-carlo-003875-000089
JobscriptExit code0
Real time3h (14159s)
CPU time3h (13787s = 97%)
Outputting started2024-10-30 18:36:14
Output files
Finished2024-10-30 21:14:46
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = 000089
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/

ERROR: MRB_INSTALL is not defined - please source localProducts_XXX/setup

/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
../justin-jobscript: line 97:  1130 Aborted                 (core dumped) lar -c $FCL_ANA -n -1 -s $outFile_reco -o $outFile_ana -T $outFile_ana_hist > ${fname}_ana_${now}.log 2>&1
=== Start last 100 lines of lar log file ===
  Max cluster timespan      : 50.0 ticks
  Min cluster overlap       :  0.5
  Clust match sigma-factor  :  0.8
  Clust match max dT        :  2.0 ticks
  Charge diff limit         : 10.0e3
  Charge ratio min          : 0.2
  pl0 matches per cand      : 1.04
  pl1 matches per cand      : 1.04

BlipAna Summary

  Total events                : 47
  Blips per evt, total        : 37.936
                 3 planes     : 28.298
  MC-matched blips per evt    : 34.021
  MC blip purity              : 0.897
  MC blip purity, 3 planes    : 0.899
  Charge completeness, total  : 0.2132 +/- 0.0410
  Mean blip charge            : 28786 e-

  Plane 0 -------------------------
   * total hits/evt           : 402.85
   * untracked hits/evt       : 402.85 (56.45 plane-matched)
   * true-matched hits/evt    : 286.00 (55.89 plane-matched)
   * hit purity               : 0.7045
  Plane 1 -------------------------
   * total hits/evt           : 1069.02
   * untracked hits/evt       : 1069.02 (58.96 plane-matched)
   * true-matched hits/evt    : 686.19 (58.28 plane-matched)
   * hit purity               : 0.6402
  Plane 2 -------------------------
   * total hits/evt           : 741.00
   * untracked hits/evt       : 741.00 (70.21 plane-matched)
   * true-matched hits/evt    : 739.17 (70.06 plane-matched)
   * hit purity               : 0.9975

***********************************************
30-Oct-2024 18:36:07 GMT  Closed input file "000089_reco_2024-10-30T_144042Z.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                        0.00043682     0.421232       0.77463      0.398095      0.145482        47     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.00028802    0.000474293   0.00120375    0.000427727   0.000167693      47     
end_path:pdblipana:BlipAna         0.226507      0.428705      0.773454       0.4033        0.13177        46     
end_path:out:RootOutput            5.051e-06    7.18611e-06   1.1202e-05      6.2e-06     1.95932e-06      46     
end_path:out:RootOutput(write)    0.000266382   0.000983926    0.025267     0.000468616   0.00362351       46     
====================================================================================================================
%MSG-i NuRandomService:  BlipAna:pdblipana@EndJob 30-Oct-2024 18:36:07 GMT  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'random'
  master seed: 862622913
  seed within: [ 1 ; 900000000 ]

%MSG

TrigReport ---------- Event summary -------------
TrigReport Events total = 47 passed = 47 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         47         46          1 pdblipana
TrigReport         46         46          0 out

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 35.656101 Real = 97.987356

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 3998.91 VmHWM = 718.733

%MSG-s ArtException:  PostEndJob 30-Oct-2024 18:36:08 GMT ModuleEndJob
---- EventProcessorFailure BEGIN
  EventProcessor: an exception occurred during current event processing
  ---- EventProcessorFailure BEGIN
    EndPathExecutor: an exception occurred during current event processing
    ---- ScheduleExecutionFailure BEGIN
      Path: ProcessingStopped.
      ---- StdException BEGIN
        An exception was thrown while processing module BlipAna/pdblipana run: 1 subRun: 0 event: 47
        vector::_M_range_check: __n (which is 18446744073709551615) >= this->size() (which is 16)
      ---- StdException END
      Exception going through path end_path
    ---- ScheduleExecutionFailure END
  ---- EventProcessorFailure END
---- EventProcessorFailure END
---- FatalRootError BEGIN
  Fatal Root Error: TTree::SetEntries
  Tree branches have different numbers of entries, eg EventAuxiliary has 46 entries while art::TriggerResults_TriggerResults__Reco. has 100 entries.
  ROOT severity: 2000
---- FatalRootError END
%MSG
terminate called after throwing an instance of 'cet::coded_exception<art::errors::ErrorCodes, &art::ExceptionDetail::translate[abi:cxx11]>'
  what():  ---- FatalRootError BEGIN
  Fatal Root Error: TClass::LoadClassInfo
  no interpreter information for class TF1 is available even though it has a TClass initialization routine.
  ROOT severity: 3000
---- FatalRootError END

=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2024-11-23 12:28:35 UTC       justIN version: 01.01.09