justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 278632.81@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID278632.81@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3777
Stage ID1
User namedmunoz@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes8388608000 (8000 MiB)
Wall seconds limit14600 (4 hours)
Submitted time2024-10-22 22:40:41
SiteUS_UChicago
EntryEngage_US_MWT2_uiuc_gk02_condce_mcore
Last heartbeat2024-10-23 03:18:28
From worker nodeHostnameuct2-c493.mwt2.org
cpuinfoIntel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes8388608000 (8000 MiB)
Wall seconds limit86400 (24 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-22 22:52:43
Input filesmonte-carlo-003777-000087
JobscriptExit code0
Real time4h (15776s)
CPU time4h (15385s = 97%)
Outputting started2024-10-23 03:15:41
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/dmunoz/03777/1/000087_g4_stage1_2024-10-22T_225259Z.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/dmunoz/03777/1/000087_g4_stage2_2024-10-22T_225259Z.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/dmunoz/03777/1/000087_detsim_2024-10-22T_225259Z.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/dmunoz/03777/1/000087_gen_2024-10-22T_225259Z.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/dmunoz/03777/1/000087_ana_hist_2024-10-22T_225259Z.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/dmunoz/03777/1/RootOutput-78ad-043d-aa14-4c09.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/dmunoz/03777/1/000087_reco_2024-10-22T_225259Z.root
Finished2024-10-23 03:18:28
Saved logsjustin-logs:278632.81-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = 000087
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/

ERROR: MRB_INSTALL is not defined - please source localProducts_XXX/setup

/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
../justin-jobscript: line 94:  1561 Aborted                 (core dumped) lar -c $FCL_ANA -n -1 -s $outFile_reco -o $outFile_ana -T $outFile_ana_hist > ${fname}_ana_${now}.log 2>&1
=== Start last 100 lines of lar log file ===
  Max cluster timespan      : 50.0 ticks
  Min cluster overlap       :  0.5
  Clust match sigma-factor  :  0.8
  Clust match max dT        :  2.0 ticks
  Charge diff limit         : 10.0e3
  Charge ratio min          : 0.2
  pl0 matches per cand      : 1.03
  pl1 matches per cand      : 1.03

BlipAna Summary

  Total events                : 40
  Blips per evt, total        : 27.750
                 3 planes     : 21.825
  MC-matched blips per evt    : 25.100
  MC blip purity              : 0.905
  MC blip purity, 3 planes    : 0.903
  Charge completeness, total  : 0.1536 +/- 0.0388
  Mean blip charge            : 32933 e-

  Plane 0 -------------------------
   * total hits/evt           : 265.52
   * untracked hits/evt       : 265.52 (37.12 plane-matched)
   * true-matched hits/evt    : 261.80 (37.03 plane-matched)
   * hit purity               : 0.9852
  Plane 1 -------------------------
   * total hits/evt           : 656.22
   * untracked hits/evt       : 656.22 (38.83 plane-matched)
   * true-matched hits/evt    : 655.12 (38.80 plane-matched)
   * hit purity               : 0.9983
  Plane 2 -------------------------
   * total hits/evt           : 705.58
   * untracked hits/evt       : 705.58 (44.78 plane-matched)
   * true-matched hits/evt    : 705.53 (44.78 plane-matched)
   * hit purity               : 0.9999

***********************************************
22-Oct-2024 22:15:39 CDT  Closed input file "000087_reco_2024-10-22T_225259Z.root"

====================================================================================================================
TimeTracker printout (sec)            Min           Avg           Max         Median          RMS         nEvts   
====================================================================================================================
Full event                        0.000640606    0.547845       1.12499      0.526309      0.192702        40     
--------------------------------------------------------------------------------------------------------------------
source:RootInput(read)            0.000405731   0.000610782   0.00151831    0.000560349   0.00020056       40     
end_path:pdblipana:BlipAna         0.337865      0.560386       1.12287      0.530744      0.173528        39     
end_path:out:RootOutput            5.777e-06    8.25313e-06   2.3297e-05     7.745e-06    3.05649e-06      39     
end_path:out:RootOutput(write)     0.0003126    0.000598009   0.00309012    0.000458562   0.000466772      39     
====================================================================================================================
%MSG-i NuRandomService:  BlipAna:pdblipana@EndJob 22-Oct-2024 22:15:39 CDT  ModuleEndJob

Summary of seeds computed by the NuRandomService
Random policy: 'random'
  master seed: 230371439
  seed within: [ 1 ; 900000000 ]

%MSG

TrigReport ---------- Event summary -------------
TrigReport Events total = 40 passed = 40 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport         40         39          1 pdblipana
TrigReport         39         39          0 out

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 49.056992 Real = 66.326694

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 12468.8 VmHWM = 777.474

%MSG-s ArtException:  PostEndJob 22-Oct-2024 22:15:39 CDT ModuleEndJob
---- EventProcessorFailure BEGIN
  EventProcessor: an exception occurred during current event processing
  ---- EventProcessorFailure BEGIN
    EndPathExecutor: an exception occurred during current event processing
    ---- ScheduleExecutionFailure BEGIN
      Path: ProcessingStopped.
      ---- StdException BEGIN
        An exception was thrown while processing module BlipAna/pdblipana run: 1 subRun: 0 event: 40
        vector::_M_range_check: __n (which is 18446744073709551615) >= this->size() (which is 16)
      ---- StdException END
      Exception going through path end_path
    ---- ScheduleExecutionFailure END
  ---- EventProcessorFailure END
---- EventProcessorFailure END
---- FatalRootError BEGIN
  Fatal Root Error: TTree::SetEntries
  Tree branches have different numbers of entries, eg EventAuxiliary has 39 entries while art::TriggerResults_TriggerResults__Reco. has 100 entries.
  ROOT severity: 2000
---- FatalRootError END
%MSG
terminate called after throwing an instance of 'cet::coded_exception<art::errors::ErrorCodes, &art::ExceptionDetail::translate[abi:cxx11]>'
  what():  ---- FatalRootError BEGIN
  Fatal Root Error: TClass::LoadClassInfo
  no interpreter information for class TF1 is available even though it has a TClass initialization routine.
  ROOT severity: 3000
---- FatalRootError END

=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2024-11-23 22:27:14 UTC       justIN version: 01.01.09