justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 168732.5@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID168732.5@justin-prod-sched02.dune.hep.ac.uk
Workflow ID5894
Stage ID1
User namewalkerj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes13631488000 (13000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-04-02 08:53:32
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2025-04-02 09:43:30
From worker nodeHostnamedunegli-40756-0-cmswn5029.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes13631488000 (13000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-04-02 08:58:08
Input filesprotodune-sp:np04_raw_run011655_0002_dl5.root
JobscriptExit code0
Real time44m (2682s)
CPU time44m (2665s = 99%)
Max RSS bytes11606921216 (11069 MiB)
Outputting started2025-04-02 09:42:51
Output filesusertests:np04_raw_run011655_0002_dl5_reco1_2025-04-02T_085811Z.root
Finished2025-04-02 09:43:30
Saved logsjustin-logs:168732.5-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/protodune-sp/4e/c3/np04_raw_run011655_0002_dl5.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v09_82_00
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00
MRB_SOURCE=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/srcs
MRB_BUILDDIR=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof

PRODUCTS=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/exp/dune/app/users/walkerj/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof

local product directory is /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e26-p3913-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
decode:pandora2Track:LArPandoraTrackCreation       2.76597       5.81339       9.02846       5.57968       1.46686        27     
decode:TrackRemoval:TrackRemoval                  0.115055      0.241262       0.4012       0.218401      0.0753886       27     
[art]:TriggerResults:TriggerResultInserter       2.0189e-05    3.09528e-05   8.4282e-05    2.7683e-05    1.23313e-05      27     
end_path:out1:RootOutput                          5.029e-06    8.67841e-06   3.3825e-05     6.121e-06    5.68698e-06      27     
end_path:out1:RootOutput(write)                   0.506528      0.673226      0.855748      0.674155      0.0833597       27     
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21979.2 MB
  Peak resident set size usage (VmHWM): 11606.9 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 27
ToolBasedRawDigitPrepService:dtor:  Call count: 162
ToolBasedRawDigitPrepService:dtor: Time report for 12 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.12 sec/event
ToolBasedRawDigitPrepService:dtor:          pdsp_sticky_codes_ped:   0.03 sec/event
ToolBasedRawDigitPrepService:dtor:              pd_adcPedestalFit:   4.07 sec/event
ToolBasedRawDigitPrepService:dtor:           adcSampleCalibration:   0.23 sec/event
ToolBasedRawDigitPrepService:dtor:            pdsp_gainCorrection:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:               pdsp_adcMitigate:   0.30 sec/event
ToolBasedRawDigitPrepService:dtor:            pdsp_timingMitigate:   0.01 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   2.13 sec/event
ToolBasedRawDigitPrepService:dtor:            pdsp_noiseRemovalKe:   7.49 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.09 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.01 sec/event
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2025-04-03 08:14:22 UTC       justIN version: 01.03.00