justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 168732.3@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID168732.3@justin-prod-sched02.dune.hep.ac.uk
Workflow ID5894
Stage ID1
User namewalkerj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes13631488000 (13000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-04-02 08:53:32
SiteUS_FNAL-T1
EntryCMSHTPC_T1_US_FNAL_condce_opp1_whole
Last heartbeat2025-04-02 09:46:49
From worker nodeHostnamedunegli-40756-0-cmswn5029.fnal.gov
cpuinfoAMD EPYC 7543 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes13631488000 (13000 MiB)
Wall seconds limit171000 (47 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-04-02 08:57:43
Input filesprotodune-sp:np04_raw_run011655_0002_dl9.root
JobscriptExit code0
Real time48m (2907s)
CPU time47m (2867s = 98%)
Max RSS bytes12636352512 (12050 MiB)
Outputting started2025-04-02 09:46:11
Output filesusertests:np04_raw_run011655_0002_dl9_reco1_2025-04-02T_085746Z.root
Finished2025-04-02 09:46:49
Saved logsjustin-logs:168732.3-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/protodune-sp/bb/c7/np04_raw_run011655_0002_dl9.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v09_82_00
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00
MRB_SOURCE=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/srcs
MRB_BUILDDIR=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof

PRODUCTS=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/exp/dune/app/users/walkerj/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof

local product directory is /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e26-p3913-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
decode:pandora2Track:LArPandoraTrackCreation       2.73368       6.28604       12.1454       5.94354       1.95741        27     
decode:TrackRemoval:TrackRemoval                  0.114508      0.248042      0.646244      0.211855      0.106927        27     
[art]:TriggerResults:TriggerResultInserter       1.6091e-05    2.50403e-05   8.1066e-05    2.1081e-05    1.30949e-05      27     
end_path:out1:RootOutput                          3.657e-06    6.23819e-06   2.7382e-05     5.009e-06    4.43507e-06      27     
end_path:out1:RootOutput(write)                   0.451492      0.684766      0.902352      0.666977      0.104208        27     
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21977.3 MB
  Peak resident set size usage (VmHWM): 12636.4 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 27
ToolBasedRawDigitPrepService:dtor:  Call count: 162
ToolBasedRawDigitPrepService:dtor: Time report for 12 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.12 sec/event
ToolBasedRawDigitPrepService:dtor:          pdsp_sticky_codes_ped:   0.03 sec/event
ToolBasedRawDigitPrepService:dtor:              pd_adcPedestalFit:   4.07 sec/event
ToolBasedRawDigitPrepService:dtor:           adcSampleCalibration:   0.23 sec/event
ToolBasedRawDigitPrepService:dtor:            pdsp_gainCorrection:   0.03 sec/event
ToolBasedRawDigitPrepService:dtor:               pdsp_adcMitigate:   0.30 sec/event
ToolBasedRawDigitPrepService:dtor:            pdsp_timingMitigate:   0.01 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   2.14 sec/event
ToolBasedRawDigitPrepService:dtor:            pdsp_noiseRemovalKe:   7.43 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.09 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.00 sec/event
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2025-04-03 08:14:21 UTC       justIN version: 01.03.00