justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 360195.16@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID360195.16@justin-prod-sched01.dune.hep.ac.uk
Workflow ID5894
Stage ID1
User namewalkerj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes13631488000 (13000 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-04-02 08:52:30
SiteUS_FNAL-FermiGrid
EntryFNAL_GPGrid_ce03_mcore_op_duneonly
Last heartbeat2025-04-02 09:50:42
From worker nodeHostnamedunegli-4378304-0-fnpc19126.fnal.gov
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes13631488000 (13000 MiB)
Wall seconds limit172800 (48 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-04-02 08:58:08
Input filesprotodune-sp:np04_raw_run011655_0003_dl9.root
JobscriptExit code0
Real time51m (3110s)
CPU time51m (3083s = 99%)
Max RSS bytes12989710336 (12387 MiB)
Outputting started2025-04-02 09:49:58
Output filesusertests:np04_raw_run011655_0003_dl9_reco1_2025-04-02T_085811Z.root
Finished2025-04-02 09:50:42
Saved logsjustin-logs:360195.16-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = root://fndca1.fnal.gov:1094/pnfs/fnal.gov/usr/dune/persistent/staging/protodune-sp/ee/2a/np04_raw_run011655_0003_dl9.root
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/

MRB_PROJECT=larsoft
MRB_PROJECT_VERSION=v09_82_00
MRB_QUALS=e26:prof
MRB_TOP=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00
MRB_SOURCE=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/srcs
MRB_BUILDDIR=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/build_slf7.x86_64
MRB_INSTALL=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof

PRODUCTS=/cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof:/cvmfs/dune.opensciencegrid.org/products/dune:/cvmfs/larsoft.opensciencegrid.org/products:/cvmfs/larsoft.opensciencegrid.org/packages:/cvmfs/fermilab.opensciencegrid.org/products/common/db/
CETPKG_INSTALL=/exp/dune/app/users/walkerj/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof

local product directory is /cvmfs/fifeuser3.opensciencegrid.org/sw/dune/db94055707bcdcf9f1ecafa647855eda4a6bbe26/my_v09_82_00/localProducts_larsoft_v09_82_00_e26_prof
----------- this block should be empty ------------------
---------------------------------------------------------
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_4_3b/Linux64bit+3.10-2.17-e26-p3913-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
decode:pandora2Track:LArPandoraTrackCreation       2.71322       9.54529       18.3857       8.62749       3.92475        27     
decode:TrackRemoval:TrackRemoval                  0.181798      0.335413      0.785921      0.314339       0.11836        27     
[art]:TriggerResults:TriggerResultInserter       1.7851e-05    2.84895e-05   6.3131e-05     2.453e-05    1.08866e-05      27     
end_path:out1:RootOutput                          2.68e-06     6.2863e-06     2.023e-05     3.98e-06     4.4233e-06       27     
end_path:out1:RootOutput(write)                   0.663164      0.950247       1.32381      0.965766      0.153574        27     
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 21660.2 MB
  Peak resident set size usage (VmHWM): 12989.7 MB
  Details saved in: 'mem.db'
====================================================================================================
ToolBasedRawDigitPrepService:dtor: Event count: 27
ToolBasedRawDigitPrepService:dtor:  Call count: 162
ToolBasedRawDigitPrepService:dtor: Time report for 12 tools.
ToolBasedRawDigitPrepService:dtor:                    digitReader:   0.11 sec/event
ToolBasedRawDigitPrepService:dtor:          pdsp_sticky_codes_ped:   0.03 sec/event
ToolBasedRawDigitPrepService:dtor:              pd_adcPedestalFit:   5.35 sec/event
ToolBasedRawDigitPrepService:dtor:           adcSampleCalibration:   0.28 sec/event
ToolBasedRawDigitPrepService:dtor:            pdsp_gainCorrection:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:               pdsp_adcMitigate:   0.37 sec/event
ToolBasedRawDigitPrepService:dtor:            pdsp_timingMitigate:   0.01 sec/event
ToolBasedRawDigitPrepService:dtor:          pdspTailPedRemovalZKe:   2.65 sec/event
ToolBasedRawDigitPrepService:dtor:            pdsp_noiseRemovalKe:   8.64 sec/event
ToolBasedRawDigitPrepService:dtor:         adcKeepAllSignalFinder:   0.13 sec/event
ToolBasedRawDigitPrepService:dtor:                adcScaleKeToAdc:   0.04 sec/event
ToolBasedRawDigitPrepService:dtor:         pdsp_RemoveBadChannels:   0.01 sec/event
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2025-04-03 07:46:37 UTC       justIN version: 01.03.00