Jobsub ID 98316.42@justin-prod-sched02.dune.hep.ac.uk
Jobsub ID | 98316.42@justin-prod-sched02.dune.hep.ac.uk |
Workflow ID | 4114 |
Stage ID | 1 |
User name | gvittist@fnal.gov |
HTCondor Group | group_dune |
Requested | Processors | 1 |
RSS bytes | 4194304000 (4000 MiB) |
Wall seconds limit | 18000 (5 hours) |
Submitted time | 2024-11-16 01:05:30 |
Site | NL_SURFsara |
Entry | DUNE_SurfSARA_arc03 |
Last heartbeat | 2024-11-16 01:28:14 |
From worker node | Hostname | wn-da-61.gina.surfsara.nl |
cpuinfo | AMD EPYC 7702P 64-Core Processor |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 4194304000 (4000 MiB) |
Wall seconds limit | 129600 (36 hours) |
Inner Apptainer? | True |
Job state | stalled |
Allocator name | justin-allocator-pro.dune.hep.ac.uk |
Started | 2024-11-16 01:07:50 |
Input files | hd-protodune:np04hd_raw_run029197_0856_dataflow7_datawriter_0_20240916T235700.hdf5
|
Outputting started | 2024-11-16 01:28:14 |
Output files | |
Finished | 2024-11-16 02:05:42 |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
Input PFN = root://eospublic.cern.ch:1094//eos/experiment/neutplatform/protodune/dune/hd-protodune/1f/b4/np04hd_raw_run029197_0856_dataflow7_datawriter_0_20240916T235700.hdf5
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: raw with 10240 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "raw"
wclsFrameSaver: found empty channel masks for "bad"
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: raw with 10240 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "raw"
wclsFrameSaver: found empty channel masks for "bad"
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
WARNING: Could not find offline channel for 9 0 32
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: raw with 10240 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "raw"
wclsFrameSaver: found empty channel masks for "bad"
16-Nov-2024 02:28:13 CET Closed output file "np04hd_raw_run029197_0856_dataflow7_datawriter_0_20240916T235700_reco_2024-10-27T_010758Z.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 34.2716 37.7609 44.8352 37.2663 2.76218 31
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 2.4788e-05 3.21436e-05 0.000125779 2.7473e-05 1.79321e-05 31
produce:tpcrawdecoder:PDHDTPCReader 8.51818 11.6408 18.425 11.3799 2.54134 31
produce:triggerrawdecoder:PDHDTriggerReader3 0.46002 0.487493 0.600641 0.483309 0.0249564 31
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0170663 0.019102 0.0359059 0.0174608 0.00446229 31
produce:pdhddaphne:DAPHNEReaderPDHD 6.31836 6.97564 9.12219 6.81955 0.595758 31
produce:fembfilter:PDHDFEMBFilter 0.000111042 0.000135848 0.000482549 0.000122584 6.37251e-05 31
produce:wclsdatahdfilter:WireCellToolkit 13.1554 13.9456 14.6236 14.0077 0.315512 31
[art]:TriggerResults:TriggerResultInserter 1.5519e-05 2.47779e-05 8.1174e-05 2.1591e-05 1.33636e-05 31
end_path:out1:RootOutput 3.496e-06 5.00239e-06 2.1631e-05 4.198e-06 3.39484e-06 31
end_path:out1:RootOutput(write) 4.42432 4.69085 5.12692 4.68898 0.13586 31
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3246.36 MB
Peak resident set size usage (VmHWM): 1637.01 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0