justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 285092.80@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID285092.80@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3958
Stage ID1
User namegvittist@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-11-06 19:51:17
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce03
Last heartbeat2024-11-06 20:10:00
From worker nodeHostnameccwcondor0660
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit106200 (29 hours)
Inner Apptainer?True
Job statestalled
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-06 19:53:02
Input fileshd-protodune:np04hd_raw_run029107_1685_dataflow0_datawriter_0_20240907T191809.hdf5
Outputting started2024-11-06 20:10:00
Output files
Finished2024-11-06 20:51:27
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = root://eospublic.cern.ch:1094//eos/experiment/neutplatform/protodune/dune/hd-protodune/72/22/np04hd_raw_run029107_1685_dataflow0_datawriter_0_20240907T191809.hdf5
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
WARNING: Could not find offline channel for 13 0 4
WARNING: Could not find offline channel for 13 0 6
WARNING: Could not find offline channel for 13 0 10
WARNING: Could not find offline channel for 13 0 11
WARNING: Could not find offline channel for 13 0 12
WARNING: Could not find offline channel for 13 0 13
WARNING: Could not find offline channel for 13 0 16
WARNING: Could not find offline channel for 13 0 17
WARNING: Could not find offline channel for 13 0 20
WARNING: Could not find offline channel for 13 0 21
WARNING: Could not find offline channel for 13 0 22
WARNING: Could not find offline channel for 13 0 23
WARNING: Could not find offline channel for 13 0 24
WARNING: Could not find offline channel for 13 0 25
WARNING: Could not find offline channel for 13 0 26
WARNING: Could not find offline channel for 13 0 27
WARNING: Could not find offline channel for 13 0 30
WARNING: Could not find offline channel for 13 0 31
WARNING: Could not find offline channel for 13 0 32
WARNING: Could not find offline channel for 13 0 33
WARNING: Could not find offline channel for 13 0 34
WARNING: Could not find offline channel for 13 0 35
WARNING: Could not find offline channel for 13 0 36
WARNING: Could not find offline channel for 13 0 37
WARNING: Could not find offline channel for 13 0 40
WARNING: Could not find offline channel for 13 0 41
WARNING: Could not find offline channel for 13 0 42
WARNING: Could not find offline channel for 13 0 43
WARNING: Could not find offline channel for 13 0 44
WARNING: Could not find offline channel for 13 0 45
WARNING: Could not find offline channel for 13 0 46
WARNING: Could not find offline channel for 13 0 47
WARNING: Could not find offline channel for 13 0 12
WARNING: Could not find offline channel for 13 0 13
WARNING: Could not find offline channel for 13 0 3
WARNING: Could not find offline channel for 13 0 4
WARNING: Could not find offline channel for 13 0 6
WARNING: Could not find offline channel for 13 0 10
WARNING: Could not find offline channel for 13 0 11
WARNING: Could not find offline channel for 13 0 14
WARNING: Could not find offline channel for 13 0 15
WARNING: Could not find offline channel for 13 0 16
WARNING: Could not find offline channel for 13 0 17
WARNING: Could not find offline channel for 13 0 20
WARNING: Could not find offline channel for 13 0 21
WARNING: Could not find offline channel for 13 0 22
WARNING: Could not find offline channel for 13 0 23
WARNING: Could not find offline channel for 13 0 24
WARNING: Could not find offline channel for 13 0 25
WARNING: Could not find offline channel for 13 0 26
WARNING: Could not find offline channel for 13 0 27
WARNING: Could not find offline channel for 13 0 30
WARNING: Could not find offline channel for 13 0 31
WARNING: Could not find offline channel for 13 0 32
WARNING: Could not find offline channel for 13 0 33
WARNING: Could not find offline channel for 13 0 34
WARNING: Could not find offline channel for 13 0 35
WARNING: Could not find offline channel for 13 0 36
WARNING: Could not find offline channel for 13 0 37
WARNING: Could not find offline channel for 13 0 40
WARNING: Could not find offline channel for 13 0 41
WARNING: Could not find offline channel for 13 0 42
WARNING: Could not find offline channel for 13 0 43
WARNING: Could not find offline channel for 13 0 44
WARNING: Could not find offline channel for 13 0 45
WARNING: Could not find offline channel for 13 0 46
WARNING: Could not find offline channel for 13 0 47
WARNING: Could not find offline channel for 13 0 1
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: raw with 10240 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "raw"
wclsFrameSaver: found empty channel masks for "bad"
06-Nov-2024 21:09:59 CET  Closed output file "np04hd_raw_run029107_1685_dataflow0_datawriter_0_20240907T191809_reco_2024-10-17T_195306Z.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                         29.9942       32.5665       44.9152       32.1259       2.6632         30     
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       4.0215e-05    6.55092e-05   0.00028055    5.4633e-05    4.42373e-05      30     
produce:tpcrawdecoder:PDHDTPCReader                4.61711       5.83663       18.9746       5.07077       2.69131        30     
produce:triggerrawdecoder:PDHDTriggerReader3      0.0782151     0.0910627     0.168897      0.0862306     0.0163881       30     
produce:timingrawdecoder:PDHDTimingRawDecoder    0.00275658    0.00308413    0.00526603     0.0029681    0.000434699      30     
produce:pdhddaphne:DAPHNEReaderPDHD                5.71606        6.254        6.77852       6.22756      0.320854        30     
produce:fembfilter:PDHDFEMBFilter                0.000122872   0.000254955   0.00102888    0.000171969   0.000190564      30     
produce:wclsdatahdfilter:WireCellToolkit           13.7062       14.6586       15.9394       14.6924      0.540042        30     
[art]:TriggerResults:TriggerResultInserter       2.6019e-05    4.31702e-05   0.000107974   4.0882e-05    1.43295e-05      30     
end_path:out1:RootOutput                          6.281e-06    8.6893e-06     3.212e-05     7.714e-06    4.50895e-06      30     
end_path:out1:RootOutput(write)                    4.89505       5.72107       6.45238       5.69957      0.437011        30     
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3284.64 MB
  Peak resident set size usage (VmHWM): 1789.97 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2024-11-23 15:39:17 UTC       justIN version: 01.01.09