justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 89144.44@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID89144.44@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3883
Stage ID1
User namegvittist@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-31 12:26:29
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce505
Last heartbeat2024-10-31 13:31:26
From worker nodeHostnameb9g37p6281.cern.ch
cpuinfoIntel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4194304000 (4000 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-31 13:08:15
Input fileshd-protodune:np04hd_raw_run029006_2588_dataflow7_datawriter_0_20240901T092643.hdf5
Outputting started2024-10-31 13:29:29
Output files
Finished2024-10-31 13:31:26
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Input PFN = root://eospublic.cern.ch:1094//eos/experiment/neutplatform/protodune/dune/hd-protodune/b9/45/np04hd_raw_run029006_2588_dataflow7_datawriter_0_20240901T092643.hdf5
Setting up larsoft UPS area... /cvmfs/larsoft.opensciencegrid.org
Setting up DUNE UPS area... /cvmfs/dune.opensciencegrid.org/products/dune/
/cvmfs/larsoft.opensciencegrid.org/products/xrootd/v5_5_5a/Linux64bit+3.10-2.17-e26-p3915-prof/lib/libXrdPosixPreload.so
=== Start last 100 lines of lar log file ===
WARNING: Could not find offline channel for 13 0 6
WARNING: Could not find offline channel for 13 0 10
WARNING: Could not find offline channel for 13 0 11
WARNING: Could not find offline channel for 13 0 12
WARNING: Could not find offline channel for 13 0 13
WARNING: Could not find offline channel for 13 0 14
WARNING: Could not find offline channel for 13 0 15
WARNING: Could not find offline channel for 13 0 16
WARNING: Could not find offline channel for 13 0 17
WARNING: Could not find offline channel for 13 0 20
WARNING: Could not find offline channel for 13 0 21
WARNING: Could not find offline channel for 13 0 22
WARNING: Could not find offline channel for 13 0 23
WARNING: Could not find offline channel for 13 0 24
WARNING: Could not find offline channel for 13 0 25
WARNING: Could not find offline channel for 13 0 26
WARNING: Could not find offline channel for 13 0 27
WARNING: Could not find offline channel for 13 0 30
WARNING: Could not find offline channel for 13 0 31
WARNING: Could not find offline channel for 13 0 32
WARNING: Could not find offline channel for 13 0 33
WARNING: Could not find offline channel for 13 0 35
WARNING: Could not find offline channel for 13 0 36
WARNING: Could not find offline channel for 13 0 37
WARNING: Could not find offline channel for 13 0 40
WARNING: Could not find offline channel for 13 0 41
WARNING: Could not find offline channel for 13 0 42
WARNING: Could not find offline channel for 13 0 43
WARNING: Could not find offline channel for 13 0 44
WARNING: Could not find offline channel for 13 0 45
WARNING: Could not find offline channel for 13 0 46
WARNING: Could not find offline channel for 13 0 47
WARNING: Could not find offline channel for 13 0 42
WARNING: Could not find offline channel for 13 0 43
WARNING: Could not find offline channel for 13 0 3
WARNING: Could not find offline channel for 13 0 4
WARNING: Could not find offline channel for 13 0 6
WARNING: Could not find offline channel for 13 0 10
WARNING: Could not find offline channel for 13 0 11
WARNING: Could not find offline channel for 13 0 12
WARNING: Could not find offline channel for 13 0 13
WARNING: Could not find offline channel for 13 0 14
WARNING: Could not find offline channel for 13 0 15
WARNING: Could not find offline channel for 13 0 16
WARNING: Could not find offline channel for 13 0 17
WARNING: Could not find offline channel for 13 0 20
WARNING: Could not find offline channel for 13 0 21
WARNING: Could not find offline channel for 13 0 22
WARNING: Could not find offline channel for 13 0 23
WARNING: Could not find offline channel for 13 0 24
WARNING: Could not find offline channel for 13 0 25
WARNING: Could not find offline channel for 13 0 26
WARNING: Could not find offline channel for 13 0 27
WARNING: Could not find offline channel for 13 0 30
WARNING: Could not find offline channel for 13 0 31
WARNING: Could not find offline channel for 13 0 32
WARNING: Could not find offline channel for 13 0 33
WARNING: Could not find offline channel for 13 0 34
WARNING: Could not find offline channel for 13 0 35
WARNING: Could not find offline channel for 13 0 36
WARNING: Could not find offline channel for 13 0 37
WARNING: Could not find offline channel for 13 0 40
WARNING: Could not find offline channel for 13 0 41
WARNING: Could not find offline channel for 13 0 44
WARNING: Could not find offline channel for 13 0 45
WARNING: Could not find offline channel for 13 0 46
WARNING: Could not find offline channel for 13 0 47
WARNING: Could not find offline channel for 13 0 1
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: raw with 10240 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "raw"
wclsFrameSaver: found empty channel masks for "bad"
31-Oct-2024 14:29:28 CET  Closed output file "np04hd_raw_run029006_2588_dataflow7_datawriter_0_20240901T092643_reco_2024-10-11T_130821Z.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                         36.8763       40.2458       53.0095       39.2786       3.01398        30     
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        2.498e-05    5.99672e-05   0.000296401   5.00335e-05   4.61455e-05      30     
produce:tpcrawdecoder:PDHDTPCReader                3.87454       4.60521       5.29859       4.6229       0.313047        30     
produce:triggerrawdecoder:PDHDTriggerReader3      0.0108233     0.0163343     0.030288      0.013965     0.00588019       30     
produce:timingrawdecoder:PDHDTimingRawDecoder    0.000405409   0.00056541    0.000947821   0.000530661   0.00012753       30     
produce:pdhddaphne:DAPHNEReaderPDHD                10.0181       10.9952       13.2303       10.8362      0.712603        30     
produce:fembfilter:PDHDFEMBFilter                0.000121697   0.000384255   0.00086901    0.000403581   0.000157593      30     
produce:wclsdatahdfilter:WireCellToolkit           16.8055       18.2215       26.1028       17.7658       1.72548        30     
[art]:TriggerResults:TriggerResultInserter       2.9459e-05    4.18663e-05   0.00012922    3.7024e-05    1.76844e-05      30     
end_path:out1:RootOutput                          5.465e-06    8.9378e-06    3.1107e-05    8.0995e-06    4.20517e-06      30     
end_path:out1:RootOutput(write)                    5.95842       6.40499       8.35524       6.19177       0.57411        30     
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3294.56 MB
  Peak resident set size usage (VmHWM): 1812.6 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
=== End last 100 lines of lar log file ===
lar exit code 0
justIN time: 2024-11-17 05:44:23 UTC       justIN version: 01.01.09