justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 105608.57@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID105608.57@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4189
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes2096103424 (1999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-21 04:39:49
SiteUK_Lancaster
EntryUBoone_UK_Lancaster_HEC_grendel_ce02
Last heartbeat2024-11-21 10:46:08
From worker nodeHostnamecomp19-03
cpuinfoIntel(R) Xeon(R) Gold 6148 CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2096103424 (1999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statejobscript_error
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-21 04:49:12
Input fileshd-protodune:np04hd_raw_run028891_1121_dataflow0_datawriter_0_20240824T195338.hdf5
hd-protodune:np04hd_raw_run028891_1123_dataflow2_datawriter_0_20240824T195805.hdf5
hd-protodune:np04hd_raw_run028891_1124_dataflow5_datawriter_0_20240824T200024.hdf5
hd-protodune:np04hd_raw_run028891_1127_dataflow2_datawriter_0_20240824T200742.hdf5
hd-protodune:np04hd_raw_run028891_1125_dataflow2_datawriter_0_20240824T200241.hdf5
JobscriptExit code139
Real time0m (0s)
CPU time0m (0s = 0%)
Outputting started 
Output files
Finished2024-11-21 10:46:08
Saved logsjustin-logs:105608.57-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

RO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
%MSG-w BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2024 10:45:45 GMT  run: 28891 subRun: 1 event: 279202 BeamEvent_module.cc:1828
Could not get XCET1 info

%MSG
%MSG-w BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2024 10:45:45 GMT  run: 28891 subRun: 1 event: 279202 BeamEvent_module.cc:1846
Could not get XCET2 info

%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: 96.0694 5.03321
%MSG-w HDF5FileLayout.cpp:  PostProcessEvent 21-Nov-2024 10:45:45 GMT  run: 28891 subRun: 1 event: 279202 HDF5FileLayout.cpp:70
 File Layout Not Enough Digits For Path 279210 5
%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: 96.3115 5.02463
%MSG-w HDF5FileLayout.cpp:  PostProcessEvent 21-Nov-2024 10:45:47 GMT  run: 28891 subRun: 1 event: 279210 HDF5FileLayout.cpp:70
 File Layout Not Enough Digits For Path 279218 5
%MSG
Timing trigger: 12
Matched: 1
CKovs: 0 0
TOF, P: 89.7324 4.85906
%MSG-w HDF5FileLayout.cpp:  PostProcessEvent 21-Nov-2024 10:45:49 GMT  run: 28891 subRun: 1 event: 279218 HDF5FileLayout.cpp:70
 File Layout Not Enough Digits For Path 279226 5
%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: -1 4.71042
%MSG-w HDF5FileLayout.cpp:  PostProcessEvent 21-Nov-2024 10:45:50 GMT  run: 28891 subRun: 1 event: 279226 HDF5FileLayout.cpp:70
 File Layout Not Enough Digits For Path 279234 5
%MSG
Timing trigger: 8
Matched: 0
CKovs: 0 0
TOF, P: 0 -1
%MSG-w HDF5FileLayout.cpp:  PostProcessEvent 21-Nov-2024 10:45:52 GMT  run: 28891 subRun: 1 event: 279234 HDF5FileLayout.cpp:70
 File Layout Not Enough Digits For Path 279242 5
%MSG
Timing trigger: 8
Matched: 0
CKovs: 0 0
TOF, P: 0 -1
21-Nov-2024 10:45:54 GMT  Closed output file "np04hd_raw_run028891_1125_dataflow2_datawriter_0_20240824T200241_beam.root"
21-Nov-2024 10:45:54 GMT  Closed output file "np04hd_raw_run028891_1125_dataflow2_datawriter_0_20240824T200241_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.871867       136.659       4319.94       0.98315       654.646        155    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.3953e-05    1.6933e-05    9.9734e-05    1.5975e-05    7.12294e-06      155    
produce:triggerrawdecoder:PDHDTriggerReader3      0.630551      0.734426       1.00411      0.717815      0.0672548       155    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.114896      0.132486      0.181452      0.125061      0.0163841       155    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0230327     0.0235463     0.0244755     0.023533     0.000312809      155    
produce:beamevent:BeamEvent                      0.000156553     135.676       4318.91     0.00433794      654.636        155    
[art]:TriggerResults:TriggerResultInserter        1.107e-05    1.57079e-05   5.3932e-05    1.4966e-05    4.50273e-06      155    
end_path:out1:RootOutput                          2.564e-06    3.40004e-06   1.9271e-05     3.145e-06    1.78384e-06      155    
end_path:out1:RootOutput(write)                   0.0585232     0.0924364     0.202677      0.0902427     0.0196594       155    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.871867       136.659       4319.94       0.98315       654.646        155    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                       1.3953e-05    1.6933e-05    9.9734e-05    1.5975e-05    7.12294e-06      155    
produce:triggerrawdecoder:PDHDTriggerReader3      0.630551      0.734426       1.00411      0.717815      0.0672548       155    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.114896      0.132486      0.181452      0.125061      0.0163841       155    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0230327     0.0235463     0.0244755     0.023533     0.000312809      155    
produce:beamevent:BeamEvent                      0.000156553     135.676       4318.91     0.00433794      654.636        155    
[art]:TriggerResults:TriggerResultInserter        1.107e-05    1.57079e-05   5.3932e-05    1.4966e-05    4.50273e-06      155    
end_path:out1:RootOutput                          2.564e-06    3.40004e-06   1.9271e-05     3.145e-06    1.78384e-06      155    
end_path:out1:RootOutput(write)                   0.0585232     0.0924364     0.202677      0.0902427     0.0196594       155    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1477.36 MB
  Peak resident set size usage (VmHWM): 569.741 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1477.36 MB
  Peak resident set size usage (VmHWM): 569.741 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 155 passed = 155 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        155        155          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 28.978487 Real = 21396.185767

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1477.36 VmHWM = 569.807
justIN time: 2024-11-21 16:50:24 UTC       justIN version: 01.01.09