justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 105546.40@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID105546.40@justin-prod-sched02.dune.hep.ac.uk
Workflow ID4191
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes2096103424 (1999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-21 02:46:34
SiteES_CIEMAT
EntryDUNE_T2_ES_CIEMAT_condorce1
Last heartbeat2024-11-21 08:47:12
From worker nodeHostnamegaew0194.ciemat.es
cpuinfoIntel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2096103424 (1999 MiB)
Wall seconds limit232200 (64 hours)
Inner Apptainer?True
Job statejobscript_error
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-21 02:58:50
Input fileshd-protodune:np04hd_raw_run028759_0322_dataflow5_datawriter_0_20240818T022132.hdf5
hd-protodune:np04hd_raw_run028759_0321_dataflow6_datawriter_0_20240818T021953.hdf5
hd-protodune:np04hd_raw_run028759_0322_dataflow1_datawriter_0_20240818T022132.hdf5
hd-protodune:np04hd_raw_run028759_0321_dataflow3_datawriter_0_20240818T021950.hdf5
hd-protodune:np04hd_raw_run028759_0373_dataflow5_datawriter_0_20240818T030708.hdf5
JobscriptExit code139
Real time0m (0s)
CPU time0m (0s = 0%)
Outputting started 
Output files
Finished2024-11-21 08:47:12
Saved logsjustin-logs:105546.40-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

LF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
%MSG-w BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2024 09:46:46 CET  run: 28759 subRun: 1 event: 89725 BeamEvent_module.cc:1828
Could not get XCET1 info

%MSG
%MSG-w BeamEvent:  BeamEvent:beamevent@BeginModule 21-Nov-2024 09:46:46 CET  run: 28759 subRun: 1 event: 89725 BeamEvent_module.cc:1846
Could not get XCET2 info

%MSG
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: 94.1074 4.99984
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: 95.8887 -1
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: 89.6543 6.64979
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: -1 5.04851
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: -1 5.10392
21-Nov-2024 09:46:53 CET  Closed output file "np04hd_raw_run028759_0373_dataflow5_datawriter_0_20240818T030708_beam.root"
21-Nov-2024 09:46:53 CET  Closed output file "np04hd_raw_run028759_0373_dataflow5_datawriter_0_20240818T030708_beam.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                         0.84548       137.761       7120.5       0.960284       784.462        150    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        1.199e-05    1.67282e-05   0.000129002   1.56515e-05   9.52617e-06      150    
produce:triggerrawdecoder:PDHDTriggerReader3       0.59793      0.665486      0.775767      0.659558      0.0372619       150    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.108069      0.119225      0.155851      0.109706      0.0129872       150    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0216603     0.0219157     0.0242499     0.0218899    0.00024666       150    
produce:beamevent:BeamEvent                      0.000243707     136.821       7119.58      0.0132807      784.459        150    
[art]:TriggerResults:TriggerResultInserter       1.3131e-05    1.78996e-05   5.0683e-05    1.6642e-05    5.11311e-06      150    
end_path:out1:RootOutput                          2.742e-06    3.75085e-06   1.7194e-05     3.331e-06    1.83575e-06      150    
end_path:out1:RootOutput(write)                   0.0712256     0.133042      0.277775      0.131921      0.0303232       150    
===================================================================================================================================

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                         0.84548       137.761       7120.5       0.960284       784.462        150    
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read)                        1.199e-05    1.67282e-05   0.000129002   1.56515e-05   9.52617e-06      150    
produce:triggerrawdecoder:PDHDTriggerReader3       0.59793      0.665486      0.775767      0.659558      0.0372619       150    
produce:ctbrawdecoder:PDHDCTBRawDecoder           0.108069      0.119225      0.155851      0.109706      0.0129872       150    
produce:timingrawdecoder:PDHDTimingRawDecoder     0.0216603     0.0219157     0.0242499     0.0218899    0.00024666       150    
produce:beamevent:BeamEvent                      0.000243707     136.821       7119.58      0.0132807      784.459        150    
[art]:TriggerResults:TriggerResultInserter       1.3131e-05    1.78996e-05   5.0683e-05    1.6642e-05    5.11311e-06      150    
end_path:out1:RootOutput                          2.742e-06    3.75085e-06   1.7194e-05     3.331e-06    1.83575e-06      150    
end_path:out1:RootOutput(write)                   0.0712256     0.133042      0.277775      0.131921      0.0303232       150    
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1587.73 MB
  Peak resident set size usage (VmHWM): 629.096 MB
====================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 1587.73 MB
  Peak resident set size usage (VmHWM): 629.096 MB
====================================================================================================

TrigReport ---------- Event summary -------------
TrigReport Events total = 150 passed = 150 failed = 0

TrigReport ---------- Modules in End-path ----------
TrigReport        Run    Success      Error Name
TrigReport        150        150          0 out1

TimeReport ---------- Time summary [sec] -------
TimeReport CPU = 33.830727 Real = 20876.329213

MemReport  ---------- Memory summary [base-10 MB] ------
MemReport  VmPeak = 1587.73 VmHWM = 629.096
justIN time: 2024-11-23 11:52:13 UTC       justIN version: 01.01.09