justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 298161.3@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID298161.3@justin-prod-sched01.dune.hep.ac.uk
Workflow ID4175
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
RSS bytes2096103424 (1999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2024-11-20 22:15:59
SiteCH_UNIBE-LHEP
EntryOSG_CH_UNIBE_LHEP_ce02
Last heartbeat2024-11-20 22:29:55
From worker nodeHostnamewn-1-12.local
cpuinfoIntel(R) Xeon(R) CPU E5-2680 v2 @ 2.80GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes2096103424 (1999 MiB)
Wall seconds limit86400 (24 hours)
Inner Apptainer?True
Job statejobscript_error
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-11-20 22:17:31
Input fileshd-protodune:np04hd_raw_run028012_0104_dataflow7_datawriter_0_20240715T014510.hdf5
hd-protodune:np04hd_raw_run028012_0106_dataflow5_datawriter_0_20240715T014637.hdf5
hd-protodune:np04hd_raw_run028012_0105_dataflow2_datawriter_0_20240715T014543.hdf5
hd-protodune:np04hd_raw_run028012_0167_dataflow0_datawriter_0_20240715T022630.hdf5
hd-protodune:np04hd_raw_run028012_0106_dataflow4_datawriter_0_20240715T014637.hdf5
JobscriptExit code137
Real time0m (0s)
CPU time0m (0s = 0%)
Outputting started 
Output files
Finished2024-11-20 22:29:55
Saved logsjustin-logs:298161.3-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1641
Breaking 2A 1A -1.83812e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
64 23 Breaking 2A Gen -1.83814e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1641
Breaking 2A 1A -6.63022e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
65 24 Breaking 2A Gen -4.46295e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
66 24 Breaking 2A Gen -3.79993e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
67 24 Breaking 2A Gen -3.79313e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
68 24 Breaking 2A Gen -3.55949e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
69 24 Breaking 2A Gen -3.24185e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
70 24 Breaking 2A Gen -3.19237e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
71 24 Breaking 2A Gen -2.00045e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
72 24 Breaking 2A Gen -1.08903e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
73 24 Breaking 2A Gen -6.90508e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
74 24 Breaking 2A Gen -1.99327e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1641
Breaking 2A 1A -4.69251e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
75 25 Breaking 2A Gen -4.69251e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
76 26 Breaking 2A Gen -4.25363e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
77 26 Breaking 2A Gen -2.04319e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1641
Breaking 2A 1A -395.783

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
78 27 Breaking 2A Gen -6.19394e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1641
Breaking 2A 1A -4.36695e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
79 28 Breaking 2A Gen -4.36696e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
80 28 Breaking 2A Gen -8.80081e+06

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1641
Breaking 2A 1A -1.1234e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
81 29 Breaking 2A Gen -7.44941e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
82 29 Breaking 2A Gen -6.326e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1641
Breaking 2A 1A -1.21643e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
83 30 Breaking 2A Gen -3.49748e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
84 30 Breaking 2A Gen -2.28104e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
85 30 Breaking 2A Gen -7.05417e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1641
Breaking 2A 1A -396.27

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
86 31 Breaking 2A Gen -1.5515e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
87 31 Breaking 2A Gen -1.51876e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
88 31 Breaking 2A Gen -4.36375e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1641
Breaking 2A 1A -6.68406e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
89 32 Breaking 2A Gen -6.68408e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1641
Breaking 2A 1A -5.00995e+06

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
90 33 Breaking 2A Gen -5.01006e+06

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1641
Breaking 2A 1A -398.131

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
91 34 Breaking 2A Gen -1.00775e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
92 34 Breaking 2A Gen -6.47145e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
93 34 Breaking 2A Gen -1.41136e+06

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1641
Breaking 2A 1A -1.92442e+07

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
94 35 Breaking 2A Gen -3.37842e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
95 35 Breaking 2A Gen -3.18598e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
96 35 Breaking 2A Gen -2.91529e+08

%MSG
%MSG-i BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:51 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1625
97 35 Breaking 2A Gen -2.11834e+08

%MSG
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
WARNING: NONZERO HALF
%MSG-w BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:52 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1828
Could not get XCET1 info

%MSG
%MSG-w BeamEvent:  BeamEvent:beamevent@BeginModule 20-Nov-2024 23:23:52 CET  run: 28012 subRun: 1 event: 26300 BeamEvent_module.cc:1846
Could not get XCET2 info

%MSG
Timing trigger: 12
Matched: 1
CKovs: 0 0
TOF, P: 95.4844 1.04869
Timing trigger: 12
Matched: 1
CKovs: 0 0
TOF, P: 373.319 1.04949
Timing trigger: 12
Matched: 1
CKovs: 0 0
TOF, P: 96.4198 1.3492
Timing trigger: 12
Matched: 1
CKovs: 0 0
TOF, P: 94.998 0.964811
Timing trigger: 12
Matched: 1
CKovs: 0 0
TOF, P: 97.6065 1.00967
Timing trigger: 12
Matched: 1
CKovs: 0 1
TOF, P: 95.4844 -1
Timing trigger: 12
Matched: 1
CKovs: 0 1
TOF, P: 94.2734 0.985863
Timing trigger: 12
Matched: 1
CKovs: 1 0
TOF, P: 94.6738 0.990041
justIN time: 2024-11-21 18:02:55 UTC       justIN version: 01.01.09