Jobsub ID 76835.4@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 76835.4@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3387 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-24 22:00:00 |
| Site | UK_Liverpool |
| Entry | DUNE_UK_Liverpool_hepgrid5 |
| Last heartbeat | 2024-09-25 02:13:14 |
| From worker node | Hostname | r12-n05.ph.liv.ac.uk |
| cpuinfo | AMD EPYC 7453 28-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 259200 (72 hours) |
| Inner Apptainer? | True |
| Job state | jobscript_error |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-25 01:44:06 |
| Input files | hd-protodune:np04hd_raw_run029006_2175_dataflow5_datawriter_0_20240901T024208.hdf5
|
| Jobscript | Exit code | 139 |
| Real time | 0m (0s) |
| CPU time | 0m (0s = 0%) |
| Outputting started | |
| Output files | |
| Finished | 2024-09-25 02:13:14 |
| Saved logs | justin-logs:76835.4-justin-prod-sched02.dune.hep.ac.uk.logs.tgz |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
hannel for 13 0 14
WARNING: Could not find offline channel for 13 0 15
WARNING: Could not find offline channel for 13 0 16
WARNING: Could not find offline channel for 13 0 17
WARNING: Could not find offline channel for 13 0 20
WARNING: Could not find offline channel for 13 0 21
WARNING: Could not find offline channel for 13 0 22
WARNING: Could not find offline channel for 13 0 23
WARNING: Could not find offline channel for 13 0 24
WARNING: Could not find offline channel for 13 0 25
WARNING: Could not find offline channel for 13 0 26
WARNING: Could not find offline channel for 13 0 27
WARNING: Could not find offline channel for 13 0 30
WARNING: Could not find offline channel for 13 0 31
WARNING: Could not find offline channel for 13 0 32
WARNING: Could not find offline channel for 13 0 33
WARNING: Could not find offline channel for 13 0 34
WARNING: Could not find offline channel for 13 0 35
WARNING: Could not find offline channel for 13 0 36
WARNING: Could not find offline channel for 13 0 37
WARNING: Could not find offline channel for 13 0 40
WARNING: Could not find offline channel for 13 0 41
WARNING: Could not find offline channel for 13 0 42
WARNING: Could not find offline channel for 13 0 43
WARNING: Could not find offline channel for 13 0 44
WARNING: Could not find offline channel for 13 0 45
WARNING: Could not find offline channel for 13 0 3
WARNING: Could not find offline channel for 13 0 4
WARNING: Could not find offline channel for 13 0 6
WARNING: Could not find offline channel for 13 0 10
WARNING: Could not find offline channel for 13 0 11
WARNING: Could not find offline channel for 13 0 12
WARNING: Could not find offline channel for 13 0 13
WARNING: Could not find offline channel for 13 0 14
WARNING: Could not find offline channel for 13 0 15
WARNING: Could not find offline channel for 13 0 16
WARNING: Could not find offline channel for 13 0 17
WARNING: Could not find offline channel for 13 0 20
WARNING: Could not find offline channel for 13 0 21
WARNING: Could not find offline channel for 13 0 22
WARNING: Could not find offline channel for 13 0 23
WARNING: Could not find offline channel for 13 0 24
WARNING: Could not find offline channel for 13 0 25
WARNING: Could not find offline channel for 13 0 26
WARNING: Could not find offline channel for 13 0 27
WARNING: Could not find offline channel for 13 0 30
WARNING: Could not find offline channel for 13 0 31
WARNING: Could not find offline channel for 13 0 32
WARNING: Could not find offline channel for 13 0 33
WARNING: Could not find offline channel for 13 0 34
WARNING: Could not find offline channel for 13 0 35
WARNING: Could not find offline channel for 13 0 36
WARNING: Could not find offline channel for 13 0 37
WARNING: Could not find offline channel for 13 0 40
WARNING: Could not find offline channel for 13 0 41
WARNING: Could not find offline channel for 13 0 42
WARNING: Could not find offline channel for 13 0 43
WARNING: Could not find offline channel for 13 0 44
WARNING: Could not find offline channel for 13 0 45
WARNING: Could not find offline channel for 13 0 46
WARNING: Could not find offline channel for 13 0 47
WARNING: Could not find offline channel for 13 0 1
WARNING: Could not find offline channel for 13 0 12
WARNING: Could not find offline channel for 13 0 13
WARNING: Could not find offline channel for 13 0 3
WARNING: Could not find offline channel for 13 0 4
WARNING: Could not find offline channel for 13 0 6
WARNING: Could not find offline channel for 13 0 10
WARNING: Could not find offline channel for 13 0 11
WARNING: Could not find offline channel for 13 0 14
WARNING: Could not find offline channel for 13 0 15
WARNING: Could not find offline channel for 13 0 16
WARNING: Could not find offline channel for 13 0 17
WARNING: Could not find offline channel for 13 0 20
WARNING: Could not find offline channel for 13 0 21
WARNING: Could not find offline channel for 13 0 22
WARNING: Could not find offline channel for 13 0 23
WARNING: Could not find offline channel for 13 0 24
WARNING: Could not find offline channel for 13 0 25
WARNING: Could not find offline channel for 13 0 26
WARNING: Could not find offline channel for 13 0 27
WARNING: Could not find offline channel for 13 0 30
WARNING: Could not find offline channel for 13 0 31
WARNING: Could not find offline channel for 13 0 32
WARNING: Could not find offline channel for 13 0 33
WARNING: Could not find offline channel for 13 0 34
WARNING: Could not find offline channel for 13 0 35
WARNING: Could not find offline channel for 13 0 36
WARNING: Could not find offline channel for 13 0 37
WARNING: Could not find offline channel for 13 0 40
WARNING: Could not find offline channel for 13 0 41
WARNING: Could not find offline channel for 13 0 42
WARNING: Could not find offline channel for 13 0 43
WARNING: Could not find offline channel for 13 0 44
WARNING: Could not find offline channel for 13 0 45
WARNING: Could not find offline channel for 13 0 46
WARNING: Could not find offline channel for 13 0 47
WARNING: Could not find offline channel for 13 0 1
WARNING: Could not find offline channel for 13 0 1
WARNING: Could not find offline channel for 13 0 3
WARNING: Could not find offline channel for 13 0 4
WARNING: Could not find offline channel for 13 0 6
WARNING: Could not find offline channel for 13 0 10
WARNING: Could not find offline channel for 13 0 11
WARNING: Could not find offline channel for 13 0 12
WARNING: Could not find offline channel for 13 0 13
WARNING: Could not find offline channel for 13 0 14
WARNING: Could not find offline channel for 13 0 15
WARNING: Could not find offline channel for 13 0 16
WARNING: Could not find offline channel for 13 0 17
WARNING: Could not find offline channel for 13 0 20
WARNING: Could not find offline channel for 13 0 21
WARNING: Could not find offline channel for 13 0 22
WARNING: Could not find offline channel for 13 0 23
WARNING: Could not find offline channel for 13 0 24
WARNING: Could not find offline channel for 13 0 25
WARNING: Could not find offline channel for 13 0 26
WARNING: Could not find offline channel for 13 0 27
WARNING: Could not find offline channel for 13 0 30
WARNING: Could not find offline channel for 13 0 31
WARNING: Could not find offline channel for 13 0 32
WARNING: Could not find offline channel for 13 0 33
WARNING: Could not find offline channel for 13 0 34
WARNING: Could not find offline channel for 13 0 35
WARNING: Could not find offline channel for 13 0 36
WARNING: Could not find offline channel for 13 0 37
WARNING: Could not find offline channel for 13 0 40
WARNING: Could not find offline channel for 13 0 41
WARNING: Could not find offline channel for 13 0 42
WARNING: Could not find offline channel for 13 0 43
WARNING: Could not find offline channel for 13 0 44
WARNING: Could not find offline channel for 13 0 45
WARNING: Could not find offline channel for 13 0 46
WARNING: Could not find offline channel for 13 0 47
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: raw with 10240 traces, 0 summary
wclsFrameSaver: saving raw::RawDigits tagged "raw"
wclsFrameSaver: found empty channel masks for "bad"
25-Sep-2024 03:12:53 BST Closed output file "np04hd_raw_run029006_2175_dataflow5_datawriter_0_20240901T024208_reco_stage1.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 46.7274 55.292 64.6243 54.7788 4.47608 30
-----------------------------------------------------------------------------------------------------------------------------------
source:HDF5RawInput3(read) 2.0929e-05 4.26952e-05 0.000226956 3.5527e-05 3.55419e-05 30
produce:tpcrawdecoder:PDHDTPCReader 18.3654 28.3725 36.7415 27.9309 4.21407 30
produce:triggerrawdecoder:PDHDTriggerReader3 0.722495 0.807192 0.949092 0.793052 0.0599953 30
produce:timingrawdecoder:PDHDTimingRawDecoder 0.0236171 0.032145 0.0813823 0.0243811 0.0142223 30
produce:pdhddaphne:DAPHNEReaderPDHD 7.7898 11.3223 13.6008 11.3768 1.29343 30
produce:fembfilter:PDHDFEMBFilter 8.1724e-05 0.000139463 0.0004476 0.000109521 7.51102e-05 30
produce:wclsdatahdfilter:WireCellToolkit 10.563 10.9753 11.614 10.9532 0.237746 30
[art]:TriggerResults:TriggerResultInserter 1.4908e-05 2.36834e-05 8.8446e-05 2.131e-05 1.25082e-05 30
end_path:out1:RootOutput 3.246e-06 5.7999e-06 2.3073e-05 4.533e-06 3.72712e-06 30
end_path:out1:RootOutput(write) 3.62695 3.78107 4.01748 3.77875 0.0869263 30
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3293.84 MB
Peak resident set size usage (VmHWM): 1679.52 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
../justin-jobscript: line 145: 1025 Segmentation fault (core dumped) LD_PRELOAD=$XROOTD_LIB/libXrdPosixPreload.so lar -c ${FCL1} -n ${nevents} ${extra_line} ${pfn}
Error in reco1 