justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 226824.169@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID226824.169@justin-prod-sched02.dune.hep.ac.uk
Workflow ID7814
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-20 20:21:08
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2025-06-21 05:34:12
From worker nodeHostnamewn1208251.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes8387559424 (7999 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-21 02:39:38
Input fileshd-protodune:np04hd_raw_run027087_0654_dataflow1_datawriter_0_20240614T203643.hdf5
JobscriptExit code0
Real time2h (10422s)
CPU time2h (9878s = 94%)
Max RSS bytes2660151296 (2536 MiB)
Outputting started2025-06-21 05:33:21
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07814/1/002/pdhd_processing_1_226824_169_1750473595_stage1_stage2.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07814/1/002/pdhd_processing_1_226824_169_1750473595_stage1_stage2_tfile.root
Finished2025-06-21 05:34:12
Saved logsjustin-logs:226824.169-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

ver: q=2.33431e+06 n=1027521 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 88296 traces, 88296 summary
Retagger: tagging trace set: gauss with 72321 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 72321 traces tagged "gauss"
FrameSaver: q=2.31202e+06 n=1200566 tag=gauss
wclsFrameSaver: saving 88296 traces tagged "wiener"
FrameSaver: q=2.58318e+06 n=1129101 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 75565 traces, 75565 summary
Retagger: tagging trace set: gauss with 60559 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 60559 traces tagged "gauss"
FrameSaver: q=1.64793e+06 n=924394 tag=gauss
wclsFrameSaver: saving 75565 traces tagged "wiener"
FrameSaver: q=1.90004e+06 n=875749 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 72986 traces, 72986 summary
Retagger: tagging trace set: gauss with 58745 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 58745 traces tagged "gauss"
FrameSaver: q=1.48212e+06 n=874001 tag=gauss
wclsFrameSaver: saving 72986 traces tagged "wiener"
FrameSaver: q=1.7298e+06 n=836732 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 68008 traces, 68008 summary
Retagger: tagging trace set: gauss with 55923 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 55923 traces tagged "gauss"
FrameSaver: q=1.35478e+06 n=840062 tag=gauss
wclsFrameSaver: saving 68008 traces tagged "wiener"
FrameSaver: q=1.53684e+06 n=796604 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 77513 traces, 77513 summary
Retagger: tagging trace set: gauss with 61365 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 61365 traces tagged "gauss"
FrameSaver: q=1.67266e+06 n=918629 tag=gauss
wclsFrameSaver: saving 77513 traces tagged "wiener"
FrameSaver: q=1.94159e+06 n=863981 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 77088 traces, 77088 summary
Retagger: tagging trace set: gauss with 59143 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 59143 traces tagged "gauss"
FrameSaver: q=1.6454e+06 n=834095 tag=gauss
wclsFrameSaver: saving 77088 traces tagged "wiener"
FrameSaver: q=1.96296e+06 n=803639 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 88070 traces, 88070 summary
Retagger: tagging trace set: gauss with 68687 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 68687 traces tagged "gauss"
FrameSaver: q=1.92253e+06 n=1032083 tag=gauss
wclsFrameSaver: saving 88070 traces tagged "wiener"
FrameSaver: q=2.24983e+06 n=970199 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 76545 traces, 76545 summary
Retagger: tagging trace set: gauss with 60223 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 60223 traces tagged "gauss"
FrameSaver: q=1.59438e+06 n=883184 tag=gauss
wclsFrameSaver: saving 76545 traces tagged "wiener"
FrameSaver: q=1.8595e+06 n=836535 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 81772 traces, 81772 summary
Retagger: tagging trace set: gauss with 63556 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 63556 traces tagged "gauss"
FrameSaver: q=1.81536e+06 n=954467 tag=gauss
wclsFrameSaver: saving 81772 traces tagged "wiener"
FrameSaver: q=2.08841e+06 n=909504 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 71827 traces, 71827 summary
Retagger: tagging trace set: gauss with 58054 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 58054 traces tagged "gauss"
FrameSaver: q=1.51293e+06 n=878276 tag=gauss
wclsFrameSaver: saving 71827 traces tagged "wiener"
FrameSaver: q=1.75278e+06 n=847288 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 82314 traces, 82314 summary
Retagger: tagging trace set: gauss with 64404 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 64404 traces tagged "gauss"
FrameSaver: q=1.82123e+06 n=993593 tag=gauss
wclsFrameSaver: saving 82314 traces tagged "wiener"
FrameSaver: q=2.07881e+06 n=929656 tag=wiener
21-Jun-2025 06:33:19 BST  Closed output file "pdhd_processing_1_226824_169_1750473595_stage1_stage2.root"
21-Jun-2025 06:33:20 BST  Closed input file "pdhd_processing_1_226824_169_1750473595_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              155.308       218.113       341.878       205.817       44.3246        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000708797   0.00395357    0.00823809    0.00370209    0.00223264       40     
produce:fembfilter:PDHDFEMBFilter                      0.810505       1.03036       1.30046       1.03122      0.0858557       40     
produce:wclsdatahd:WireCellToolkit                      53.4153       70.1636       77.3031       71.677        5.75446        40     
produce:gaushit:GausHitFinder                          0.898269       1.33981       1.91581       1.29993       0.25217        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000449618   0.000655842   0.00117836    0.000632589   0.000155333      40     
produce:reco3d:SpacePointSolver                        0.368305       1.5889        8.83805       1.21165       1.33691        40     
produce:hitpdune:DisambigFromSpacePoints               0.328919      0.937392       1.99665      0.827779      0.388217        40     
produce:pandora:StandardPandora                         16.8865       36.9147       81.857        34.4245       14.7937        40     
produce:pandoraWriter:StandardPandora                  0.194917      0.349929      0.489921      0.329342      0.0765914       40     
produce:pandoraTrack:LArPandoraTrackCreation            1.55913       3.7748        7.72384       3.33746       1.4723         40     
produce:pandoraShower:LArPandoraShowerCreation          1.80692       4.36521       9.41386       3.40939       2.05186        40     
produce:pandoracalo:Calorimetry                        0.907162       1.80072       3.5403        1.54408      0.730187        40     
produce:pandoracalonosce:Calorimetry                   0.769687       1.70985       3.99088       1.52548      0.738876        40     
produce:pandorapid:Chi2ParticleID                     0.00212492    0.00371333     0.006302      0.0035947    0.000939548      40     
produce:pandoraShowercalo:ShowerCalorimetry             1.30463       4.12736       9.28351       3.29173       2.01511        40     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.28859        3.875        9.0567        3.21845       1.79235        40     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.114176      0.249204      0.406188      0.238519      0.0733555       40     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.043714      0.0859708     0.142292      0.0825679     0.0251205       40     
produce:emtrkmichelid:EmTrackMichelId                   39.1131       58.4627       89.4668       57.052        12.161         40     
[art]:TriggerResults:TriggerResultInserter            2.5899e-05    7.32515e-05   0.000156214   7.36195e-05   2.54307e-05      40     
end_path:out1:RootOutput                               4.799e-06    1.60263e-05   0.000177856   1.29345e-05   2.64776e-05      40     
end_path:michelremoving:michelremoving                 0.0349649     0.169195      0.436182      0.113386      0.125624        40     
end_path:michelremovinggnocchi:michelremoving          0.0329797     0.154805       0.41036      0.0981867     0.115628        40     
end_path:calibanagnocchi:CalibAnaTree                   12.4921       25.2567       64.9392       21.4673       12.4346        40     
end_path:out1:RootOutput(write)                        0.987865       1.45901       2.20916       1.42832       0.3008         40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5091.64 MB
  Peak resident set size usage (VmHWM): 2660.15 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'pdhd_processing_1_226824_169_1750473595_stage1_stage2.root', 'tfile_out': 'pdhd_processing_1_226824_169_1750473595_stage1_stage2_tfile.root', 'start_time': 1750475198.256534, 'end_time': 1750484001.414213}
justIN time: 2025-08-22 02:52:52 UTC       justIN version: 01.03.02