justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 226824.93@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID226824.93@justin-prod-sched02.dune.hep.ac.uk
Workflow ID7814
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-20 20:21:08
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2025-06-21 05:08:54
From worker nodeHostnamewn6219291.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes8387559424 (7999 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-21 02:14:46
Input fileshd-protodune:np04hd_raw_run027087_0432_dataflow3_datawriter_0_20240614T183714.hdf5
JobscriptExit code0
Real time2h (10394s)
CPU time2h (9821s = 94%)
Max RSS bytes2667724800 (2544 MiB)
Outputting started2025-06-21 05:08:01
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07814/1/002/pdhd_processing_1_226824_93_1750472100_stage1_stage2_tfile.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07814/1/002/pdhd_processing_1_226824_93_1750472100_stage1_stage2.root
Finished2025-06-21 05:08:54
Saved logsjustin-logs:226824.93-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

q=2.35841e+06 n=925523 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 71165 traces, 71165 summary
Retagger: tagging trace set: gauss with 56829 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 56829 traces tagged "gauss"
FrameSaver: q=1.51864e+06 n=860437 tag=gauss
wclsFrameSaver: saving 71165 traces tagged "wiener"
FrameSaver: q=1.78081e+06 n=830782 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 77081 traces, 77081 summary
Retagger: tagging trace set: gauss with 60519 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 60519 traces tagged "gauss"
FrameSaver: q=1.7035e+06 n=909523 tag=gauss
wclsFrameSaver: saving 77081 traces tagged "wiener"
FrameSaver: q=2.00015e+06 n=890262 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 93701 traces, 93701 summary
Retagger: tagging trace set: gauss with 74144 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 74144 traces tagged "gauss"
FrameSaver: q=2.21511e+06 n=1227968 tag=gauss
wclsFrameSaver: saving 93701 traces tagged "wiener"
FrameSaver: q=2.49488e+06 n=1149753 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 87628 traces, 87628 summary
Retagger: tagging trace set: gauss with 70115 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 70115 traces tagged "gauss"
FrameSaver: q=1.94834e+06 n=1102603 tag=gauss
wclsFrameSaver: saving 87628 traces tagged "wiener"
FrameSaver: q=2.27375e+06 n=1061529 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 76266 traces, 76266 summary
Retagger: tagging trace set: gauss with 58051 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 58051 traces tagged "gauss"
FrameSaver: q=1.55357e+06 n=840128 tag=gauss
wclsFrameSaver: saving 76266 traces tagged "wiener"
FrameSaver: q=1.82851e+06 n=811725 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 100178 traces, 100178 summary
Retagger: tagging trace set: gauss with 76396 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 76396 traces tagged "gauss"
FrameSaver: q=2.36243e+06 n=1190899 tag=gauss
wclsFrameSaver: saving 100178 traces tagged "wiener"
FrameSaver: q=2.83992e+06 n=1174161 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 86719 traces, 86719 summary
Retagger: tagging trace set: gauss with 68794 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 68794 traces tagged "gauss"
FrameSaver: q=1.9864e+06 n=1049391 tag=gauss
wclsFrameSaver: saving 86719 traces tagged "wiener"
FrameSaver: q=2.3072e+06 n=1017181 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 74025 traces, 74025 summary
Retagger: tagging trace set: gauss with 58483 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 58483 traces tagged "gauss"
FrameSaver: q=1.59684e+06 n=916420 tag=gauss
wclsFrameSaver: saving 74025 traces tagged "wiener"
FrameSaver: q=1.81501e+06 n=869273 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 73016 traces, 73016 summary
Retagger: tagging trace set: gauss with 60537 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 60537 traces tagged "gauss"
FrameSaver: q=1.52418e+06 n=935666 tag=gauss
wclsFrameSaver: saving 73016 traces tagged "wiener"
FrameSaver: q=1.71325e+06 n=867981 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 60679 traces, 60679 summary
Retagger: tagging trace set: gauss with 51017 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 51017 traces tagged "gauss"
FrameSaver: q=1.12613e+06 n=747025 tag=gauss
wclsFrameSaver: saving 60679 traces tagged "wiener"
FrameSaver: q=1.3078e+06 n=714286 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 84642 traces, 84642 summary
Retagger: tagging trace set: gauss with 65211 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 65211 traces tagged "gauss"
FrameSaver: q=1.98121e+06 n=1029663 tag=gauss
wclsFrameSaver: saving 84642 traces tagged "wiener"
FrameSaver: q=2.31901e+06 n=993029 tag=wiener
21-Jun-2025 06:07:59 BST  Closed output file "pdhd_processing_1_226824_93_1750472100_stage1_stage2.root"
21-Jun-2025 06:07:59 BST  Closed input file "pdhd_processing_1_226824_93_1750472100_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              129.759       218.259       466.098       200.505       61.5328        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000454794   0.00336104    0.00812276    0.00277823     0.0020717       40     
produce:fembfilter:PDHDFEMBFilter                      0.782493       1.03666       1.45022       1.06899       0.14974        40     
produce:wclsdatahd:WireCellToolkit                      46.2302       67.0949       78.2658       68.7774       7.40417        40     
produce:gaushit:GausHitFinder                          0.704985       1.23911       1.83546       1.17949      0.286588        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000356509    0.0005712    0.000863583   0.00056414    0.000120878      40     
produce:reco3d:SpacePointSolver                        0.372714       1.65301       8.95202       1.30496       1.61104        40     
produce:hitpdune:DisambigFromSpacePoints               0.386848      0.842968       1.88271      0.714365       0.38314        40     
produce:pandora:StandardPandora                         15.9818       38.9863       110.47        32.1386       20.7787        40     
produce:pandoraWriter:StandardPandora                  0.165141      0.318005      0.511103      0.314132      0.0774939       40     
produce:pandoraTrack:LArPandoraTrackCreation            1.30806       3.2455        7.48451       3.08587       1.37969        40     
produce:pandoraShower:LArPandoraShowerCreation          0.87801       3.69469       9.29098       3.40756       1.73529        40     
produce:pandoracalo:Calorimetry                        0.688414       1.55032       3.39888       1.54633      0.636865        40     
produce:pandoracalonosce:Calorimetry                   0.476078       1.41637       3.3793        1.32451      0.585596        40     
produce:pandorapid:Chi2ParticleID                     0.00163305     0.0032455    0.00485351    0.00313457    0.000738926      40     
produce:pandoraShowercalo:ShowerCalorimetry            0.883817       3.6704        10.3241        3.292        1.97239        40     
produce:pandoraShowercalonosce:ShowerCalorimetry        0.8684        3.44537       9.92055       2.96795       1.72661        40     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.120262      0.246187      0.403645      0.246667      0.0700802       40     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0480412     0.0839363     0.132359      0.0818067     0.0206491       40     
produce:emtrkmichelid:EmTrackMichelId                   32.9137       57.0007       84.0074       56.4891       11.0067        40     
[art]:TriggerResults:TriggerResultInserter            2.0498e-05    5.6657e-05    0.000120086   5.3671e-05    2.35107e-05      40     
end_path:out1:RootOutput                               4.178e-06    9.32168e-06    3.202e-05    7.7195e-06    4.96347e-06      40     
end_path:michelremoving:michelremoving                 0.0263668     0.121564      0.534742      0.055812      0.117752        40     
end_path:michelremovinggnocchi:michelremoving          0.0254887     0.116489      0.519959      0.0522229     0.114176        40     
end_path:calibanagnocchi:CalibAnaTree                   12.2499       30.8719       272.106       22.0576       40.4108        40     
end_path:out1:RootOutput(write)                         0.8208        1.36214       2.06675       1.33395      0.263954        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5091.94 MB
  Peak resident set size usage (VmHWM): 2667.72 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'pdhd_processing_1_226824_93_1750472100_stage1_stage2.root', 'tfile_out': 'pdhd_processing_1_226824_93_1750472100_stage1_stage2_tfile.root', 'start_time': 1750473682.8631954, 'end_time': 1750482481.2104928}
justIN time: 2025-08-22 02:56:50 UTC       justIN version: 01.03.02