justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 418933.74@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID418933.74@justin-prod-sched01.dune.hep.ac.uk
Workflow ID7811
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-20 16:38:40
SiteUK_RAL-PPD
EntryCMSHTPC_T2_UK_SGrid_RALPP_hep207
Last heartbeat2025-06-20 23:25:02
From worker nodeHostnameheplnc077.pp.rl.ac.uk
cpuinfoIntel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes8387559424 (7999 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-20 20:06:54
Input fileshd-protodune:np04hd_raw_run027087_0253_dataflow2_datawriter_0_20240614T170113.hdf5
JobscriptExit code0
Real time3h (11840s)
CPU time3h (11302s = 95%)
Max RSS bytes2730545152 (2604 MiB)
Outputting started2025-06-20 23:24:14
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07811/1/002/pdhd_processing_1_418933_74_1750450027_stage1_stage2.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07811/1/002/pdhd_processing_1_418933_74_1750450027_stage1_stage2_tfile.root
Finished2025-06-20 23:25:02
Saved logsjustin-logs:418933.74-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

q=2.60463e+06 n=1080143 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 87769 traces, 87769 summary
Retagger: tagging trace set: gauss with 69193 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 69193 traces tagged "gauss"
FrameSaver: q=1.95212e+06 n=1088234 tag=gauss
wclsFrameSaver: saving 87769 traces tagged "wiener"
FrameSaver: q=2.24938e+06 n=1028766 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 66913 traces, 66913 summary
Retagger: tagging trace set: gauss with 53548 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 53548 traces tagged "gauss"
FrameSaver: q=1.18109e+06 n=744775 tag=gauss
wclsFrameSaver: saving 66913 traces tagged "wiener"
FrameSaver: q=1.37718e+06 n=688564 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 80049 traces, 80049 summary
Retagger: tagging trace set: gauss with 63493 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 63493 traces tagged "gauss"
FrameSaver: q=1.77488e+06 n=993917 tag=gauss
wclsFrameSaver: saving 80049 traces tagged "wiener"
FrameSaver: q=2.02124e+06 n=939881 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 67594 traces, 67594 summary
Retagger: tagging trace set: gauss with 54886 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 54886 traces tagged "gauss"
FrameSaver: q=1.3392e+06 n=823048 tag=gauss
wclsFrameSaver: saving 67594 traces tagged "wiener"
FrameSaver: q=1.54496e+06 n=795687 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 66933 traces, 66933 summary
Retagger: tagging trace set: gauss with 55474 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 55474 traces tagged "gauss"
FrameSaver: q=1.33394e+06 n=804032 tag=gauss
wclsFrameSaver: saving 66933 traces tagged "wiener"
FrameSaver: q=1.54318e+06 n=753257 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 67218 traces, 67218 summary
Retagger: tagging trace set: gauss with 53670 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 53670 traces tagged "gauss"
FrameSaver: q=2.73605e+06 n=854216 tag=gauss
wclsFrameSaver: saving 67218 traces tagged "wiener"
FrameSaver: q=2.9524e+06 n=811340 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 95569 traces, 95569 summary
Retagger: tagging trace set: gauss with 74041 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 74041 traces tagged "gauss"
FrameSaver: q=2.32425e+06 n=1189198 tag=gauss
wclsFrameSaver: saving 95569 traces tagged "wiener"
FrameSaver: q=2.64243e+06 n=1126905 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 93316 traces, 93316 summary
Retagger: tagging trace set: gauss with 70914 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 70914 traces tagged "gauss"
FrameSaver: q=2.22691e+06 n=1052035 tag=gauss
wclsFrameSaver: saving 93316 traces tagged "wiener"
FrameSaver: q=2.70429e+06 n=1046548 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 67349 traces, 67349 summary
Retagger: tagging trace set: gauss with 55555 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 55555 traces tagged "gauss"
FrameSaver: q=1.4325e+06 n=836944 tag=gauss
wclsFrameSaver: saving 67349 traces tagged "wiener"
FrameSaver: q=1.67647e+06 n=811104 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 89901 traces, 89901 summary
Retagger: tagging trace set: gauss with 69832 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 69832 traces tagged "gauss"
FrameSaver: q=2.17344e+06 n=1136787 tag=gauss
wclsFrameSaver: saving 89901 traces tagged "wiener"
FrameSaver: q=2.45052e+06 n=1079434 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 101000 traces, 101000 summary
Retagger: tagging trace set: gauss with 78898 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 78898 traces tagged "gauss"
FrameSaver: q=2.58955e+06 n=1299652 tag=gauss
wclsFrameSaver: saving 101000 traces tagged "wiener"
FrameSaver: q=2.94476e+06 n=1218166 tag=wiener
21-Jun-2025 00:24:12 BST  Closed output file "pdhd_processing_1_418933_74_1750450027_stage1_stage2.root"
21-Jun-2025 00:24:12 BST  Closed input file "pdhd_processing_1_418933_74_1750450027_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              152.072       251.463       442.832       233.62        68.0072        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000877151   0.00283034    0.00811301    0.00238508    0.00175806       40     
produce:fembfilter:PDHDFEMBFilter                      0.711701      0.969458       1.18305      0.995691      0.095812        40     
produce:wclsdatahd:WireCellToolkit                      47.6092       60.7348       64.2563       61.9967       3.66785        40     
produce:gaushit:GausHitFinder                           0.76521       1.58475       2.35543       1.63006      0.403911        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000359506   0.00058456    0.000921729   0.000576107   0.000125318      40     
produce:reco3d:SpacePointSolver                        0.287925       1.16269       3.95298      0.964655      0.733745        40     
produce:hitpdune:DisambigFromSpacePoints                0.28789       1.27778       2.61563       1.22465      0.631991        40     
produce:pandora:StandardPandora                         14.3141       42.8764       205.403       36.3366       31.9922        40     
produce:pandoraWriter:StandardPandora                  0.147076      0.312308      0.468605      0.311947      0.0759248       40     
produce:pandoraTrack:LArPandoraTrackCreation            1.33129       3.71828       9.08555       3.35017       1.69972        40     
produce:pandoraShower:LArPandoraShowerCreation          1.24368       4.3472         13.12        4.34224       2.46981        40     
produce:pandoracalo:Calorimetry                        0.698459       1.64387       3.85762       1.52673       0.70041        40     
produce:pandoracalonosce:Calorimetry                   0.538944       1.52214       3.63825       1.43474      0.685409        40     
produce:pandorapid:Chi2ParticleID                     0.00171169     0.0040608    0.00731239    0.00402671    0.00112736       40     
produce:pandoraShowercalo:ShowerCalorimetry            0.809292       3.75099       12.7572       3.62727       2.25189        40     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.884925       3.58544       13.1793       3.38218       2.18482        40     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.107064      0.275846      0.523603      0.271502      0.0855891       40     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0394276     0.0916398     0.167114      0.0929801     0.0279947       40     
produce:emtrkmichelid:EmTrackMichelId                   56.9869       95.7541       151.832       96.2284       21.5241        40     
[art]:TriggerResults:TriggerResultInserter            3.3144e-05    5.76231e-05   0.000124921   5.5274e-05    1.91987e-05      40     
end_path:out1:RootOutput                               6.547e-06    1.27703e-05   3.9115e-05     1.156e-05    5.01468e-06      40     
end_path:michelremoving:michelremoving                 0.0274795     0.168337      0.866481      0.0731998     0.177844        40     
end_path:michelremovinggnocchi:michelremoving          0.0251219     0.157781      0.836787      0.073954      0.171671        40     
end_path:calibanagnocchi:CalibAnaTree                   11.4417       25.9131       71.9298       23.245        12.2457        40     
end_path:out1:RootOutput(write)                        0.596984       1.46545       2.44676       1.49097      0.364772        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5099.81 MB
  Peak resident set size usage (VmHWM): 2730.55 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'pdhd_processing_1_418933_74_1750450027_stage1_stage2.root', 'tfile_out': 'pdhd_processing_1_418933_74_1750450027_stage1_stage2_tfile.root', 'start_time': 1750451715.303765, 'end_time': 1750461854.57655}
justIN time: 2025-08-15 08:15:00 UTC       justIN version: 01.03.02