justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 418934.146@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID418934.146@justin-prod-sched01.dune.hep.ac.uk
Workflow ID7811
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-20 16:39:59
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2025-06-20 23:33:55
From worker nodeHostnamewn1208090.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes8387559424 (7999 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-20 20:48:44
Input fileshd-protodune:np04hd_raw_run027087_0385_dataflow3_datawriter_0_20240614T181214.hdf5
JobscriptExit code0
Real time2h (9860s)
CPU time2h (9260s = 93%)
Max RSS bytes2716094464 (2590 MiB)
Outputting started2025-06-20 23:33:04
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07811/1/002/pdhd_processing_1_418934_146_1750452538_stage1_stage2.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07811/1/002/pdhd_processing_1_418934_146_1750452538_stage1_stage2_tfile.root
Finished2025-06-20 23:33:55
Saved logsjustin-logs:418934.146-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

.6822e+06 n=1348471 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 80085 traces, 80085 summary
Retagger: tagging trace set: gauss with 62664 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 62664 traces tagged "gauss"
FrameSaver: q=1.7316e+06 n=962834 tag=gauss
wclsFrameSaver: saving 80085 traces tagged "wiener"
FrameSaver: q=1.97589e+06 n=909703 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 83303 traces, 83303 summary
Retagger: tagging trace set: gauss with 66919 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 66919 traces tagged "gauss"
FrameSaver: q=1.97066e+06 n=1107080 tag=gauss
wclsFrameSaver: saving 83303 traces tagged "wiener"
FrameSaver: q=2.21288e+06 n=1040297 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 100172 traces, 100172 summary
Retagger: tagging trace set: gauss with 74140 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 74140 traces tagged "gauss"
FrameSaver: q=2.44259e+06 n=1117959 tag=gauss
wclsFrameSaver: saving 100172 traces tagged "wiener"
FrameSaver: q=2.9058e+06 n=1099405 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 68424 traces, 68424 summary
Retagger: tagging trace set: gauss with 53945 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 53945 traces tagged "gauss"
FrameSaver: q=1.43227e+06 n=799096 tag=gauss
wclsFrameSaver: saving 68424 traces tagged "wiener"
FrameSaver: q=1.65853e+06 n=773950 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 88595 traces, 88595 summary
Retagger: tagging trace set: gauss with 70049 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 70049 traces tagged "gauss"
FrameSaver: q=2.35218e+06 n=1105089 tag=gauss
wclsFrameSaver: saving 88595 traces tagged "wiener"
FrameSaver: q=2.72848e+06 n=1064518 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 82784 traces, 82784 summary
Retagger: tagging trace set: gauss with 62187 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 62187 traces tagged "gauss"
FrameSaver: q=1.75725e+06 n=930533 tag=gauss
wclsFrameSaver: saving 82784 traces tagged "wiener"
FrameSaver: q=2.07521e+06 n=887190 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 92851 traces, 92851 summary
Retagger: tagging trace set: gauss with 74066 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 74066 traces tagged "gauss"
FrameSaver: q=2.5758e+06 n=1174085 tag=gauss
wclsFrameSaver: saving 92851 traces tagged "wiener"
FrameSaver: q=3.09824e+06 n=1128350 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 79427 traces, 79427 summary
Retagger: tagging trace set: gauss with 63606 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 63606 traces tagged "gauss"
FrameSaver: q=1.75102e+06 n=988976 tag=gauss
wclsFrameSaver: saving 79427 traces tagged "wiener"
FrameSaver: q=2.01819e+06 n=943955 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 82421 traces, 82421 summary
Retagger: tagging trace set: gauss with 64565 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 64565 traces tagged "gauss"
FrameSaver: q=1.72489e+06 n=991476 tag=gauss
wclsFrameSaver: saving 82421 traces tagged "wiener"
FrameSaver: q=1.96243e+06 n=920400 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 71274 traces, 71274 summary
Retagger: tagging trace set: gauss with 57616 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 57616 traces tagged "gauss"
FrameSaver: q=1.92711e+06 n=845483 tag=gauss
wclsFrameSaver: saving 71274 traces tagged "wiener"
FrameSaver: q=2.26346e+06 n=847124 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 81944 traces, 81944 summary
Retagger: tagging trace set: gauss with 63921 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 63921 traces tagged "gauss"
FrameSaver: q=1.96704e+06 n=1028890 tag=gauss
wclsFrameSaver: saving 81944 traces tagged "wiener"
FrameSaver: q=2.22556e+06 n=977909 tag=wiener
21-Jun-2025 00:33:03 BST  Closed output file "pdhd_processing_1_418934_146_1750452538_stage1_stage2.root"
21-Jun-2025 00:33:03 BST  Closed input file "pdhd_processing_1_418934_146_1750452538_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              66.8141       202.411       437.201       180.301       69.4719        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000400546   0.00332271    0.00775384    0.00334508    0.00195938       40     
produce:fembfilter:PDHDFEMBFilter                      0.811827       1.05084       1.23756       1.05895      0.0615769       40     
produce:wclsdatahd:WireCellToolkit                      51.9969       61.9639       74.2835       62.018        6.45554        40     
produce:gaushit:GausHitFinder                          0.608879       1.33302       2.56729       1.31253      0.341181        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000311938   0.000592259   0.000925797   0.000549983   0.000138831      40     
produce:reco3d:SpacePointSolver                        0.284865       1.50757       7.5394        1.05365       1.41157        38     
produce:hitpdune:DisambigFromSpacePoints               0.255677      0.998272       3.08148      0.847164      0.555727        38     
produce:pandora:StandardPandora                         13.6633       39.1778       134.069       32.2033       24.6142        38     
produce:pandoraWriter:StandardPandora                  0.188924      0.339761      0.566159      0.328835      0.0830954       38     
produce:pandoraTrack:LArPandoraTrackCreation            1.42967       3.6109        11.7834       3.30304       1.91002        38     
produce:pandoraShower:LArPandoraShowerCreation          1.2382        4.29229       10.9269       3.64439       2.26377        38     
produce:pandoracalo:Calorimetry                        0.630403       1.68781       5.35116       1.51296       0.83944        38     
produce:pandoracalonosce:Calorimetry                   0.500658       1.5675        4.7479        1.44964      0.790841        38     
produce:pandorapid:Chi2ParticleID                      0.0019673    0.00353537    0.00652291     0.003536     0.000891912      38     
produce:pandoraShowercalo:ShowerCalorimetry             1.13677       3.83467       8.48609       3.40464       1.99628        38     
produce:pandoraShowercalonosce:ShowerCalorimetry        1.08298       3.70168       8.18959       3.35894       1.80545        38     
produce:pandoraGnocchiCalo:GnocchiCalorimetry           0.16789      0.273192      0.420476      0.275323      0.0597355       38     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0548994     0.0913536     0.139757      0.0922732     0.0199837       38     
produce:emtrkmichelid:EmTrackMichelId                   32.6342       52.975        77.8566       51.9933       11.7889        38     
[art]:TriggerResults:TriggerResultInserter            2.9846e-05    6.18802e-05   0.000146987   6.19015e-05   2.45653e-05      40     
end_path:out1:RootOutput                               4.859e-06    9.93355e-06   3.5307e-05     9.518e-06    5.11093e-06      40     
end_path:michelremoving:michelremoving                4.4094e-05      0.14736      0.634856      0.0638175     0.153181        40     
end_path:michelremovinggnocchi:michelremoving         2.5969e-05      0.14933      0.631097      0.0633377     0.155739        40     
end_path:calibanagnocchi:CalibAnaTree                 1.7012e-05      27.6531       127.841       20.2134       23.5597        40     
end_path:out1:RootOutput(write)                        0.656038       1.49176       2.39082       1.47556      0.378236        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5112.86 MB
  Peak resident set size usage (VmHWM): 2716.09 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'pdhd_processing_1_418934_146_1750452538_stage1_stage2.root', 'tfile_out': 'pdhd_processing_1_418934_146_1750452538_stage1_stage2_tfile.root', 'start_time': 1750454214.632359, 'end_time': 1750462384.648212}
justIN time: 2025-08-15 06:44:28 UTC       justIN version: 01.03.02