justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 226824.138@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID226824.138@justin-prod-sched02.dune.hep.ac.uk
Workflow ID7814
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-20 20:21:08
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2025-06-21 05:12:32
From worker nodeHostnamewn6219291.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes8387559424 (7999 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-21 02:21:15
Input fileshd-protodune:np04hd_raw_run027087_0543_dataflow2_datawriter_0_20240614T193647.hdf5
JobscriptExit code0
Real time2h (10226s)
CPU time2h (9638s = 94%)
Max RSS bytes2722988032 (2596 MiB)
Outputting started2025-06-21 05:11:42
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07814/1/002/pdhd_processing_1_226824_138_1750472489_stage1_stage2_tfile.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07814/1/002/pdhd_processing_1_226824_138_1750472489_stage1_stage2.root
Finished2025-06-21 05:12:32
Saved logsjustin-logs:226824.138-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

24489e+06 n=975696 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 93916 traces, 93916 summary
Retagger: tagging trace set: gauss with 74793 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 74793 traces tagged "gauss"
FrameSaver: q=2.36441e+06 n=1258059 tag=gauss
wclsFrameSaver: saving 93916 traces tagged "wiener"
FrameSaver: q=2.68038e+06 n=1188300 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 59246 traces, 59246 summary
Retagger: tagging trace set: gauss with 48982 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 48982 traces tagged "gauss"
FrameSaver: q=1.17021e+06 n=692294 tag=gauss
wclsFrameSaver: saving 59246 traces tagged "wiener"
FrameSaver: q=1.3614e+06 n=669843 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 94077 traces, 94077 summary
Retagger: tagging trace set: gauss with 72562 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 72562 traces tagged "gauss"
FrameSaver: q=2.49175e+06 n=1145114 tag=gauss
wclsFrameSaver: saving 94077 traces tagged "wiener"
FrameSaver: q=2.9155e+06 n=1095376 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 75457 traces, 75457 summary
Retagger: tagging trace set: gauss with 60415 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 60415 traces tagged "gauss"
FrameSaver: q=1.50302e+06 n=907049 tag=gauss
wclsFrameSaver: saving 75457 traces tagged "wiener"
FrameSaver: q=1.72846e+06 n=853528 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 85398 traces, 85398 summary
Retagger: tagging trace set: gauss with 66461 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 66461 traces tagged "gauss"
FrameSaver: q=1.87471e+06 n=1007271 tag=gauss
wclsFrameSaver: saving 85398 traces tagged "wiener"
FrameSaver: q=2.18118e+06 n=960140 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 93051 traces, 93051 summary
Retagger: tagging trace set: gauss with 73079 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 73079 traces tagged "gauss"
FrameSaver: q=2.57307e+06 n=1156184 tag=gauss
wclsFrameSaver: saving 93051 traces tagged "wiener"
FrameSaver: q=3.04455e+06 n=1093777 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 74558 traces, 74558 summary
Retagger: tagging trace set: gauss with 57293 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 57293 traces tagged "gauss"
FrameSaver: q=1.83296e+06 n=879146 tag=gauss
wclsFrameSaver: saving 74558 traces tagged "wiener"
FrameSaver: q=2.07994e+06 n=842805 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 81565 traces, 81565 summary
Retagger: tagging trace set: gauss with 65089 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 65089 traces tagged "gauss"
FrameSaver: q=1.87578e+06 n=1026050 tag=gauss
wclsFrameSaver: saving 81565 traces tagged "wiener"
FrameSaver: q=2.11575e+06 n=950675 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 105247 traces, 105247 summary
Retagger: tagging trace set: gauss with 78722 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 78722 traces tagged "gauss"
FrameSaver: q=2.7174e+06 n=1254225 tag=gauss
wclsFrameSaver: saving 105247 traces tagged "wiener"
FrameSaver: q=3.14531e+06 n=1217474 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 72414 traces, 72414 summary
Retagger: tagging trace set: gauss with 56844 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 56844 traces tagged "gauss"
FrameSaver: q=1.4039e+06 n=820371 tag=gauss
wclsFrameSaver: saving 72414 traces tagged "wiener"
FrameSaver: q=1.6678e+06 n=798943 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 67294 traces, 67294 summary
Retagger: tagging trace set: gauss with 54827 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 54827 traces tagged "gauss"
FrameSaver: q=1.31055e+06 n=802831 tag=gauss
wclsFrameSaver: saving 67294 traces tagged "wiener"
FrameSaver: q=1.57598e+06 n=800032 tag=wiener
21-Jun-2025 06:11:41 BST  Closed output file "pdhd_processing_1_226824_138_1750472489_stage1_stage2.root"
21-Jun-2025 06:11:41 BST  Closed input file "pdhd_processing_1_226824_138_1750472489_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                               122.2        214.272       820.511       201.851       103.505        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000632829   0.00273607    0.00729128    0.00273998    0.00153052       40     
produce:fembfilter:PDHDFEMBFilter                      0.767843       1.01955       1.10563       1.06722      0.0955019       40     
produce:wclsdatahd:WireCellToolkit                      51.9443       66.5687       79.7225       68.6676       7.58442        40     
produce:gaushit:GausHitFinder                          0.572826       1.22557       2.10562       1.20347      0.305668        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000392728   0.000579485   0.000832333   0.000575662   0.000119493      40     
produce:reco3d:SpacePointSolver                        0.333546       1.68245       19.4967       1.02932       2.95344        40     
produce:hitpdune:DisambigFromSpacePoints               0.266166      0.875683       2.3491       0.779935      0.411156        40     
produce:pandora:StandardPandora                         11.3254       36.2421       177.909       31.5689       25.8924        40     
produce:pandoraWriter:StandardPandora                  0.152508      0.308424       0.4821       0.294391      0.0660475       40     
produce:pandoraTrack:LArPandoraTrackCreation            1.18341       2.95382       8.03689       2.54405       1.32589        40     
produce:pandoraShower:LArPandoraShowerCreation         0.834747       3.41848       8.95369       3.12859       1.68124        40     
produce:pandoracalo:Calorimetry                        0.391313       1.34556       3.62347       1.13858       0.59331        40     
produce:pandoracalonosce:Calorimetry                   0.369203       1.24244       3.60088       1.01534      0.583833        40     
produce:pandorapid:Chi2ParticleID                     0.00167044    0.00316547    0.00605031    0.00297229    0.000945521      40     
produce:pandoraShowercalo:ShowerCalorimetry            0.604462       3.04617       6.56162       2.78118       1.35896        40     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.606994       2.91067       7.08714       2.66982       1.39333        40     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0860488     0.229174      0.375001      0.231778       0.05997        40     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0350408     0.0778711     0.120528      0.0737303     0.0190493       40     
produce:emtrkmichelid:EmTrackMichelId                   28.313        56.4043       83.8317       56.7087       11.838         40     
[art]:TriggerResults:TriggerResultInserter            2.4886e-05    5.19977e-05   0.000130715   4.65225e-05   2.3133e-05       40     
end_path:out1:RootOutput                               4.298e-06    8.19263e-06    3.204e-05     6.071e-06    4.82986e-06      40     
end_path:michelremoving:michelremoving                 0.0281682     0.135226      0.497023      0.0587627     0.120339        40     
end_path:michelremovinggnocchi:michelremoving          0.0287027     0.131076      0.508516      0.0622091     0.117809        40     
end_path:calibanagnocchi:CalibAnaTree                   9.42419       32.8018       423.981       21.0533       63.4416        40     
end_path:out1:RootOutput(write)                        0.830823       1.41491       2.08399       1.42579      0.276058        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5127.02 MB
  Peak resident set size usage (VmHWM): 2722.99 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'pdhd_processing_1_226824_138_1750472489_stage1_stage2.root', 'tfile_out': 'pdhd_processing_1_226824_138_1750472489_stage1_stage2_tfile.root', 'start_time': 1750474065.9428139, 'end_time': 1750482702.4293187}
justIN time: 2025-08-22 02:59:13 UTC       justIN version: 01.03.02