justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 419148.9@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID419148.9@justin-prod-sched01.dune.hep.ac.uk
Workflow ID7814
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-20 20:19:41
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2025-06-21 05:04:59
From worker nodeHostnamedune001-6394508.0-host-172-16-100-226.nubes.stfc.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes8387559424 (7999 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-21 02:44:21
Input fileshd-protodune:np04hd_raw_run027087_0413_dataflow0_datawriter_0_20240614T182709.hdf5
JobscriptExit code0
Real time2h (8381s)
CPU time2h (8115s = 96%)
Max RSS bytes2722316288 (2596 MiB)
Outputting started2025-06-21 05:04:03
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07814/1/002/pdhd_processing_1_419148_9_1750473879_stage1_stage2.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07814/1/002/pdhd_processing_1_419148_9_1750473879_stage1_stage2_tfile.root
Finished2025-06-21 05:04:59
Saved logsjustin-logs:419148.9-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

q=2.1646e+06 n=998112 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 92589 traces, 92589 summary
Retagger: tagging trace set: gauss with 72000 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 72000 traces tagged "gauss"
FrameSaver: q=2.21437e+06 n=1179753 tag=gauss
wclsFrameSaver: saving 92589 traces tagged "wiener"
FrameSaver: q=2.4893e+06 n=1109309 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 80952 traces, 80952 summary
Retagger: tagging trace set: gauss with 62861 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 62861 traces tagged "gauss"
FrameSaver: q=1.74699e+06 n=947392 tag=gauss
wclsFrameSaver: saving 80952 traces tagged "wiener"
FrameSaver: q=2.01885e+06 n=888561 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 91371 traces, 91371 summary
Retagger: tagging trace set: gauss with 72372 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 72372 traces tagged "gauss"
FrameSaver: q=2.28631e+06 n=1206594 tag=gauss
wclsFrameSaver: saving 91371 traces tagged "wiener"
FrameSaver: q=2.56301e+06 n=1132309 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 68115 traces, 68115 summary
Retagger: tagging trace set: gauss with 54340 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 54340 traces tagged "gauss"
FrameSaver: q=1.32769e+06 n=789605 tag=gauss
wclsFrameSaver: saving 68115 traces tagged "wiener"
FrameSaver: q=1.5507e+06 n=761207 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 78530 traces, 78530 summary
Retagger: tagging trace set: gauss with 63460 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 63460 traces tagged "gauss"
FrameSaver: q=1.63539e+06 n=976913 tag=gauss
wclsFrameSaver: saving 78530 traces tagged "wiener"
FrameSaver: q=1.89434e+06 n=928226 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 100270 traces, 100270 summary
Retagger: tagging trace set: gauss with 73450 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 73450 traces tagged "gauss"
FrameSaver: q=2.27436e+06 n=1142967 tag=gauss
wclsFrameSaver: saving 100270 traces tagged "wiener"
FrameSaver: q=2.67585e+06 n=1098525 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 77031 traces, 77031 summary
Retagger: tagging trace set: gauss with 60220 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 60220 traces tagged "gauss"
FrameSaver: q=2.35272e+06 n=961319 tag=gauss
wclsFrameSaver: saving 77031 traces tagged "wiener"
FrameSaver: q=2.61415e+06 n=934993 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 78670 traces, 78670 summary
Retagger: tagging trace set: gauss with 63028 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 63028 traces tagged "gauss"
FrameSaver: q=1.85788e+06 n=1012293 tag=gauss
wclsFrameSaver: saving 78670 traces tagged "wiener"
FrameSaver: q=2.10717e+06 n=970664 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 81985 traces, 81985 summary
Retagger: tagging trace set: gauss with 65265 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 65265 traces tagged "gauss"
FrameSaver: q=1.97389e+06 n=1084477 tag=gauss
wclsFrameSaver: saving 81985 traces tagged "wiener"
FrameSaver: q=2.2275e+06 n=1033708 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 88393 traces, 88393 summary
Retagger: tagging trace set: gauss with 69311 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 69311 traces tagged "gauss"
FrameSaver: q=2.05292e+06 n=1136690 tag=gauss
wclsFrameSaver: saving 88393 traces tagged "wiener"
FrameSaver: q=2.30065e+06 n=1058196 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 76166 traces, 76166 summary
Retagger: tagging trace set: gauss with 61302 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 61302 traces tagged "gauss"
FrameSaver: q=1.94082e+06 n=1015549 tag=gauss
wclsFrameSaver: saving 76166 traces tagged "wiener"
FrameSaver: q=2.22181e+06 n=958263 tag=wiener
21-Jun-2025 05:04:01 UTC  Closed output file "pdhd_processing_1_419148_9_1750473879_stage1_stage2.root"
21-Jun-2025 05:04:01 UTC  Closed input file "pdhd_processing_1_419148_9_1750473879_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              75.4088       176.491       334.62        155.092       61.1211        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00108441     0.0054897     0.0160271    0.00525857    0.00321159       40     
produce:fembfilter:PDHDFEMBFilter                      0.581368      0.755172       1.00683      0.794188      0.116623        40     
produce:wclsdatahd:WireCellToolkit                      35.8742       49.5293       66.5718       52.1055       8.56314        40     
produce:gaushit:GausHitFinder                          0.394038      0.969749       1.56688      0.935584      0.282898        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000401352   0.00140074    0.00278296    0.00133799    0.000547252      40     
produce:reco3d:SpacePointSolver                        0.170034       1.55247       9.66074       0.86193       1.96091        40     
produce:hitpdune:DisambigFromSpacePoints               0.157788       0.71933       1.75975      0.637006      0.369936        40     
produce:pandora:StandardPandora                         6.27639       27.2773       112.227       21.4009       19.2136        40     
produce:pandoraWriter:StandardPandora                  0.0992143     0.297914      0.496513      0.302413      0.0992086       40     
produce:pandoraTrack:LArPandoraTrackCreation            0.7405        4.98584       13.5088       4.21379       2.85793        40     
produce:pandoraShower:LArPandoraShowerCreation         0.648459       6.51421       24.4191       5.10512       4.84286        40     
produce:pandoracalo:Calorimetry                        0.337505       2.05113       7.5348        1.71378       1.41435        40     
produce:pandoracalonosce:Calorimetry                   0.313008       1.92115       7.0481        1.58172       1.32107        40     
produce:pandorapid:Chi2ParticleID                     0.00149908    0.00379024    0.00771575    0.00368621    0.00152728       40     
produce:pandoraShowercalo:ShowerCalorimetry            0.576632       4.89102       15.4366       3.66107       3.46062        40     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.580611       4.62915       11.4398       3.55421       3.17022        40     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0631199     0.191953      0.337675      0.188384      0.0663369       40     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0233764     0.0736222     0.126353      0.0747632     0.0250771       40     
produce:emtrkmichelid:EmTrackMichelId                   18.6495       45.5459       69.6957       43.054        11.2618        40     
[art]:TriggerResults:TriggerResultInserter            2.3529e-05    0.000115456   0.000243031   0.000113635   5.52998e-05      40     
end_path:out1:RootOutput                              1.0389e-05    3.42152e-05    8.003e-05    3.54905e-05   1.69613e-05      40     
end_path:michelremoving:michelremoving                 0.0194829     0.139897      0.508289      0.089014      0.126068        40     
end_path:michelremovinggnocchi:michelremoving          0.0158684     0.132555      0.514548      0.0967263     0.120726        40     
end_path:calibanagnocchi:CalibAnaTree                   7.77429       22.7881       113.986       15.7531       21.0845        40     
end_path:out1:RootOutput(write)                        0.515398       1.05072       1.71681       1.00817      0.288064        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5248.17 MB
  Peak resident set size usage (VmHWM): 2722.32 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'pdhd_processing_1_419148_9_1750473879_stage1_stage2.root', 'tfile_out': 'pdhd_processing_1_419148_9_1750473879_stage1_stage2_tfile.root', 'start_time': 1750475115.6539285, 'end_time': 1750482242.8530812}
justIN time: 2025-08-22 03:02:44 UTC       justIN version: 01.03.02