justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 419148.14@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID419148.14@justin-prod-sched01.dune.hep.ac.uk
Workflow ID7814
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-20 20:19:41
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce01
Last heartbeat2025-06-21 05:05:32
From worker nodeHostnamewn1206240.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes8387559424 (7999 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-21 02:43:39
Input fileshd-protodune:np04hd_raw_run027087_0329_dataflow1_datawriter_0_20240614T174201.hdf5
JobscriptExit code0
Real time2h (8458s)
CPU time2h (7908s = 93%)
Max RSS bytes2748243968 (2620 MiB)
Outputting started2025-06-21 05:04:37
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07814/1/002/pdhd_processing_1_419148_14_1750473831_stage1_stage2.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07814/1/002/pdhd_processing_1_419148_14_1750473831_stage1_stage2_tfile.root
Finished2025-06-21 05:05:32
Saved logsjustin-logs:419148.14-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

er: q=3.01078e+06 n=1202229 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 98102 traces, 98102 summary
Retagger: tagging trace set: gauss with 73831 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 73831 traces tagged "gauss"
FrameSaver: q=2.28922e+06 n=1127383 tag=gauss
wclsFrameSaver: saving 98102 traces tagged "wiener"
FrameSaver: q=2.66254e+06 n=1053457 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 98283 traces, 98283 summary
Retagger: tagging trace set: gauss with 72265 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 72265 traces tagged "gauss"
FrameSaver: q=2.30057e+06 n=1111178 tag=gauss
wclsFrameSaver: saving 98283 traces tagged "wiener"
FrameSaver: q=2.70293e+06 n=1079435 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 56122 traces, 56122 summary
Retagger: tagging trace set: gauss with 47788 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 47788 traces tagged "gauss"
FrameSaver: q=904616 n=646594 tag=gauss
wclsFrameSaver: saving 56122 traces tagged "wiener"
FrameSaver: q=1.07475e+06 n=626854 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 80015 traces, 80015 summary
Retagger: tagging trace set: gauss with 64908 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 64908 traces tagged "gauss"
FrameSaver: q=1.70644e+06 n=992686 tag=gauss
wclsFrameSaver: saving 80015 traces tagged "wiener"
FrameSaver: q=1.97195e+06 n=925406 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 78901 traces, 78901 summary
Retagger: tagging trace set: gauss with 60815 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 60815 traces tagged "gauss"
FrameSaver: q=1.88333e+06 n=976877 tag=gauss
wclsFrameSaver: saving 78901 traces tagged "wiener"
FrameSaver: q=2.12897e+06 n=928906 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 98460 traces, 98460 summary
Retagger: tagging trace set: gauss with 71452 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 71452 traces tagged "gauss"
FrameSaver: q=2.30815e+06 n=1108620 tag=gauss
wclsFrameSaver: saving 98460 traces tagged "wiener"
FrameSaver: q=2.66327e+06 n=1047373 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 99365 traces, 99365 summary
Retagger: tagging trace set: gauss with 74806 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 74806 traces tagged "gauss"
FrameSaver: q=2.35155e+06 n=1171515 tag=gauss
wclsFrameSaver: saving 99365 traces tagged "wiener"
FrameSaver: q=2.74808e+06 n=1144718 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 80960 traces, 80960 summary
Retagger: tagging trace set: gauss with 64203 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 64203 traces tagged "gauss"
FrameSaver: q=1.81951e+06 n=966913 tag=gauss
wclsFrameSaver: saving 80960 traces tagged "wiener"
FrameSaver: q=2.08316e+06 n=917367 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 62973 traces, 62973 summary
Retagger: tagging trace set: gauss with 51070 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 51070 traces tagged "gauss"
FrameSaver: q=1.11421e+06 n=698519 tag=gauss
wclsFrameSaver: saving 62973 traces tagged "wiener"
FrameSaver: q=1.31476e+06 n=668305 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 72214 traces, 72214 summary
Retagger: tagging trace set: gauss with 58191 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 58191 traces tagged "gauss"
FrameSaver: q=1.65277e+06 n=890820 tag=gauss
wclsFrameSaver: saving 72214 traces tagged "wiener"
FrameSaver: q=1.86511e+06 n=841849 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 69049 traces, 69049 summary
Retagger: tagging trace set: gauss with 55233 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 55233 traces tagged "gauss"
FrameSaver: q=1.42078e+06 n=789965 tag=gauss
wclsFrameSaver: saving 69049 traces tagged "wiener"
FrameSaver: q=1.68652e+06 n=747245 tag=wiener
21-Jun-2025 06:04:36 BST  Closed output file "pdhd_processing_1_419148_14_1750473831_stage1_stage2.root"
21-Jun-2025 06:04:36 BST  Closed input file "pdhd_processing_1_419148_14_1750473831_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              112.461       169.628       263.096       170.62        36.3403        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000468551   0.00309919    0.00723995    0.00290633    0.00174973       40     
produce:fembfilter:PDHDFEMBFilter                      0.741648      0.953981       1.0667        1.01374      0.107561        40     
produce:wclsdatahd:WireCellToolkit                      44.9975       51.1103       64.6732       50.0554       4.7536         40     
produce:gaushit:GausHitFinder                          0.522442       1.07491       1.77063       1.10078      0.267557        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000288984   0.000465553   0.000688766   0.000440529   0.000106694      40     
produce:reco3d:SpacePointSolver                        0.271036       1.16526       4.36786       1.09526      0.762485        40     
produce:hitpdune:DisambigFromSpacePoints               0.219708      0.747877       1.76546      0.755372      0.322369        40     
produce:pandora:StandardPandora                         13.2137       33.1004       86.5948       30.2983       16.1824        40     
produce:pandoraWriter:StandardPandora                   0.16683      0.265255      0.413409      0.254006      0.0657171       40     
produce:pandoraTrack:LArPandoraTrackCreation           0.892008       2.47745       5.90601       2.28786       1.09742        40     
produce:pandoraShower:LArPandoraShowerCreation         0.863524       3.01001       9.05323       2.50083       1.77768        40     
produce:pandoracalo:Calorimetry                        0.395103       1.15954       2.66414       1.04087       0.48547        40     
produce:pandoracalonosce:Calorimetry                   0.388407       1.09288       2.94128      0.979613      0.485325        40     
produce:pandorapid:Chi2ParticleID                     0.00186323    0.00309006    0.00548064    0.00313457    0.000715596      40     
produce:pandoraShowercalo:ShowerCalorimetry            0.685439       2.5863        7.57545       2.20786       1.38096        40     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.714537       2.41394       7.21398       2.04344       1.38954        40     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.117915      0.216921      0.374394      0.214319      0.0569836       40     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0432247     0.0716052     0.121493      0.0713601     0.0179419       40     
produce:emtrkmichelid:EmTrackMichelId                   25.9497       42.7385       60.5687       42.3846       8.28062        40     
[art]:TriggerResults:TriggerResultInserter            2.2483e-05    4.26088e-05   7.0202e-05    3.96995e-05   1.48371e-05      40     
end_path:out1:RootOutput                               4.208e-06    7.35285e-06   2.0148e-05     5.921e-06    3.45389e-06      40     
end_path:michelremoving:michelremoving                 0.0210324      0.11512      0.571957      0.0471449     0.118345        40     
end_path:michelremovinggnocchi:michelremoving          0.0200911     0.113846      0.568647      0.0454356     0.119507        40     
end_path:calibanagnocchi:CalibAnaTree                   11.055        23.7059       48.7713       21.595        10.3492        40     
end_path:out1:RootOutput(write)                         0.80686       1.30034       2.01337       1.29004      0.298417        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5136.11 MB
  Peak resident set size usage (VmHWM): 2748.24 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'pdhd_processing_1_419148_14_1750473831_stage1_stage2.root', 'tfile_out': 'pdhd_processing_1_419148_14_1750473831_stage1_stage2_tfile.root', 'start_time': 1750475427.4334722, 'end_time': 1750482277.5095472}
justIN time: 2025-08-22 03:01:05 UTC       justIN version: 01.03.02