justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 419148.65@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID419148.65@justin-prod-sched01.dune.hep.ac.uk
Workflow ID7814
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-20 20:19:41
SiteUK_Manchester
EntryUBoone_T2_UK_Manchester_ce02
Last heartbeat2025-06-21 05:10:32
From worker nodeHostnamewn6219300.tier2.hep.manchester.ac.uk
cpuinfoAMD EPYC 7702P 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes8387559424 (7999 MiB)
Wall seconds limit257400 (71 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-21 02:45:22
Input fileshd-protodune:np04hd_raw_run027087_0440_dataflow0_datawriter_0_20240614T184134.hdf5
JobscriptExit code0
Real time2h (8659s)
CPU time2h (8172s = 94%)
Max RSS bytes2718371840 (2592 MiB)
Outputting started2025-06-21 05:09:42
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07814/1/002/pdhd_processing_1_419148_65_1750473938_stage1_stage2.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07814/1/002/pdhd_processing_1_419148_65_1750473938_stage1_stage2_tfile.root
Finished2025-06-21 05:10:32
Saved logsjustin-logs:419148.65-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

q=1.95055e+06 n=954044 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 86135 traces, 86135 summary
Retagger: tagging trace set: gauss with 67766 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 67766 traces tagged "gauss"
FrameSaver: q=1.97665e+06 n=1091688 tag=gauss
wclsFrameSaver: saving 86135 traces tagged "wiener"
FrameSaver: q=2.22049e+06 n=1021184 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 89638 traces, 89638 summary
Retagger: tagging trace set: gauss with 70887 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 70887 traces tagged "gauss"
FrameSaver: q=2.00656e+06 n=1073651 tag=gauss
wclsFrameSaver: saving 89638 traces tagged "wiener"
FrameSaver: q=2.37921e+06 n=1040039 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 105527 traces, 105527 summary
Retagger: tagging trace set: gauss with 77280 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 77280 traces tagged "gauss"
FrameSaver: q=2.72834e+06 n=1276782 tag=gauss
wclsFrameSaver: saving 105527 traces tagged "wiener"
FrameSaver: q=3.09626e+06 n=1214283 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 81228 traces, 81228 summary
Retagger: tagging trace set: gauss with 64038 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 64038 traces tagged "gauss"
FrameSaver: q=1.84311e+06 n=989399 tag=gauss
wclsFrameSaver: saving 81228 traces tagged "wiener"
FrameSaver: q=2.11796e+06 n=948386 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 75567 traces, 75567 summary
Retagger: tagging trace set: gauss with 61338 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 61338 traces tagged "gauss"
FrameSaver: q=1.581e+06 n=930628 tag=gauss
wclsFrameSaver: saving 75567 traces tagged "wiener"
FrameSaver: q=1.7994e+06 n=867315 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 92040 traces, 92040 summary
Retagger: tagging trace set: gauss with 73017 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 73017 traces tagged "gauss"
FrameSaver: q=2.24844e+06 n=1218976 tag=gauss
wclsFrameSaver: saving 92040 traces tagged "wiener"
FrameSaver: q=2.52013e+06 n=1154534 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 59233 traces, 59233 summary
Retagger: tagging trace set: gauss with 48366 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 48366 traces tagged "gauss"
FrameSaver: q=1.20948e+06 n=704044 tag=gauss
wclsFrameSaver: saving 59233 traces tagged "wiener"
FrameSaver: q=1.35676e+06 n=662406 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 68348 traces, 68348 summary
Retagger: tagging trace set: gauss with 55262 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 55262 traces tagged "gauss"
FrameSaver: q=1.32292e+06 n=796328 tag=gauss
wclsFrameSaver: saving 68348 traces tagged "wiener"
FrameSaver: q=1.50791e+06 n=749555 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 92006 traces, 92006 summary
Retagger: tagging trace set: gauss with 72758 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 72758 traces tagged "gauss"
FrameSaver: q=2.2195e+06 n=1178892 tag=gauss
wclsFrameSaver: saving 92006 traces tagged "wiener"
FrameSaver: q=2.5541e+06 n=1117051 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 71171 traces, 71171 summary
Retagger: tagging trace set: gauss with 55729 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 55729 traces tagged "gauss"
FrameSaver: q=1.99184e+06 n=889658 tag=gauss
wclsFrameSaver: saving 71171 traces tagged "wiener"
FrameSaver: q=2.24947e+06 n=861007 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 79254 traces, 79254 summary
Retagger: tagging trace set: gauss with 60699 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 60699 traces tagged "gauss"
FrameSaver: q=1.6397e+06 n=898907 tag=gauss
wclsFrameSaver: saving 79254 traces tagged "wiener"
FrameSaver: q=1.88478e+06 n=844475 tag=wiener
21-Jun-2025 06:09:40 BST  Closed output file "pdhd_processing_1_419148_65_1750473938_stage1_stage2.root"
21-Jun-2025 06:09:40 BST  Closed input file "pdhd_processing_1_419148_65_1750473938_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              92.7957       174.414       297.684       166.689       43.2027        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000445141   0.00280176    0.00730341    0.00258447    0.00168029       40     
produce:fembfilter:PDHDFEMBFilter                      0.724546      0.968411       1.1118        1.0003       0.110244        40     
produce:wclsdatahd:WireCellToolkit                      39.8779       51.5223       59.4903       52.0508       4.23843        40     
produce:gaushit:GausHitFinder                          0.493167       1.15959       1.78745       1.15661       0.28916        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000353567   0.000512605   0.00083144    0.000482501   0.000117068      40     
produce:reco3d:SpacePointSolver                        0.202557       1.27321       4.73937       1.04518       0.92551        40     
produce:hitpdune:DisambigFromSpacePoints               0.189425       0.79355       1.52233      0.755831      0.363478        40     
produce:pandora:StandardPandora                         11.0027       31.3532       69.8081       29.9029       14.1001        40     
produce:pandoraWriter:StandardPandora                   0.13032      0.286733      0.453613      0.288178      0.0749576       40     
produce:pandoraTrack:LArPandoraTrackCreation           0.684292       2.64653       6.8507        2.48055       1.27066        40     
produce:pandoraShower:LArPandoraShowerCreation         0.452843       3.05073       7.42216       2.75621       1.62292        40     
produce:pandoracalo:Calorimetry                        0.346969       1.20652       2.90464       1.00185      0.607833        40     
produce:pandoracalonosce:Calorimetry                   0.344127       1.08751       2.90196      0.945567      0.588551        40     
produce:pandorapid:Chi2ParticleID                     0.00158048    0.00289723    0.00491538    0.00270526    0.000784777      40     
produce:pandoraShowercalo:ShowerCalorimetry            0.368435       2.7291        7.61217       2.38504       1.54077        40     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.356106       2.56993       6.80096       2.30822       1.37867        40     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0847849     0.215492      0.381097      0.220509      0.0635414       40     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0295141     0.0731105     0.124783      0.0736256     0.0206037       40     
produce:emtrkmichelid:EmTrackMichelId                   26.116        45.6531       75.4103       44.1316       10.5824        40     
[art]:TriggerResults:TriggerResultInserter            2.2302e-05    6.71802e-05   0.000706824   4.61225e-05   0.000105161      40     
end_path:out1:RootOutput                               4.368e-06    8.64657e-06   4.1378e-05    6.0415e-06    7.32468e-06      40     
end_path:michelremoving:michelremoving                 0.0213639     0.132887       0.41048      0.0540739      0.12153        40     
end_path:michelremovinggnocchi:michelremoving          0.0210805     0.132434      0.404622      0.0542764      0.12349        40     
end_path:calibanagnocchi:CalibAnaTree                   10.1501       25.9954       70.1786       21.5284       15.5313        40     
end_path:out1:RootOutput(write)                        0.668461       1.34062       1.97385       1.3599       0.319243        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5107.88 MB
  Peak resident set size usage (VmHWM): 2718.37 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'pdhd_processing_1_419148_65_1750473938_stage1_stage2.root', 'tfile_out': 'pdhd_processing_1_419148_65_1750473938_stage1_stage2_tfile.root', 'start_time': 1750475536.6072736, 'end_time': 1750482581.9334261}
justIN time: 2025-08-22 03:01:05 UTC       justIN version: 01.03.02