justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 418934.159@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID418934.159@justin-prod-sched01.dune.hep.ac.uk
Workflow ID7811
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-20 16:39:59
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce16-multicore
Last heartbeat2025-06-20 23:45:13
From worker nodeHostnametd835.pic.es
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes8387559424 (7999 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-20 21:07:26
Input fileshd-protodune:np04hd_raw_run027087_0420_dataflow1_datawriter_0_20240614T183058.hdf5
JobscriptExit code0
Real time2h (9415s)
CPU time2h (8437s = 89%)
Max RSS bytes2700324864 (2575 MiB)
Outputting started2025-06-20 23:44:22
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07811/1/002/pdhd_processing_1_418934_159_1750453660_stage1_stage2.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07811/1/002/pdhd_processing_1_418934_159_1750453660_stage1_stage2_tfile.root
Finished2025-06-20 23:45:13
Saved logsjustin-logs:418934.159-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

=2.46539e+06 n=1010346 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 70048 traces, 70048 summary
Retagger: tagging trace set: gauss with 57323 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 57323 traces tagged "gauss"
FrameSaver: q=1.41353e+06 n=854999 tag=gauss
wclsFrameSaver: saving 70048 traces tagged "wiener"
FrameSaver: q=1.65488e+06 n=828013 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 82808 traces, 82808 summary
Retagger: tagging trace set: gauss with 66121 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 66121 traces tagged "gauss"
FrameSaver: q=1.83133e+06 n=988492 tag=gauss
wclsFrameSaver: saving 82808 traces tagged "wiener"
FrameSaver: q=2.14394e+06 n=931374 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 89994 traces, 89994 summary
Retagger: tagging trace set: gauss with 68699 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 68699 traces tagged "gauss"
FrameSaver: q=2.10965e+06 n=1060864 tag=gauss
wclsFrameSaver: saving 89994 traces tagged "wiener"
FrameSaver: q=2.47085e+06 n=1034113 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 89023 traces, 89023 summary
Retagger: tagging trace set: gauss with 68340 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 68340 traces tagged "gauss"
FrameSaver: q=1.84632e+06 n=1026975 tag=gauss
wclsFrameSaver: saving 89023 traces tagged "wiener"
FrameSaver: q=2.17337e+06 n=978723 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 99185 traces, 99185 summary
Retagger: tagging trace set: gauss with 75789 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 75789 traces tagged "gauss"
FrameSaver: q=2.63464e+06 n=1288317 tag=gauss
wclsFrameSaver: saving 99185 traces tagged "wiener"
FrameSaver: q=3.0368e+06 n=1239465 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 84713 traces, 84713 summary
Retagger: tagging trace set: gauss with 66257 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 66257 traces tagged "gauss"
FrameSaver: q=1.89517e+06 n=1035739 tag=gauss
wclsFrameSaver: saving 84713 traces tagged "wiener"
FrameSaver: q=2.15333e+06 n=967344 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 81996 traces, 81996 summary
Retagger: tagging trace set: gauss with 65081 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 65081 traces tagged "gauss"
FrameSaver: q=1.82177e+06 n=1020190 tag=gauss
wclsFrameSaver: saving 81996 traces tagged "wiener"
FrameSaver: q=2.06719e+06 n=958224 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 64833 traces, 64833 summary
Retagger: tagging trace set: gauss with 51454 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 51454 traces tagged "gauss"
FrameSaver: q=1.30188e+06 n=741047 tag=gauss
wclsFrameSaver: saving 64833 traces tagged "wiener"
FrameSaver: q=1.50092e+06 n=710124 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 80513 traces, 80513 summary
Retagger: tagging trace set: gauss with 65001 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 65001 traces tagged "gauss"
FrameSaver: q=1.78816e+06 n=1004171 tag=gauss
wclsFrameSaver: saving 80513 traces tagged "wiener"
FrameSaver: q=2.03523e+06 n=933950 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 74815 traces, 74815 summary
Retagger: tagging trace set: gauss with 60298 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 60298 traces tagged "gauss"
FrameSaver: q=1.66902e+06 n=958876 tag=gauss
wclsFrameSaver: saving 74815 traces tagged "wiener"
FrameSaver: q=1.85593e+06 n=884193 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 55783 traces, 55783 summary
Retagger: tagging trace set: gauss with 47079 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 47079 traces tagged "gauss"
FrameSaver: q=951201 n=637108 tag=gauss
wclsFrameSaver: saving 55783 traces tagged "wiener"
FrameSaver: q=1.11583e+06 n=610250 tag=wiener
21-Jun-2025 01:44:20 CEST  Closed output file "pdhd_processing_1_418934_159_1750453660_stage1_stage2.root"
21-Jun-2025 01:44:20 CEST  Closed input file "pdhd_processing_1_418934_159_1750453660_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              109.71        185.335       264.695       182.143       37.6255        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00103285    0.00418757    0.00780389    0.00431624     0.0019506       40     
produce:fembfilter:PDHDFEMBFilter                      0.747042       1.01547       1.21801       1.03263      0.0950075       40     
produce:wclsdatahd:WireCellToolkit                      48.7088       56.3322       69.3593       55.1073       5.5769         40     
produce:gaushit:GausHitFinder                          0.644539       1.23763       1.9175        1.2802       0.288234        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000374894   0.000899543   0.00164978    0.000939573   0.000206406      40     
produce:reco3d:SpacePointSolver                        0.329127       1.37159       6.18602       1.1835       0.953406        40     
produce:hitpdune:DisambigFromSpacePoints               0.277145      0.877635       1.73763      0.901684      0.363605        40     
produce:pandora:StandardPandora                         11.3438       34.1021       85.0604       30.6734       14.845         40     
produce:pandoraWriter:StandardPandora                  0.192355      0.345255      0.500693      0.356776      0.074822        40     
produce:pandoraTrack:LArPandoraTrackCreation            1.22846       3.08552       7.13809       2.90025       1.2751         40     
produce:pandoraShower:LArPandoraShowerCreation         0.869369       3.55852       8.19017       3.36523       1.73738        40     
produce:pandoracalo:Calorimetry                        0.566564       1.45303       3.10428       1.43632      0.562865        40     
produce:pandoracalonosce:Calorimetry                   0.504156        1.422        3.62167       1.33244      0.593502        40     
produce:pandorapid:Chi2ParticleID                       0.00161     0.00340934     0.0050071    0.00356792    0.000724008      40     
produce:pandoraShowercalo:ShowerCalorimetry            0.744132       3.29261       6.99945       3.31086       1.46042        40     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.756068       3.13251       8.7359        3.11571       1.50382        40     
produce:pandoraGnocchiCalo:GnocchiCalorimetry           0.11014      0.246904      0.383853       0.26285      0.0624264       40     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0411498     0.0806728     0.130639      0.081378      0.0210509       40     
produce:emtrkmichelid:EmTrackMichelId                   24.7532       46.9714       75.5676       46.9523       10.0472        40     
[art]:TriggerResults:TriggerResultInserter             4.518e-05    7.61426e-05   0.000141232   7.5681e-05    1.71024e-05      40     
end_path:out1:RootOutput                               1.031e-05    1.95345e-05    4.42e-05     1.9515e-05    7.63494e-06      40     
end_path:michelremoving:michelremoving                 0.0272282     0.170026      0.815269       0.1458       0.166053        40     
end_path:michelremovinggnocchi:michelremoving          0.0259213     0.165535      0.800626      0.140619      0.164719        40     
end_path:calibanagnocchi:CalibAnaTree                   11.2813       24.7437       60.3999       22.574        10.7631        40     
end_path:out1:RootOutput(write)                        0.845275       1.45953       2.11457       1.49981      0.284885        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5087.46 MB
  Peak resident set size usage (VmHWM): 2700.32 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'pdhd_processing_1_418934_159_1750453660_stage1_stage2.root', 'tfile_out': 'pdhd_processing_1_418934_159_1750453660_stage1_stage2_tfile.root', 'start_time': 1750455581.0909197, 'end_time': 1750463061.9209344}
justIN time: 2025-08-15 08:08:07 UTC       justIN version: 01.03.02