justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 418934.153@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID418934.153@justin-prod-sched01.dune.hep.ac.uk
Workflow ID7811
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-20 16:39:59
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce16-multicore
Last heartbeat2025-06-20 23:53:59
From worker nodeHostnametd835.pic.es
cpuinfoAMD EPYC 7452 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes8387559424 (7999 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-20 21:03:55
Input fileshd-protodune:np04hd_raw_run027087_0419_dataflow1_datawriter_0_20240614T183029.hdf5
JobscriptExit code0
Real time2h (10159s)
CPU time2h (8958s = 88%)
Max RSS bytes2711068672 (2585 MiB)
Outputting started2025-06-20 23:53:15
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07811/1/002/pdhd_processing_1_418934_153_1750453520_stage1_stage2.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07811/1/002/pdhd_processing_1_418934_153_1750453520_stage1_stage2_tfile.root
Finished2025-06-20 23:53:55
Saved logsjustin-logs:418934.153-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

3069e+06 n=772040 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 95538 traces, 95538 summary
Retagger: tagging trace set: gauss with 73183 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 73183 traces tagged "gauss"
FrameSaver: q=2.40297e+06 n=1189121 tag=gauss
wclsFrameSaver: saving 95538 traces tagged "wiener"
FrameSaver: q=2.76985e+06 n=1139423 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 108810 traces, 108810 summary
Retagger: tagging trace set: gauss with 84334 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 84334 traces tagged "gauss"
FrameSaver: q=2.71047e+06 n=1356136 tag=gauss
wclsFrameSaver: saving 108810 traces tagged "wiener"
FrameSaver: q=3.19891e+06 n=1315705 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 86981 traces, 86981 summary
Retagger: tagging trace set: gauss with 67324 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 67324 traces tagged "gauss"
FrameSaver: q=2.02189e+06 n=1026184 tag=gauss
wclsFrameSaver: saving 86981 traces tagged "wiener"
FrameSaver: q=2.35435e+06 n=981546 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 70386 traces, 70386 summary
Retagger: tagging trace set: gauss with 56282 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 56282 traces tagged "gauss"
FrameSaver: q=1.40207e+06 n=800146 tag=gauss
wclsFrameSaver: saving 70386 traces tagged "wiener"
FrameSaver: q=1.65021e+06 n=777185 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 73778 traces, 73778 summary
Retagger: tagging trace set: gauss with 59145 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 59145 traces tagged "gauss"
FrameSaver: q=1.39595e+06 n=810771 tag=gauss
wclsFrameSaver: saving 73778 traces tagged "wiener"
FrameSaver: q=1.69125e+06 n=780445 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 82388 traces, 82388 summary
Retagger: tagging trace set: gauss with 65355 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 65355 traces tagged "gauss"
FrameSaver: q=1.91655e+06 n=1081853 tag=gauss
wclsFrameSaver: saving 82388 traces tagged "wiener"
FrameSaver: q=2.14147e+06 n=1015117 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 90482 traces, 90482 summary
Retagger: tagging trace set: gauss with 70707 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 70707 traces tagged "gauss"
FrameSaver: q=2.1662e+06 n=1170501 tag=gauss
wclsFrameSaver: saving 90482 traces tagged "wiener"
FrameSaver: q=2.51276e+06 n=1113934 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 53452 traces, 53452 summary
Retagger: tagging trace set: gauss with 45181 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 45181 traces tagged "gauss"
FrameSaver: q=894222 n=622847 tag=gauss
wclsFrameSaver: saving 53452 traces tagged "wiener"
FrameSaver: q=1.03265e+06 n=597456 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 80847 traces, 80847 summary
Retagger: tagging trace set: gauss with 62599 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 62599 traces tagged "gauss"
FrameSaver: q=1.69759e+06 n=959517 tag=gauss
wclsFrameSaver: saving 80847 traces tagged "wiener"
FrameSaver: q=1.95028e+06 n=896856 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 77924 traces, 77924 summary
Retagger: tagging trace set: gauss with 61951 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 61951 traces tagged "gauss"
FrameSaver: q=1.65343e+06 n=952350 tag=gauss
wclsFrameSaver: saving 77924 traces tagged "wiener"
FrameSaver: q=1.86525e+06 n=886645 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 86814 traces, 86814 summary
Retagger: tagging trace set: gauss with 67661 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 67661 traces tagged "gauss"
FrameSaver: q=1.94138e+06 n=1019975 tag=gauss
wclsFrameSaver: saving 86814 traces tagged "wiener"
FrameSaver: q=2.31199e+06 n=1003197 tag=wiener
21-Jun-2025 01:53:13 CEST  Closed output file "pdhd_processing_1_418934_153_1750453520_stage1_stage2.root"
21-Jun-2025 01:53:13 CEST  Closed input file "pdhd_processing_1_418934_153_1750453520_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              116.477       198.698       334.149       190.208       49.3266        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.00079161    0.00408501    0.00808021    0.00416576    0.00203111       40     
produce:fembfilter:PDHDFEMBFilter                      0.767477       1.04349       1.23115       1.05473      0.0859699       40     
produce:wclsdatahd:WireCellToolkit                      49.1996       58.1586       71.0179       57.2127       5.87162        40     
produce:gaushit:GausHitFinder                          0.480037       1.29676       2.08881       1.32855      0.326034        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000414215   0.000946351    0.0013198    0.000986802   0.000215246      40     
produce:reco3d:SpacePointSolver                        0.221446       1.46984       5.29745       1.21603      0.980903        40     
produce:hitpdune:DisambigFromSpacePoints               0.165838      0.912295       1.94959       0.8576       0.425056        40     
produce:pandora:StandardPandora                         9.81565       37.7444        81.62        36.6512       15.9461        40     
produce:pandoraWriter:StandardPandora                  0.185034      0.364458      0.544687      0.361368      0.0904094       40     
produce:pandoraTrack:LArPandoraTrackCreation            1.31327       3.66712       8.99712       3.74857       1.6926         40     
produce:pandoraShower:LArPandoraShowerCreation          0.81436       4.32878       10.9391       3.89574       2.62527        40     
produce:pandoracalo:Calorimetry                        0.567307       1.68619       4.66327       1.52427      0.906731        40     
produce:pandoracalonosce:Calorimetry                   0.536511       1.70364       4.99247       1.52459      0.968917        40     
produce:pandorapid:Chi2ParticleID                     0.00191796    0.00356155     0.0062263    0.00357155    0.000879004      40     
produce:pandoraShowercalo:ShowerCalorimetry            0.711957       3.77037       9.79156       3.13084       2.3852         40     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.668201       3.54329       9.48266       3.29972       2.18856        40     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.120312      0.244951       0.48727      0.249797      0.0769766       40     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0383753     0.0783196     0.128615      0.0853115     0.024875        40     
produce:emtrkmichelid:EmTrackMichelId                   28.8795       48.8374       77.4272       47.7114       11.7046        40     
[art]:TriggerResults:TriggerResultInserter            2.5721e-05    7.87856e-05   0.000241233   7.6441e-05    3.26182e-05      40     
end_path:out1:RootOutput                               5.37e-06     1.60395e-05    4.448e-05    1.3275e-05    8.2821e-06       40     
end_path:michelremoving:michelremoving                 0.0310322     0.167182      0.601041      0.0810244      0.15168        40     
end_path:michelremovinggnocchi:michelremoving          0.0316051     0.160964      0.594002      0.0738518     0.149098        40     
end_path:calibanagnocchi:CalibAnaTree                   11.2277       27.7493       78.0767       23.0087       16.2487        40     
end_path:out1:RootOutput(write)                        0.568025       1.48865       2.28945       1.51464      0.404941        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5116.57 MB
  Peak resident set size usage (VmHWM): 2711.07 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'pdhd_processing_1_418934_153_1750453520_stage1_stage2.root', 'tfile_out': 'pdhd_processing_1_418934_153_1750453520_stage1_stage2_tfile.root', 'start_time': 1750455556.953332, 'end_time': 1750463594.9286966}
justIN time: 2025-08-15 08:10:00 UTC       justIN version: 01.03.02