justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 226820.1@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID226820.1@justin-prod-sched02.dune.hep.ac.uk
Workflow ID7814
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-20 20:16:59
SiteFR_CCIN2P3
EntryDUNE_FR_CCIN2P3_cccondorce01
Last heartbeat2025-06-21 01:01:01
From worker nodeHostnameccwcondor0693
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes8387559424 (7999 MiB)
Wall seconds limit106200 (29 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-20 23:21:50
Input fileshd-protodune:np04hd_raw_run027087_0158_dataflow1_datawriter_0_20240614T161019.hdf5
JobscriptExit code0
Real time1h (5910s)
CPU time1h (5274s = 89%)
Max RSS bytes2685140992 (2560 MiB)
Outputting started2025-06-21 01:00:21
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07814/1/002/pdhd_processing_1_226820_1_1750461720_stage1_stage2.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07814/1/002/pdhd_processing_1_226820_1_1750461720_stage1_stage2_tfile.root
Finished2025-06-21 01:01:01
Saved logsjustin-logs:226820.1-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

FrameSaver: q=1.61916e+06 n=821263 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 80907 traces, 80907 summary
Retagger: tagging trace set: gauss with 63286 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 63286 traces tagged "gauss"
FrameSaver: q=1.78571e+06 n=975636 tag=gauss
wclsFrameSaver: saving 80907 traces tagged "wiener"
FrameSaver: q=2.04642e+06 n=918537 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 77864 traces, 77864 summary
Retagger: tagging trace set: gauss with 62592 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 62592 traces tagged "gauss"
FrameSaver: q=1.6008e+06 n=909673 tag=gauss
wclsFrameSaver: saving 77864 traces tagged "wiener"
FrameSaver: q=1.87399e+06 n=854385 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 91060 traces, 91060 summary
Retagger: tagging trace set: gauss with 68401 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 68401 traces tagged "gauss"
FrameSaver: q=2.23948e+06 n=1059705 tag=gauss
wclsFrameSaver: saving 91060 traces tagged "wiener"
FrameSaver: q=2.62097e+06 n=1016889 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 98578 traces, 98578 summary
Retagger: tagging trace set: gauss with 77441 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 77441 traces tagged "gauss"
FrameSaver: q=2.4092e+06 n=1244424 tag=gauss
wclsFrameSaver: saving 98578 traces tagged "wiener"
FrameSaver: q=2.78952e+06 n=1190347 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 89872 traces, 89872 summary
Retagger: tagging trace set: gauss with 70720 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 70720 traces tagged "gauss"
FrameSaver: q=1.79212e+06 n=1022936 tag=gauss
wclsFrameSaver: saving 89872 traces tagged "wiener"
FrameSaver: q=2.13501e+06 n=962087 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 60367 traces, 60367 summary
Retagger: tagging trace set: gauss with 50715 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 50715 traces tagged "gauss"
FrameSaver: q=1.1598e+06 n=740284 tag=gauss
wclsFrameSaver: saving 60367 traces tagged "wiener"
FrameSaver: q=1.30766e+06 n=695881 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 77188 traces, 77188 summary
Retagger: tagging trace set: gauss with 62448 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 62448 traces tagged "gauss"
FrameSaver: q=1.55028e+06 n=947821 tag=gauss
wclsFrameSaver: saving 77188 traces tagged "wiener"
FrameSaver: q=1.7842e+06 n=909172 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 79395 traces, 79395 summary
Retagger: tagging trace set: gauss with 63526 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 63526 traces tagged "gauss"
FrameSaver: q=1.65805e+06 n=962170 tag=gauss
wclsFrameSaver: saving 79395 traces tagged "wiener"
FrameSaver: q=1.92268e+06 n=907791 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 80239 traces, 80239 summary
Retagger: tagging trace set: gauss with 64499 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 64499 traces tagged "gauss"
FrameSaver: q=1.85647e+06 n=1019594 tag=gauss
wclsFrameSaver: saving 80239 traces tagged "wiener"
FrameSaver: q=2.12821e+06 n=949704 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 57689 traces, 57689 summary
Retagger: tagging trace set: gauss with 49812 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 49812 traces tagged "gauss"
FrameSaver: q=1.10731e+06 n=736725 tag=gauss
wclsFrameSaver: saving 57689 traces tagged "wiener"
FrameSaver: q=1.23983e+06 n=699740 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 80796 traces, 80796 summary
Retagger: tagging trace set: gauss with 64292 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 64292 traces tagged "gauss"
FrameSaver: q=2.13e+06 n=1020661 tag=gauss
wclsFrameSaver: saving 80796 traces tagged "wiener"
FrameSaver: q=2.40545e+06 n=945497 tag=wiener
21-Jun-2025 03:00:20 CEST  Closed output file "pdhd_processing_1_226820_1_1750461720_stage1_stage2.root"
21-Jun-2025 03:00:20 CEST  Closed input file "pdhd_processing_1_226820_1_1750461720_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              44.5937       114.036       160.826       110.693       26.2943        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000562524   0.00292079    0.00572462    0.00285354    0.00151241       40     
produce:fembfilter:PDHDFEMBFilter                       0.55962      0.731495      0.980114      0.717283      0.103788        40     
produce:wclsdatahd:WireCellToolkit                      36.6632       40.474        43.3501       40.6814       1.58996        40     
produce:gaushit:GausHitFinder                          0.399392      0.633132      0.835004      0.629677      0.123188        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000236117   0.000431964   0.00085666    0.000414574   0.000149584      40     
produce:reco3d:SpacePointSolver                        0.126661      0.687433       1.55273      0.548741      0.398523        39     
produce:hitpdune:DisambigFromSpacePoints               0.133715      0.464515      0.951766      0.416347      0.210931        39     
produce:pandora:StandardPandora                         6.61817       19.8651       44.6469       18.3454       9.59582        39     
produce:pandoraWriter:StandardPandora                  0.083465      0.161933       0.27129       0.1588       0.0423232       39     
produce:pandoraTrack:LArPandoraTrackCreation           0.637379       1.40825       2.72688       1.33742      0.497308        39     
produce:pandoraShower:LArPandoraShowerCreation         0.515942       1.71496       3.65063       1.47568      0.781547        39     
produce:pandoracalo:Calorimetry                        0.333104      0.675488       1.17037      0.660572       0.21155        39     
produce:pandoracalonosce:Calorimetry                   0.298687      0.625856       1.13101       0.61277      0.200561        39     
produce:pandorapid:Chi2ParticleID                     0.00115326    0.00167527    0.00287572    0.00155875    0.000394797      39     
produce:pandoraShowercalo:ShowerCalorimetry            0.530704       1.55765       3.19272       1.36859      0.681037        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.455994       1.51128       3.67646       1.33888      0.686181        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.0651458     0.121647      0.194037      0.120801      0.0279365       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0230089     0.0411017     0.0611312     0.0414929     0.0089336       39     
produce:emtrkmichelid:EmTrackMichelId                   15.6841       30.6674       44.6929       28.8188       7.5225         39     
[art]:TriggerResults:TriggerResultInserter             1.586e-05    3.06784e-05    7.427e-05    2.4551e-05    1.49651e-05      40     
end_path:out1:RootOutput                               3.737e-06    9.11467e-06   3.6208e-05    7.2585e-06    5.70149e-06      40     
end_path:michelremoving:michelremoving                6.5644e-05     0.0622069      0.28599      0.0321408     0.0660279       40     
end_path:michelremovinggnocchi:michelremoving         3.4986e-05     0.0580336     0.280168      0.0269667     0.0657718       40     
end_path:calibanagnocchi:CalibAnaTree                 1.1962e-05      13.0945       33.2981       10.3627       6.81025        40     
end_path:out1:RootOutput(write)                        0.286655      0.826689       1.15093      0.825741      0.189531        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5079.34 MB
  Peak resident set size usage (VmHWM): 2685.14 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'pdhd_processing_1_226820_1_1750461720_stage1_stage2.root', 'tfile_out': 'pdhd_processing_1_226820_1_1750461720_stage1_stage2_tfile.root', 'start_time': 1750463022.41226, 'end_time': 1750467621.0811026}
justIN time: 2025-08-21 19:09:32 UTC       justIN version: 01.03.02