justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.

Jobsub ID 418934.149@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID418934.149@justin-prod-sched01.dune.hep.ac.uk
Workflow ID7811
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune
RequestedProcessors1
GPUNo
RSS bytes8387559424 (7999 MiB)
Wall seconds limit80000 (22 hours)
Submitted time2025-06-20 16:39:59
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce16-multicore
Last heartbeat2025-06-20 23:26:25
From worker nodeHostnametds422.pic.es
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes8387559424 (7999 MiB)
Wall seconds limit216000 (60 hours)
GPU
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2025-06-20 20:48:31
Input fileshd-protodune:np04hd_raw_run027087_0388_dataflow3_datawriter_0_20240614T181342.hdf5
JobscriptExit code0
Real time2h (9430s)
CPU time1h (7149s = 75%)
Max RSS bytes2785910784 (2656 MiB)
Outputting started2025-06-20 23:25:42
Output fileshttps://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07811/1/002/pdhd_processing_1_418934_149_1750452549_stage1_stage2.root
https://fndcadoor.fnal.gov:2880/dune/scratch/users/calcuttj/new_data_proc_v10_04_06d00/07811/1/002/pdhd_processing_1_418934_149_1750452549_stage1_stage2_tfile.root
Finished2025-06-20 23:26:25
Saved logsjustin-logs:418934.149-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

06 n=899641 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 184126 traces, 184126 summary
Retagger: tagging trace set: gauss with 167481 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 167481 traces tagged "gauss"
FrameSaver: q=9.78996e+07 n=5241845 tag=gauss
wclsFrameSaver: saving 184126 traces tagged "wiener"
FrameSaver: q=1.34101e+08 n=5270288 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 68406 traces, 68406 summary
Retagger: tagging trace set: gauss with 56364 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 56364 traces tagged "gauss"
FrameSaver: q=1.37394e+06 n=888390 tag=gauss
wclsFrameSaver: saving 68406 traces tagged "wiener"
FrameSaver: q=1.60924e+06 n=859096 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 86002 traces, 86002 summary
Retagger: tagging trace set: gauss with 67603 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 67603 traces tagged "gauss"
FrameSaver: q=1.91778e+06 n=1097350 tag=gauss
wclsFrameSaver: saving 86002 traces tagged "wiener"
FrameSaver: q=2.20974e+06 n=1039379 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 87347 traces, 87347 summary
Retagger: tagging trace set: gauss with 67360 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 67360 traces tagged "gauss"
FrameSaver: q=1.8658e+06 n=1025004 tag=gauss
wclsFrameSaver: saving 87347 traces tagged "wiener"
FrameSaver: q=2.17003e+06 n=969457 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 76072 traces, 76072 summary
Retagger: tagging trace set: gauss with 59244 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 59244 traces tagged "gauss"
FrameSaver: q=1.53104e+06 n=854117 tag=gauss
wclsFrameSaver: saving 76072 traces tagged "wiener"
FrameSaver: q=1.83402e+06 n=819781 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 75614 traces, 75614 summary
Retagger: tagging trace set: gauss with 61993 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 61993 traces tagged "gauss"
FrameSaver: q=1.72303e+06 n=1014926 tag=gauss
wclsFrameSaver: saving 75614 traces tagged "wiener"
FrameSaver: q=1.92562e+06 n=956870 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 63445 traces, 63445 summary
Retagger: tagging trace set: gauss with 53840 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 53840 traces tagged "gauss"
FrameSaver: q=1.33861e+06 n=794777 tag=gauss
wclsFrameSaver: saving 63445 traces tagged "wiener"
FrameSaver: q=1.61082e+06 n=762492 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 67045 traces, 67045 summary
Retagger: tagging trace set: gauss with 54934 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 54934 traces tagged "gauss"
FrameSaver: q=1.32059e+06 n=835332 tag=gauss
wclsFrameSaver: saving 67045 traces tagged "wiener"
FrameSaver: q=1.50139e+06 n=789546 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 87648 traces, 87648 summary
Retagger: tagging trace set: gauss with 69063 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 69063 traces tagged "gauss"
FrameSaver: q=2.07016e+06 n=1133849 tag=gauss
wclsFrameSaver: saving 87648 traces tagged "wiener"
FrameSaver: q=2.37176e+06 n=1077215 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 77257 traces, 77257 summary
Retagger: tagging trace set: gauss with 63361 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 63361 traces tagged "gauss"
FrameSaver: q=1.68378e+06 n=1002200 tag=gauss
wclsFrameSaver: saving 77257 traces tagged "wiener"
FrameSaver: q=1.96248e+06 n=966725 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
	input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 68827 traces, 68827 summary
Retagger: tagging trace set: gauss with 56367 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 56367 traces tagged "gauss"
FrameSaver: q=1.63309e+06 n=923642 tag=gauss
wclsFrameSaver: saving 68827 traces tagged "wiener"
FrameSaver: q=1.77804e+06 n=857326 tag=wiener
21-Jun-2025 01:25:41 CEST  Closed output file "pdhd_processing_1_418934_149_1750452549_stage1_stage2.root"
21-Jun-2025 01:25:41 CEST  Closed input file "pdhd_processing_1_418934_149_1750452549_stage1.root"

========================================================================================================================================
TimeTracker printout (sec)                                Min           Avg           Max         Median          RMS         nEvts   
========================================================================================================================================
Full event                                              77.4187       155.743       284.581       154.961       36.9429        40     
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                                0.000785903   0.00297181    0.00529756    0.00312844     0.0013498       40     
produce:fembfilter:PDHDFEMBFilter                      0.657071      0.857825      0.973892      0.889747      0.0898307       40     
produce:wclsdatahd:WireCellToolkit                      41.7261       51.1015       66.2352       51.0892       4.86899        40     
produce:gaushit:GausHitFinder                          0.579817       1.20301       7.77463       1.08976       1.07704        40     
produce:nhitsfilter:NumberOfHitsFilter                0.000304735   0.000807978   0.00303524    0.000825624   0.000423377      40     
produce:reco3d:SpacePointSolver                         0.34621       1.06517       3.92584      0.958573       0.66138        39     
produce:hitpdune:DisambigFromSpacePoints               0.233722      0.700947       1.5632       0.705234      0.305624        39     
produce:pandora:StandardPandora                         9.63918       25.6934       94.1842       23.0102       14.313         39     
produce:pandoraWriter:StandardPandora                  0.170142      0.254699      0.397684      0.246347      0.049694        39     
produce:pandoraTrack:LArPandoraTrackCreation           0.772401       2.36887       5.50039       2.07953       1.08676        39     
produce:pandoraShower:LArPandoraShowerCreation         0.666684       2.71881       7.38444       2.35314       1.55012        39     
produce:pandoracalo:Calorimetry                        0.387805       1.0483        2.13426      0.956839      0.421223        39     
produce:pandoracalonosce:Calorimetry                   0.349968      0.936147       1.86864       0.78342      0.393774        39     
produce:pandorapid:Chi2ParticleID                     0.00141217    0.00265983    0.00516154    0.00257631    0.000677791      39     
produce:pandoraShowercalo:ShowerCalorimetry            0.592819       2.22421       6.65137       1.95755       1.26944        39     
produce:pandoraShowercalonosce:ShowerCalorimetry       0.579581       2.13699       5.30109       1.86947       1.15086        39     
produce:pandoraGnocchiCalo:GnocchiCalorimetry          0.109078      0.186676      0.335618      0.187543      0.0605266       39     
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry     0.0363653     0.0629054     0.111164      0.0590234     0.0195497       39     
produce:emtrkmichelid:EmTrackMichelId                   25.0275       43.094        59.2261       43.999        9.1704         39     
[art]:TriggerResults:TriggerResultInserter             3.064e-05    6.74835e-05   0.000108581   6.9091e-05    1.62659e-05      40     
end_path:out1:RootOutput                               7.95e-06     1.70698e-05   3.1391e-05     1.437e-05    6.8036e-06       40     
end_path:michelremoving:michelremoving                7.3661e-05     0.103009      0.429938      0.0487768     0.102519        40     
end_path:michelremovinggnocchi:michelremoving         6.0681e-05     0.0986065     0.450139      0.0475969     0.102554        40     
end_path:calibanagnocchi:CalibAnaTree                 6.0231e-05      20.5732       48.4003       19.1278       10.3178        40     
end_path:out1:RootOutput(write)                        0.703372       1.16846       2.30648       1.12703      0.280302        40     
========================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 5182.62 MB
  Peak resident set size usage (VmHWM): 2785.91 MB
  Details saved in: 'mem.db'
====================================================================================================

{'art_out': 'pdhd_processing_1_418934_149_1750452549_stage1_stage2.root', 'tfile_out': 'pdhd_processing_1_418934_149_1750452549_stage1_stage2_tfile.root', 'start_time': 1750455626.6618235, 'end_time': 1750461942.5439513}
justIN time: 2025-08-15 08:15:47 UTC       justIN version: 01.03.02