21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 418930.54@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 418930.54@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 7811 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 8387559424 (7999 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-06-20 16:37:14 | |
| Site | FR_CCIN2P3 | |
| Entry | DUNE_FR_CCIN2P3_cccondorce04 | |
| Last heartbeat | 2025-06-20 19:54:59 | |
| From worker node | Hostname | ccwcondor0497 |
| cpuinfo | AMD EPYC 7302 16-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 8387559424 (7999 MiB) | |
| Wall seconds limit | 106200 (29 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | outputting_failed | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-06-20 18:42:53 | |
| Input files | hd-protodune:np04hd_raw_run027087_0000_dataflow1_datawriter_0_20240614T144534.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 49m (2979s) | |
| CPU time | 42m (2549s = 85%) | |
| Max RSS bytes | 2593660928 (2473 MiB) | |
| Outputting started | 2025-06-20 19:32:32 | |
| Output files | ||
| Finished | 2025-06-20 19:54:59 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
er: q=1.276e+06 n=669186 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 79038 traces, 79038 summary
Retagger: tagging trace set: gauss with 63973 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 63973 traces tagged "gauss"
FrameSaver: q=1.69274e+06 n=959561 tag=gauss
wclsFrameSaver: saving 79038 traces tagged "wiener"
FrameSaver: q=1.95989e+06 n=899019 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 80532 traces, 80532 summary
Retagger: tagging trace set: gauss with 62959 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 62959 traces tagged "gauss"
FrameSaver: q=1.75807e+06 n=941363 tag=gauss
wclsFrameSaver: saving 80532 traces tagged "wiener"
FrameSaver: q=2.05609e+06 n=905034 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 66587 traces, 66587 summary
Retagger: tagging trace set: gauss with 54155 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 54155 traces tagged "gauss"
FrameSaver: q=1.2985e+06 n=754765 tag=gauss
wclsFrameSaver: saving 66587 traces tagged "wiener"
FrameSaver: q=1.55479e+06 n=728965 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 78827 traces, 78827 summary
Retagger: tagging trace set: gauss with 60167 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 60167 traces tagged "gauss"
FrameSaver: q=1.72488e+06 n=912116 tag=gauss
wclsFrameSaver: saving 78827 traces tagged "wiener"
FrameSaver: q=1.97367e+06 n=839291 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 68617 traces, 68617 summary
Retagger: tagging trace set: gauss with 56528 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 56528 traces tagged "gauss"
FrameSaver: q=1.40443e+06 n=847032 tag=gauss
wclsFrameSaver: saving 68617 traces tagged "wiener"
FrameSaver: q=1.61031e+06 n=802917 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 104042 traces, 104042 summary
Retagger: tagging trace set: gauss with 80282 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 80282 traces tagged "gauss"
FrameSaver: q=2.65579e+06 n=1344887 tag=gauss
wclsFrameSaver: saving 104042 traces tagged "wiener"
FrameSaver: q=2.97443e+06 n=1250392 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 80167 traces, 80167 summary
Retagger: tagging trace set: gauss with 63488 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 63488 traces tagged "gauss"
FrameSaver: q=1.81933e+06 n=1009136 tag=gauss
wclsFrameSaver: saving 80167 traces tagged "wiener"
FrameSaver: q=2.05916e+06 n=951805 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 88965 traces, 88965 summary
Retagger: tagging trace set: gauss with 65685 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 65685 traces tagged "gauss"
FrameSaver: q=2.14207e+06 n=1027795 tag=gauss
wclsFrameSaver: saving 88965 traces tagged "wiener"
FrameSaver: q=2.4846e+06 n=997100 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 86989 traces, 86989 summary
Retagger: tagging trace set: gauss with 70972 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 70972 traces tagged "gauss"
FrameSaver: q=1.98996e+06 n=1117931 tag=gauss
wclsFrameSaver: saving 86989 traces tagged "wiener"
FrameSaver: q=2.2971e+06 n=1055836 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 73262 traces, 73262 summary
Retagger: tagging trace set: gauss with 60370 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 60370 traces tagged "gauss"
FrameSaver: q=1.60421e+06 n=971323 tag=gauss
wclsFrameSaver: saving 73262 traces tagged "wiener"
FrameSaver: q=1.76806e+06 n=901132 tag=wiener
RawFrameSource: got 10240 raw::RawDigit objects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 81738 traces, 81738 summary
Retagger: tagging trace set: gauss with 63179 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 63179 traces tagged "gauss"
FrameSaver: q=1.83367e+06 n=966096 tag=gauss
wclsFrameSaver: saving 81738 traces tagged "wiener"
FrameSaver: q=2.16899e+06 n=938552 tag=wiener
20-Jun-2025 21:32:31 CEST Closed output file "pdhd_processing_1_418930_54_1750444985_stage1_stage2.root"
20-Jun-2025 21:32:31 CEST Closed input file "pdhd_processing_1_418930_54_1750444985_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 0.426203 46.9794 198.986 0.689722 63.7959 44
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000223301 0.00112701 0.00519513 0.0003319 0.00133642 44
produce:fembfilter:PDHDFEMBFilter 0.419071 0.689951 1.1175 0.66943 0.168109 44
produce:wclsdatahd:WireCellToolkit 39.1187 45.118 51.2943 45.009 4.23678 16
produce:gaushit:GausHitFinder 0.471277 0.722087 1.1983 0.698084 0.197892 16
produce:nhitsfilter:NumberOfHitsFilter 0.000235554 0.000688029 0.00322038 0.000471163 0.000685203 16
produce:reco3d:SpacePointSolver 0.180007 0.710224 1.77429 0.660753 0.423594 16
produce:hitpdune:DisambigFromSpacePoints 0.188446 0.510297 1.14253 0.388845 0.2802 16
produce:pandora:StandardPandora 7.54441 20.3575 57.2448 16.2687 11.8868 16
produce:pandoraWriter:StandardPandora 0.115538 0.188089 0.299359 0.18902 0.0515907 16
produce:pandoraTrack:LArPandoraTrackCreation 0.71155 1.56261 2.83342 1.27117 0.685077 16
produce:pandoraShower:LArPandoraShowerCreation 0.643765 1.864 3.81984 1.46364 0.954462 16
produce:pandoracalo:Calorimetry 0.362935 0.728069 1.44288 0.755142 0.275229 16
produce:pandoracalonosce:Calorimetry 0.315029 0.641583 1.14249 0.659828 0.224209 16
produce:pandorapid:Chi2ParticleID 0.00135475 0.00233953 0.00392201 0.00218007 0.000879176 16
produce:pandoraShowercalo:ShowerCalorimetry 0.576981 1.60046 3.26667 1.32851 0.768228 16
produce:pandoraShowercalonosce:ShowerCalorimetry 0.552628 1.37581 2.57712 1.19379 0.562697 16
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0869166 0.14466 0.205598 0.145727 0.0358496 16
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0290331 0.0472917 0.0677809 0.0495216 0.0116842 16
produce:emtrkmichelid:EmTrackMichelId 21.3898 36.1037 51.2499 34.6937 7.81427 16
[art]:TriggerResults:TriggerResultInserter 2.5738e-05 5.3627e-05 0.00010053 4.98595e-05 1.76213e-05 44
end_path:out1:RootOutput 3.707e-06 9.4428e-06 3.5457e-05 5.756e-06 7.71912e-06 44
end_path:michelremoving:michelremoving 1.56e-05 0.0509205 0.806895 2.32085e-05 0.129428 44
end_path:michelremovinggnocchi:michelremoving 4.198e-06 0.0479178 0.802017 7.679e-06 0.127381 44
end_path:calibanagnocchi:CalibAnaTree 4.108e-06 5.16875 25.6813 6.7475e-06 7.46222 44
end_path:out1:RootOutput(write) 0.00056242 0.356813 1.21278 0.000851826 0.481668 44
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5023.81 MB
Peak resident set size usage (VmHWM): 2593.66 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'pdhd_processing_1_418930_54_1750444985_stage1_stage2.root', 'tfile_out': 'pdhd_processing_1_418930_54_1750444985_stage1_stage2_tfile.root', 'start_time': 1750445835.473089, 'end_time': 1750447952.666041}