21 July 2025: This instance at RAL is read-only. Please do not try submitting new workflows for now.
Jobsub ID 418592.0@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 418592.0@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 7765 | |
| Stage ID | 1 | |
| User name | ykermaid@fnal.gov | |
| HTCondor Group | group_dune | |
| Requested | Processors | 1 |
| GPU | No | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 80000 (22 hours) | |
| Submitted time | 2025-06-20 09:46:08 | |
| Site | CZ_FZU | |
| Entry | Nova_CZ_FZU_osgce1 | |
| Last heartbeat | 2025-06-20 13:12:40 | |
| From worker node | Hostname | mahagon19.farm.particle.cz |
| cpuinfo | AMD EPYC 7301 16-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 6815744000 (6500 MiB) | |
| Wall seconds limit | 172800 (48 hours) | |
| GPU | ||
| Inner Apptainer? | True | |
| Job state | outputting_failed | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2025-06-20 09:47:04 | |
| Input files | monte-carlo-007765-000100 | |
| Jobscript | Exit code | 0 |
| Real time | 2h (9454s) | |
| CPU time | 2h (9182s = 97%) | |
| Max RSS bytes | 2305576960 (2198 MiB) | |
| Outputting started | 2025-06-20 12:24:39 | |
| Output files | ||
| Finished | 2025-06-20 13:12:40 | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
les within desired window for channel 9276
wclsFrameSaver: no samples within desired window for channel 9666
FrameSaver: q=136508 n=320925 tag=wiener
20-Jun-2025 14:24:20 CEST Closed output file "prod_39Ar_protodunehd_1_418592_0_1750412881_reco_box_sce.root"
20-Jun-2025 14:24:20 CEST Closed input file "prod_39Ar_protodunehd_1_418592_0_1750412881_detsim_box_sce.root"
======================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
======================================================================================================================================
Full event 59.324 64.8408 74.1776 65.3905 4.07132 20
--------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000847115 0.00180047 0.00257464 0.00192519 0.000469187 20
reco:opdec:Deconvolution 0.170363 0.197373 0.231245 0.195732 0.0141081 20
reco:ophitspe:OpHitFinderDeco 0.163781 0.199801 0.220088 0.200279 0.0132964 20
reco:opflash:OpFlashFinder 0.000323249 0.000576485 0.00283732 0.000444187 0.000530223 20
reco:opslicer:OpSlicer 8.7284e-05 0.000147074 0.000598848 0.000121189 0.000106934 20
reco:wclsdatahd:WireCellToolkit 53.2758 58.7519 68.5205 59.3817 4.03845 20
reco:gaushit:GausHitFinder 0.0697035 0.0802766 0.0879201 0.0817353 0.00596624 20
reco:nhitsfilter:NumberOfHitsFilter 4.1248e-05 6.77506e-05 0.000242276 5.56545e-05 4.24453e-05 20
reco:reco3d:SpacePointSolver 0.00261066 0.00368535 0.0068124 0.00326333 0.000925689 20
reco:hitpdune:DisambigFromSpacePoints 0.00225953 0.00288273 0.00431351 0.00276826 0.000532274 20
reco:pandora:StandardPandora 0.265378 0.441833 2.03326 0.301365 0.391385 20
reco:pandoraWriter:StandardPandora 0.019217 0.0249782 0.0312977 0.0244311 0.00319348 20
reco:pandoraTrack:LArPandoraTrackCreation 0.000246695 0.000686342 0.00399653 0.00031852 0.00109622 20
reco:pandoraShower:LArPandoraShowerCreation 0.00013289 0.000241178 0.00110429 0.000182138 0.000204554 20
reco:pandoracalo:Calorimetry 0.000148761 0.000411884 0.00266953 0.00020981 0.000618333 20
reco:pandoracalonosce:Calorimetry 9.1462e-05 0.000144006 0.000209965 0.000132394 3.68951e-05 20
reco:pandoraShowercalo:ShowerCalorimetry 8.1113e-05 0.00016658 0.00103577 0.000121474 0.000200765 20
reco:pandoraShowercalonosce:ShowerCalorimetry 7.2387e-05 0.00010131 0.000134282 9.95875e-05 1.71768e-05 20
reco:pandoraGnocchicalo:GnocchiCalorimetry 0.000102263 0.000335654 0.00227997 0.00016161 0.000536496 20
reco:pandoraGnocchicalonosce:GnocchiCalorimetry 9.4749e-05 0.000145614 0.000273164 0.000135109 4.10076e-05 20
reco:emtrkmichelid:EmTrackMichelId 4.30471 4.68067 5.12798 4.66649 0.216872 20
reco:crttag:SingleCRTMatchingProducer 0.000320804 0.000571317 0.00180966 0.000468047 0.00034759 20
reco:crtreco:TwoCRTMatchingProducer 0.000131478 0.000205204 0.000496605 0.000184297 9.62925e-05 20
reco:pandora2Track:LArPandoraTrackCreation 0.000141226 0.000203826 0.000321926 0.000184833 5.27914e-05 20
reco:pandora2calo:ShowerCalorimetry 8.8968e-05 0.000124091 0.00016487 0.000123523 2.3594e-05 20
reco:pandora2calonosce:ShowerCalorimetry 6.7728e-05 9.89649e-05 0.000138341 9.8681e-05 2.25188e-05 20
reco:pandora2Gnocchicalo:GnocchiCalorimetry 0.000104536 0.000149165 0.000285518 0.000132635 4.51093e-05 20
reco:pandora2Gnocchicalonosce:GnocchiCalorimetry 9.1883e-05 0.000130053 0.000184898 0.000132098 2.57558e-05 20
reco:pandora2Shower:LArPandoraShowerCreation 0.000120166 0.00024735 0.00176473 0.000159054 0.000350364 20
reco:pandora2Showercalo:ShowerCalorimetry 7.3178e-05 0.000153145 0.00112501 9.8806e-05 0.000224271 20
reco:pandora2Showercalonosce:ShowerCalorimetry 6.7698e-05 9.63279e-05 0.00016421 9.00545e-05 2.4692e-05 20
[art]:TriggerResults:TriggerResultInserter 1.3285e-05 2.28982e-05 7.3097e-05 2.0233e-05 1.28453e-05 20
end_path:out1:RootOutput 8.647e-06 1.13399e-05 2.8183e-05 1.0054e-05 4.12524e-06 20
end_path:out1:RootOutput(write) 0.368734 0.41665 0.514127 0.407522 0.0356454 20
======================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4478.91 MB
Peak resident set size usage (VmHWM): 2293.21 MB
Details saved in: 'mem.db'
====================================================================================================
{'art_out': 'prod_39Ar_protodunehd_1_418592_0_1750412881_reco_box_sce.root', 'start_time': 1750420909.7427425, 'end_time': 1750422260.8662763}
Output files:
Reco: prod_39Ar_protodunehd_1_418592_0_1750412881_reco_box.root
prod_39Ar_protodunehd_1_418592_0_1750412881_reco_box_sce.root
prod_39Ar_protodunehd_1_418592_0_1750412881_reco_nest.root
Forming reco metadata
subrun: 1 -> reco file: prod_39Ar_protodunehd_1_418592_0_1750412881_reco_box.root
KEY: reco_box
FCL: standard_reco_protodunehd_MC.fcl
TClass::Init:0: RuntimeWarning: no dictionary for class sim::IDE is available
Successfully opened file prod_39Ar_protodunehd_1_418592_0_1750412881_reco_box.root
Ran successfully
{
"name": "prod_39Ar_protodunehd_1_418592_0_1750412881_reco_box.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_06_00d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_protodunehd_MC.fcl",
"dune.campaign": "pdhd-LE-test",
"core.start_time": 1750412880.0,
"core.end_time": 1750422260.0,
"core.runs": 1,
"core.subruns": 1,
"core.events": [
1,
2,
3,
4,
5,
6,
7,
8,
9,
10,
11,
12,
13,
14,
15,
16,
17,
18,
19,
20
],
"core.event_count": 20,
"core.first_event_number": 1,
"core.last_event_number": 20
}
} subrun: 2 -> reco file: prod_39Ar_protodunehd_1_418592_0_1750412881_reco_box_sce.root
KEY: reco_box_sce
FCL: standard_reco_protodunehd_MC.fcl
TClass::Init:0: RuntimeWarning: no dictionary for class sim::IDE is available
Successfully opened file prod_39Ar_protodunehd_1_418592_0_1750412881_reco_box_sce.root
Ran successfully
{
"name": "prod_39Ar_protodunehd_1_418592_0_1750412881_reco_box_sce.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_06_00d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_protodunehd_MC.fcl",
"dune.campaign": "pdhd-LE-test",
"core.start_time": 1750412880.0,
"core.end_time": 1750422260.0,
"core.runs": 1,
"core.subruns": 1,
"core.events": [
1,
2,
3,
4,
5,
6,
7,
8,
9,
10,
11,
12,
13,
14,
15,
16,
17,
18,
19,
20
],
"core.event_count": 20,
"core.first_event_number": 1,
"core.last_event_number": 20
}
} subrun: 3 -> reco file: prod_39Ar_protodunehd_1_418592_0_1750412881_reco_nest.root
KEY: reco_nest
FCL: standard_reco_protodunehd_MC.fcl
TClass::Init:0: RuntimeWarning: no dictionary for class sim::IDE is available
Successfully opened file prod_39Ar_protodunehd_1_418592_0_1750412881_reco_nest.root
Ran successfully
{
"name": "prod_39Ar_protodunehd_1_418592_0_1750412881_reco_nest.root",
"namespace": "usertests",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v10_06_00d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_protodunehd_MC.fcl",
"dune.campaign": "pdhd-LE-test",
"core.start_time": 1750412880.0,
"core.end_time": 1750422260.0,
"core.runs": 1,
"core.subruns": 1,
"core.events": [
1,
2,
3,
4,
5,
6,
7,
8,
9,
10,
11,
12,
13,
14,
15,
16,
17,
18,
19,
20
],
"core.event_count": 20,
"core.first_event_number": 1,
"core.last_event_number": 20
}
}