Jobsub ID 80065.12@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 80065.12@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3518 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 09:50:56 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw7 |
| Last heartbeat | 2024-09-27 16:44:07 |
| From worker node | Hostname | sdsc-54.t2.ucsd.edu |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2680 v4 @ 2.40GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 14:26:23 |
| Input files | hd-protodune:np04hd_raw_run027408_0028_dataflow3_datawriter_0_20240624T155203.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (7215s) |
| CPU time | 1h (5808s = 80%) |
| Outputting started | 2024-09-27 16:26:39 |
| Output files | |
| Finished | 2024-09-27 16:44:07 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
t p-value for these numbers
----view 0: 2.02656e-05 2.02656e-05 0.000238717 9.95994e-05 9.9659e-05 0.000322819 0.000157654 3.0458e-05 3.0458e-05 0.000219107 0.000146508
----view 1: 4.31538e-05 4.31538e-05 4.31538e-05 0.00067389 0.000792027 0.000128746 0.000128746 0.000128746 0.000128806 0.00342935 0.000109494
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 4059 TrkackID 10 startx, y, z 131.585 568.038 136.11 wireno, peakt tpcno 274 1651 2 dist 242.621min T, max_T5 1690.63
no of hits closeby 3 event 4059 TrkackID 12 startx, y, z 28.3771 590.765 298.155 wireno, peakt tpcno 56 1259.1 5 dist 0min T, max_T1227.74 3020.04
no of hits closeby 0 event 4059 TrkackID 10 startx, y, z 131.585 568.038 136.11 wireno, peakt tpcno 274 1651 2 dist 242.621min T, max_T5 1690.63
no of hits closeby 3 event 4059 TrkackID 12 startx, y, z 28.3771 590.765 298.155 wireno, peakt tpcno 56 1259.1 5 dist 0min T, max_T1227.74 3020.04
27-Sep-2024 09:26:31 PDT Closed output file "np04hd_raw_run027408_0028_dataflow3_datawriter_0_20240624T155203_reco_stage1_reco_stage2_20240927T162631_keepup.root"
27-Sep-2024 09:26:31 PDT Closed input file "np04hd_raw_run027408_0028_dataflow3_datawriter_0_20240624T155203_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 53.2594 136.77 237.223 133.834 42.0996 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000420722 0.00199285 0.00415671 0.00144042 0.00117457 35
produce:fembfilter:PDHDFEMBFilter 0.668927 0.686071 0.733658 0.678716 0.0150773 35
produce:wclsdatahd:WireCellToolkit 43.4336 45.1748 48.6532 44.9346 1.14996 35
produce:gaushit:GausHitFinder 0.473674 1.00555 3.00799 0.936151 0.415021 35
produce:nhitsfilter:NumberOfHitsFilter 0.000272787 0.000572989 0.00203111 0.000530201 0.00028344 35
produce:reco3d:SpacePointSolver 0.34854 1.56154 4.53066 1.09721 1.05602 34
produce:hitpdune:DisambigFromSpacePoints 0.203647 0.991017 2.34004 0.863136 0.520384 34
produce:pandora:StandardPandora 8.1724 37.227 94.7888 35.1174 21.2819 34
produce:pandoraWriter:StandardPandora 0.106936 0.211981 0.336327 0.211811 0.0552521 34
produce:pandoraTrack:LArPandoraTrackCreation 1.00072 3.48593 13.506 2.75738 2.51419 34
produce:pandoraShower:LArPandoraShowerCreation 0.800839 3.28143 10.914 2.54368 2.32365 34
produce:pandoracalo:Calorimetry 0.520389 1.44875 4.10596 1.16709 0.850857 34
produce:pandoracalonosce:Calorimetry 0.476695 1.38224 4.36879 1.07332 0.868423 34
produce:pandorapid:Chi2ParticleID 0.00150797 0.00244843 0.00392856 0.00226228 0.000659263 34
produce:pandoraShowercalo:ShowerCalorimetry 0.643107 2.81583 9.24734 2.31881 1.872 34
produce:pandoraShowercalonosce:ShowerCalorimetry 0.611922 2.65593 8.96734 2.09881 1.76805 34
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0711643 0.140331 0.210805 0.140512 0.035447 34
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0315927 0.0513535 0.081175 0.0516559 0.012621 34
produce:emtrkmichelid:EmTrackMichelId 17.6557 34.8178 51.0327 34.581 7.97219 34
[art]:TriggerResults:TriggerResultInserter 1.9515e-05 3.15653e-05 0.000127864 2.732e-05 1.85688e-05 35
end_path:out1:RootOutput 3.986e-06 5.80626e-06 2.4681e-05 5.365e-06 3.28759e-06 35
end_path:michelremoving:michelremoving 2.0877e-05 0.0958111 0.541052 0.0476301 0.114667 35
end_path:michelremovinggnocchi:michelremoving 7.803e-06 0.0890991 0.422568 0.0440754 0.104285 35
end_path:calibanagnocchi:CalibAnaTree 6.98e-06 1.15948 3.74924 0.949356 0.815031 35
end_path:out1:RootOutput(write) 0.460347 0.922511 1.39919 0.910081 0.211559 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5092.87 MB
Peak resident set size usage (VmHWM): 2709.43 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027408_0028_dataflow3_datawriter_0_20240624T155203_reco_stage1_reco_stage2_20240927T162631_keepup.root
\tHists: np04hd_raw_run027408_0028_dataflow3_datawriter_0_20240624T155203_reco_stage1_reco_stage2_20240927T162631_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027408_0028_dataflow3_datawriter_0_20240624T155203_reco_stage1_reco_stage2_20240927T162631_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027408_0028_dataflow3_datawriter_0_20240624T155203_reco_stage1_reco_stage2_20240927T162631_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727449560.0,
"core.end_time": 1727454392.0,
"core.events": [
3923,
3927,
3931,
3935,
3939,
3943,
3947,
3951,
3955,
3959,
3963,
3967,
3971,
3975,
3979,
3983,
3987,
3991,
3995,
3999,
4003,
4007,
4011,
4015,
4019,
4023,
4027,
4031,
4035,
4039,
4043,
4047,
4051,
4055,
4059
],
"core.event_count": 35,
"core.first_event_number": 3923,
"core.last_event_number": 4059,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27408
],
"core.runs_subruns": [
2740800001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027408_0028_dataflow3_datawriter_0_20240624T155203.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027408_0028_dataflow3_datawriter_0_20240624T155203_reco_stage1_reco_stage2_20240927T162631_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727449560.0,
"core.end_time": 1727454392.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27408
],
"core.runs_subruns": [
2740800001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027408_0028_dataflow3_datawriter_0_20240624T155203.hdf5"
}
]
} 