Jobsub ID 79958.49@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 79958.49@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3511 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 08:13:05 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw6 |
| Last heartbeat | 2024-09-27 16:43:30 |
| From worker node | Hostname | mh-7763-1.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 13:05:58 |
| Input files | hd-protodune:np04hd_raw_run027332_0478_dataflow0_datawriter_0_20240621T012006.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 3h (11479s) |
| CPU time | 1h (4051s = 35%) |
| Outputting started | 2024-09-27 16:17:18 |
| Output files | |
| Finished | 2024-09-27 16:43:30 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
-05 3.93391e-05 3.92795e-05 3.92795e-05 3.93391e-05 3.92795e-05 3.93391e-05 3.92795e-05 3.93391e-05
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000171781 0.000324011 8.53539e-05 8.53539e-05 8.53539e-05 8.53539e-05 8.53539e-05 8.53539e-05 0.000854909 0 0
----view 1: 3.93391e-05 3.92795e-05 3.93391e-05 3.92795e-05 3.92795e-05 3.93391e-05 3.92795e-05 3.93391e-05 3.92795e-05 3.93391e-05 3.92795e-05
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 67060 TrkackID 12 startx, y, z 210.696 331.786 70.4741 wireno, peakt tpcno 257 2657.68 2 dist 73.7089min T, max_T1.62727 2687.86
no of hits closeby 6 event 67060 TrkackID 14 startx, y, z 11.9356 590.819 364.238 wireno, peakt tpcno 460 3415.45 5 dist 1.88694min T, max_T3197.51 5726.2
no of hits closeby 0 event 67060 TrkackID 12 startx, y, z 210.696 331.786 70.4741 wireno, peakt tpcno 257 2657.68 2 dist 73.7089min T, max_T1.62727 2687.86
no of hits closeby 6 event 67060 TrkackID 14 startx, y, z 11.9356 590.819 364.238 wireno, peakt tpcno 460 3415.45 5 dist 1.88694min T, max_T3197.51 5726.2
27-Sep-2024 09:17:11 PDT Closed output file "np04hd_raw_run027332_0478_dataflow0_datawriter_0_20240621T012006_reco_stage1_reco_stage2_20240927T161711_keepup.root"
27-Sep-2024 09:17:11 PDT Closed input file "np04hd_raw_run027332_0478_dataflow0_datawriter_0_20240621T012006_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 51.0515 97.8214 193.348 87.6715 33.7975 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000413666 0.0017332 0.00542055 0.00131526 0.00117408 35
produce:fembfilter:PDHDFEMBFilter 0.50855 0.532588 0.567024 0.531729 0.0134351 35
produce:wclsdatahd:WireCellToolkit 26.2815 28.1097 31.0513 27.7435 1.19276 35
produce:gaushit:GausHitFinder 0.348822 0.638224 1.04289 0.654488 0.16445 35
produce:nhitsfilter:NumberOfHitsFilter 0.000175919 0.000317454 0.000479556 0.000320167 6.56284e-05 35
produce:reco3d:SpacePointSolver 0.194556 1.18614 3.26067 1.14228 0.725145 35
produce:hitpdune:DisambigFromSpacePoints 0.203852 0.627929 1.51532 0.521027 0.336179 35
produce:pandora:StandardPandora 5.15946 28.9084 96.1811 22.004 21.7061 35
produce:pandoraWriter:StandardPandora 0.0611653 0.144039 0.247947 0.140825 0.0442818 35
produce:pandoraTrack:LArPandoraTrackCreation 0.500877 1.74592 4.81711 1.56468 0.964879 35
produce:pandoraShower:LArPandoraShowerCreation 0.402818 1.89815 6.2283 1.6182 1.17451 35
produce:pandoracalo:Calorimetry 0.300811 0.918199 2.33527 0.851312 0.467946 35
produce:pandoracalonosce:Calorimetry 0.274988 0.854918 2.09936 0.767572 0.434913 35
produce:pandorapid:Chi2ParticleID 0.00107527 0.00184789 0.00278375 0.00183127 0.000405687 35
produce:pandoraShowercalo:ShowerCalorimetry 0.379041 1.83635 5.23216 1.48449 1.10226 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.361223 1.75182 4.84351 1.40276 1.04095 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.050903 0.101441 0.166173 0.0995836 0.0279621 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.01833 0.0349917 0.0561296 0.0337755 0.00946924 35
produce:emtrkmichelid:EmTrackMichelId 14.2581 26.8653 40.0861 26.1987 6.68066 35
[art]:TriggerResults:TriggerResultInserter 1.5689e-05 2.88274e-05 7.4389e-05 2.324e-05 1.43999e-05 35
end_path:out1:RootOutput 7.649e-06 1.22645e-05 4.1489e-05 9.06e-06 9.18857e-06 35
end_path:michelremoving:michelremoving 0.0134605 0.0671543 0.325195 0.0285029 0.0761311 35
end_path:michelremovinggnocchi:michelremoving 0.0105188 0.0621863 0.319732 0.0219438 0.0764877 35
end_path:calibanagnocchi:CalibAnaTree 0.21444 0.676247 1.64641 0.657677 0.345978 35
end_path:out1:RootOutput(write) 0.386171 0.724838 1.175 0.736153 0.187114 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5148.64 MB
Peak resident set size usage (VmHWM): 2747.68 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027332_0478_dataflow0_datawriter_0_20240621T012006_reco_stage1_reco_stage2_20240927T161711_keepup.root
\tHists: np04hd_raw_run027332_0478_dataflow0_datawriter_0_20240621T012006_reco_stage1_reco_stage2_20240927T161711_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027332_0478_dataflow0_datawriter_0_20240621T012006_reco_stage1_reco_stage2_20240927T161711_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027332_0478_dataflow0_datawriter_0_20240621T012006_reco_stage1_reco_stage2_20240927T161711_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727450378.0,
"core.end_time": 1727453831.0,
"core.events": [
66924,
66928,
66932,
66936,
66940,
66944,
66948,
66952,
66956,
66960,
66964,
66968,
66972,
66976,
66980,
66984,
66988,
66992,
66996,
67000,
67004,
67008,
67012,
67016,
67020,
67024,
67028,
67032,
67036,
67040,
67044,
67048,
67052,
67056,
67060
],
"core.event_count": 35,
"core.first_event_number": 66924,
"core.last_event_number": 67060,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27332
],
"core.runs_subruns": [
2733200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027332_0478_dataflow0_datawriter_0_20240621T012006.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027332_0478_dataflow0_datawriter_0_20240621T012006_reco_stage1_reco_stage2_20240927T161711_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727450378.0,
"core.end_time": 1727453831.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27332
],
"core.runs_subruns": [
2733200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027332_0478_dataflow0_datawriter_0_20240621T012006.hdf5"
}
]
} 