Jobsub ID 79996.81@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 79996.81@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3493 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 08:49:38 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw7 |
| Last heartbeat | 2024-09-27 16:39:19 |
| From worker node | Hostname | mh-7662-17.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7662 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | stalled |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 13:59:07 |
| Input files | hd-protodune:np04hd_raw_run027310_0686_dataflow3_datawriter_0_20240620T035656.hdf5
|
| Outputting started | 2024-09-27 16:21:25 |
| Output files | |
| Finished | 2024-09-27 17:36:31 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
863373 0.000422478 0.000609756
----view 1: 2.10404e-05 2.10404e-05 0.000323176 2.67625e-05 2.68221e-05 2.67625e-05 2.67625e-05 4.94123e-05 6.11544e-05 6.1214e-05 6.11544e-05
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 9.68575e-05 0.000241458 0.000266135 0.000651896 0.000674009 0.000863373 0.000422478 0.000609756 0.00030297 0.000615954 0.000367343
----view 1: 2.67625e-05 2.68221e-05 2.67625e-05 2.67625e-05 4.94123e-05 6.11544e-05 6.1214e-05 6.11544e-05 0.000306249 2.5332e-05 2.5332e-05
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 0.000241458 0.000266135 0.000651896 0.000674009 0.000863373 0.000422478 0.000609756 0.00030297 0.000615954 0.000367343 0.000181258
----view 1: 2.68221e-05 2.67625e-05 2.67625e-05 4.94123e-05 6.11544e-05 6.1214e-05 6.11544e-05 0.000306249 2.5332e-05 2.5332e-05 2.5332e-05
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 09:21:13 PDT Closed output file "np04hd_raw_run027310_0686_dataflow3_datawriter_0_20240620T035656_reco_stage1_reco_stage2_20240927T162113_keepup.root"
27-Sep-2024 09:21:13 PDT Closed input file "np04hd_raw_run027310_0686_dataflow3_datawriter_0_20240620T035656_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 87.0638 172.377 337.333 151.526 65.2061 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000660504 0.00344314 0.00841783 0.00290958 0.00206213 35
produce:fembfilter:PDHDFEMBFilter 0.738739 0.932732 1.06961 0.97974 0.105721 35
produce:wclsdatahd:WireCellToolkit 37.2147 45.9596 57.9714 45.289 5.04548 35
produce:gaushit:GausHitFinder 0.610134 1.25101 1.89567 1.27268 0.309725 35
produce:nhitsfilter:NumberOfHitsFilter 0.000322472 0.000591567 0.000914466 0.000581143 0.000130283 35
produce:reco3d:SpacePointSolver 0.165266 3.1606 16.4315 2.46885 3.10561 35
produce:hitpdune:DisambigFromSpacePoints 0.229305 1.28663 3.09779 1.10769 0.704241 35
produce:pandora:StandardPandora 7.5908 53.9817 214.279 36.2549 47.7916 35
produce:pandoraWriter:StandardPandora 0.120929 0.258217 0.388866 0.25868 0.0704803 35
produce:pandoraTrack:LArPandoraTrackCreation 0.899118 3.80753 9.25092 3.57219 1.99469 35
produce:pandoraShower:LArPandoraShowerCreation 0.856798 4.0504 10.4126 3.43733 2.52379 35
produce:pandoracalo:Calorimetry 0.410781 1.72392 6.73226 1.46408 1.14768 35
produce:pandoracalonosce:Calorimetry 0.371604 1.68571 6.77996 1.39499 1.18723 35
produce:pandorapid:Chi2ParticleID 0.00169287 0.00331477 0.00628394 0.00304529 0.00101642 35
produce:pandoraShowercalo:ShowerCalorimetry 0.633284 3.49939 11.0887 2.82095 2.38126 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.617486 3.20395 7.99183 2.89239 1.87476 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.116043 0.20695 0.392755 0.193049 0.0675018 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0340884 0.0717665 0.128833 0.0669207 0.0218644 35
produce:emtrkmichelid:EmTrackMichelId 24.686 43.8221 64.7421 42.1535 10.5958 35
[art]:TriggerResults:TriggerResultInserter 4.0898e-05 7.73771e-05 0.000146658 7.1436e-05 2.41155e-05 35
end_path:out1:RootOutput 6.242e-06 1.47038e-05 6.2178e-05 1.2183e-05 9.97427e-06 35
end_path:michelremoving:michelremoving 0.0302038 0.151131 0.556649 0.0611164 0.155155 35
end_path:michelremovinggnocchi:michelremoving 0.0271575 0.142743 0.556355 0.0560041 0.152053 35
end_path:calibanagnocchi:CalibAnaTree 0.485567 1.5007 4.4397 1.27449 0.918399 35
end_path:out1:RootOutput(write) 0.680999 1.42384 2.27601 1.43568 0.418172 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5085.48 MB
Peak resident set size usage (VmHWM): 2724.51 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027310_0686_dataflow3_datawriter_0_20240620T035656_reco_stage1_reco_stage2_20240927T162113_keepup.root
\tHists: np04hd_raw_run027310_0686_dataflow3_datawriter_0_20240620T035656_reco_stage1_reco_stage2_20240927T162113_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027310_0686_dataflow3_datawriter_0_20240620T035656_reco_stage1_reco_stage2_20240927T162113_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027310_0686_dataflow3_datawriter_0_20240620T035656_reco_stage1_reco_stage2_20240927T162113_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727447979.0,
"core.end_time": 1727454074.0,
"core.events": [
96087,
96091,
96095,
96099,
96103,
96107,
96111,
96115,
96119,
96123,
96127,
96131,
96135,
96139,
96143,
96147,
96151,
96155,
96159,
96163,
96167,
96171,
96175,
96179,
96183,
96187,
96191,
96195,
96199,
96203,
96207,
96211,
96215,
96219,
96223
],
"core.event_count": 35,
"core.first_event_number": 96087,
"core.last_event_number": 96223,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27310
],
"core.runs_subruns": [
2731000001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027310_0686_dataflow3_datawriter_0_20240620T035656.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027310_0686_dataflow3_datawriter_0_20240620T035656_reco_stage1_reco_stage2_20240927T162113_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727447979.0,
"core.end_time": 1727454074.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27310
],
"core.runs_subruns": [
2731000001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027310_0686_dataflow3_datawriter_0_20240620T035656.hdf5"
}
]
} 