Jobsub ID 80040.65@justin-prod-sched02.dune.hep.ac.uk
Jobsub ID | 80040.65@justin-prod-sched02.dune.hep.ac.uk |
Workflow ID | 3511 |
Stage ID | 1 |
User name | calcuttj@fnal.gov |
HTCondor Group | group_dune.prod_mcsim |
Requested | Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 18000 (5 hours) |
Submitted time | 2024-09-27 09:08:45 |
Site | US_UCSD |
Entry | CMSHTPC_T2_US_UCSD_gw6 |
Last heartbeat | 2024-09-27 16:58:30 |
From worker node | Hostname | mh-7763-1.t2.ucsd.edu |
cpuinfo | AMD EPYC 7763 64-Core Processor |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 171000 (47 hours) |
Inner Apptainer? | True |
Job state | stalled |
Allocator name | justin-allocator-pro.dune.hep.ac.uk |
Started | 2024-09-27 14:09:10 |
Input files | hd-protodune:np04hd_raw_run027334_0171_dataflow1_datawriter_0_20240621T043203.hdf5
|
Outputting started | 2024-09-27 16:58:30 |
Output files | |
Finished | 2024-09-27 17:36:31 |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
738e-05 8.77976e-05 8.7738e-05 8.77976e-05 8.7738e-05 0.000449717 0.000453055 0.000495672 0.000338137 0.000345051
----view 1: 9.29832e-06 9.29832e-06 9.23872e-06 9.29832e-06 9.29832e-06 9.29832e-06 9.29832e-06 9.29832e-06 9.29832e-06 9.29832e-06 9.29832e-06
TwoViewTransverseTracksAlgorithm: failed to calculate correlation coefficient p-value for these numbers
----view 0: 8.7738e-05 8.77976e-05 8.7738e-05 8.77976e-05 8.7738e-05 0.000449717 0.000453055 0.000495672 0.000338137 0.000345051 5.69224e-05
----view 1: 9.29832e-06 9.23872e-06 9.29832e-06 9.29832e-06 9.29832e-06 9.29832e-06 9.29832e-06 9.29832e-06 9.29832e-06 9.29832e-06 9.29832e-06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 24077 TrkackID 0 startx, y, z 220.212 606.246 128.78 wireno, peakt tpcno 478 59.4389 5 dist 0min T, max_T51.9327 3745.42
no of hits closeby 0 event 24077 TrkackID 0 startx, y, z 220.212 606.246 128.78 wireno, peakt tpcno 478 59.4389 5 dist 0min T, max_T51.9327 3745.42
27-Sep-2024 09:57:20 PDT Closed output file "np04hd_raw_run027334_0171_dataflow1_datawriter_0_20240621T043203_reco_stage1_reco_stage2_20240927T165720_keepup.root"
27-Sep-2024 09:57:20 PDT Closed input file "np04hd_raw_run027334_0171_dataflow1_datawriter_0_20240621T043203_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 29.8159 100.189 220.502 87.5673 38.46 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000600175 0.00180555 0.00347698 0.00154835 0.00100754 35
produce:fembfilter:PDHDFEMBFilter 0.49966 0.524977 0.572485 0.521011 0.0145776 35
produce:wclsdatahd:WireCellToolkit 25.9703 27.1646 32.2051 26.8382 1.1538 35
produce:gaushit:GausHitFinder 0.451023 0.657586 1.02745 0.631528 0.135858 35
produce:nhitsfilter:NumberOfHitsFilter 0.000231849 0.000331499 0.000618015 0.000301718 8.83348e-05 35
produce:reco3d:SpacePointSolver 0.228972 1.21858 3.06932 0.955947 0.785168 34
produce:hitpdune:DisambigFromSpacePoints 0.27595 0.674115 1.73703 0.542116 0.386083 34
produce:pandora:StandardPandora 6.41333 34.4614 140.67 25.2361 26.5836 34
produce:pandoraWriter:StandardPandora 0.0933994 0.143176 0.234764 0.130961 0.0346587 34
produce:pandoraTrack:LArPandoraTrackCreation 0.671932 1.76834 4.02807 1.64964 0.758856 34
produce:pandoraShower:LArPandoraShowerCreation 0.900195 1.84876 4.18101 1.48106 0.897388 34
produce:pandoracalo:Calorimetry 0.40745 0.895885 2.03594 0.816349 0.368781 34
produce:pandoracalonosce:Calorimetry 0.372625 0.85129 1.95448 0.768367 0.366965 34
produce:pandorapid:Chi2ParticleID 0.00116812 0.00184459 0.00388639 0.00178304 0.000486151 34
produce:pandoraShowercalo:ShowerCalorimetry 0.809765 1.80389 4.47692 1.38868 0.954479 34
produce:pandoraShowercalonosce:ShowerCalorimetry 0.781601 1.78048 4.46745 1.33472 1.03598 34
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0713386 0.102316 0.166962 0.0959906 0.0239599 34
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0244162 0.0353125 0.0568356 0.0325189 0.00840788 34
produce:emtrkmichelid:EmTrackMichelId 17.0925 26.6561 47.6264 25.0345 6.57352 34
[art]:TriggerResults:TriggerResultInserter 1.833e-05 2.6761e-05 8.915e-05 2.359e-05 1.24055e-05 35
end_path:out1:RootOutput 3.78e-06 5.91234e-06 2.869e-05 4.99e-06 4.09272e-06 35
end_path:michelremoving:michelremoving 1.435e-05 0.0716822 0.48286 0.0276343 0.0904454 35
end_path:michelremovinggnocchi:michelremoving 5.52e-06 0.0685597 0.477387 0.02264 0.0903415 35
end_path:calibanagnocchi:CalibAnaTree 5.129e-06 0.667455 1.47816 0.619629 0.296779 35
end_path:out1:RootOutput(write) 0.29221 0.724274 1.22029 0.685346 0.18273 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5147.67 MB
Peak resident set size usage (VmHWM): 2762.17 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027334_0171_dataflow1_datawriter_0_20240621T043203_reco_stage1_reco_stage2_20240927T165720_keepup.root
\tHists: np04hd_raw_run027334_0171_dataflow1_datawriter_0_20240621T043203_reco_stage1_reco_stage2_20240927T165720_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027334_0171_dataflow1_datawriter_0_20240621T043203_reco_stage1_reco_stage2_20240927T165720_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027334_0171_dataflow1_datawriter_0_20240621T043203_reco_stage1_reco_stage2_20240927T165720_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727452703.0,
"core.end_time": 1727456240.0,
"core.events": [
23941,
23945,
23949,
23953,
23957,
23961,
23965,
23969,
23973,
23977,
23981,
23985,
23989,
23993,
23997,
24001,
24005,
24009,
24013,
24017,
24021,
24025,
24029,
24033,
24037,
24041,
24045,
24049,
24053,
24057,
24061,
24065,
24069,
24073,
24077
],
"core.event_count": 35,
"core.first_event_number": 23941,
"core.last_event_number": 24077,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27334
],
"core.runs_subruns": [
2733400001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027334_0171_dataflow1_datawriter_0_20240621T043203.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027334_0171_dataflow1_datawriter_0_20240621T043203_reco_stage1_reco_stage2_20240927T165720_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727452703.0,
"core.end_time": 1727456240.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27334
],
"core.runs_subruns": [
2733400001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027334_0171_dataflow1_datawriter_0_20240621T043203.hdf5"
}
]
}