Jobsub ID 79940.97@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 79940.97@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3515 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 07:57:23 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw7 |
| Last heartbeat | 2024-09-27 16:40:21 |
| From worker node | Hostname | mh-7763-2.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 12:51:50 |
| Input files | hd-protodune:np04hd_raw_run027388_0936_dataflow3_datawriter_0_20240623T043336.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (10144s) |
| CPU time | 56m (3408s = 33%) |
| Outputting started | 2024-09-27 15:40:56 |
| Output files | |
| Finished | 2024-09-27 16:40:21 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
3.1088e+07
4 3.10717e+07
Now with regularization...
Begin: 2.92346e+07
0 2.92172e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 131179 TrkackID 9 startx, y, z -162.034 460.601 232.367 wireno, peakt tpcno 221 972.646 6 dist 0min T, max_T6.35815 2100.72
no of hits closeby 0 event 131179 TrkackID 10 startx, y, z 114.054 596.185 401.169 wireno, peakt tpcno 169 702 5 dist 0min T, max_T702 3102.52
no of hits closeby 2 event 131179 TrkackID 20 startx, y, z 25.1377 590.243 355.83 wireno, peakt tpcno 125 3.89067 5 dist 0min T, max_T2.63997 839.133
no of hits closeby 0 event 131179 TrkackID 9 startx, y, z -162.034 460.601 232.367 wireno, peakt tpcno 221 972.646 6 dist 0min T, max_T6.35815 2100.72
no of hits closeby 0 event 131179 TrkackID 10 startx, y, z 114.054 596.185 401.169 wireno, peakt tpcno 169 702 5 dist 0min T, max_T702 3102.52
no of hits closeby 2 event 131179 TrkackID 20 startx, y, z 25.1377 590.243 355.83 wireno, peakt tpcno 125 3.89067 5 dist 0min T, max_T2.63997 839.133
27-Sep-2024 08:40:48 PDT Closed output file "np04hd_raw_run027388_0936_dataflow3_datawriter_0_20240623T043336_reco_stage1_reco_stage2_20240927T154048_keepup.root"
27-Sep-2024 08:40:48 PDT Closed input file "np04hd_raw_run027388_0936_dataflow3_datawriter_0_20240623T043336_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 49.5005 77.7307 127.651 76.0833 16.3447 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00046158 0.00182074 0.00400448 0.00180764 0.000905192 35
produce:fembfilter:PDHDFEMBFilter 0.514031 0.556621 0.684094 0.547259 0.0325862 35
produce:wclsdatahd:WireCellToolkit 27.0018 30.3714 34.7517 30.5525 1.8825 35
produce:gaushit:GausHitFinder 0.349667 0.562294 0.860627 0.553945 0.123452 35
produce:nhitsfilter:NumberOfHitsFilter 0.00018772 0.000289315 0.00045528 0.00027986 6.25673e-05 35
produce:reco3d:SpacePointSolver 0.145141 0.967519 4.72354 0.678068 0.97539 35
produce:hitpdune:DisambigFromSpacePoints 0.129313 0.461041 1.48078 0.387603 0.261147 35
produce:pandora:StandardPandora 4.0162 12.5414 34.9637 11.1968 6.79413 35
produce:pandoraWriter:StandardPandora 0.0834267 0.12703 0.212047 0.122351 0.028975 35
produce:pandoraTrack:LArPandoraTrackCreation 0.537941 1.30757 3.65987 1.13384 0.599334 35
produce:pandoraShower:LArPandoraShowerCreation 0.505648 1.4726 4.04329 1.24372 0.76587 35
produce:pandoracalo:Calorimetry 0.284243 0.662213 1.76669 0.577418 0.277084 35
produce:pandoracalonosce:Calorimetry 0.257039 0.602891 1.65324 0.526553 0.256126 35
produce:pandorapid:Chi2ParticleID 0.0011893 0.00179235 0.00323192 0.00176618 0.000384712 35
produce:pandoraShowercalo:ShowerCalorimetry 0.451302 1.33972 3.71803 1.18594 0.661048 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.434893 1.2823 3.42675 1.12506 0.624269 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0535132 0.0970265 0.132815 0.0966043 0.0190365 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0172779 0.0333013 0.0466597 0.0331425 0.00648183 35
produce:emtrkmichelid:EmTrackMichelId 12.8977 23.9879 33.9261 23.5592 5.37385 35
[art]:TriggerResults:TriggerResultInserter 1.694e-05 3.1056e-05 8.801e-05 2.853e-05 1.35274e-05 35
end_path:out1:RootOutput 3.76e-06 9.0374e-06 3.095e-05 9.01e-06 4.51768e-06 35
end_path:michelremoving:michelremoving 0.0150023 0.064172 0.563285 0.024386 0.0994498 35
end_path:michelremovinggnocchi:michelremoving 0.0145201 0.0619284 0.55395 0.0214184 0.0982061 35
end_path:calibanagnocchi:CalibAnaTree 0.199556 0.479614 1.22082 0.427087 0.199146 35
end_path:out1:RootOutput(write) 0.35252 0.617573 0.990315 0.596466 0.148714 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5053.17 MB
Peak resident set size usage (VmHWM): 2659.61 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027388_0936_dataflow3_datawriter_0_20240623T043336_reco_stage1_reco_stage2_20240927T154048_keepup.root
\tHists: np04hd_raw_run027388_0936_dataflow3_datawriter_0_20240623T043336_reco_stage1_reco_stage2_20240927T154048_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027388_0936_dataflow3_datawriter_0_20240623T043336_reco_stage1_reco_stage2_20240927T154048_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027388_0936_dataflow3_datawriter_0_20240623T043336_reco_stage1_reco_stage2_20240927T154048_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727448894.0,
"core.end_time": 1727451649.0,
"core.events": [
131043,
131047,
131051,
131055,
131059,
131063,
131067,
131071,
131075,
131079,
131083,
131087,
131091,
131095,
131099,
131103,
131107,
131111,
131115,
131119,
131123,
131127,
131131,
131135,
131139,
131143,
131147,
131151,
131155,
131159,
131163,
131167,
131171,
131175,
131179
],
"core.event_count": 35,
"core.first_event_number": 131043,
"core.last_event_number": 131179,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27388
],
"core.runs_subruns": [
2738800001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027388_0936_dataflow3_datawriter_0_20240623T043336.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027388_0936_dataflow3_datawriter_0_20240623T043336_reco_stage1_reco_stage2_20240927T154048_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727448894.0,
"core.end_time": 1727451649.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27388
],
"core.runs_subruns": [
2738800001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027388_0936_dataflow3_datawriter_0_20240623T043336.hdf5"
}
]
} 