Jobsub ID 85799.0@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 85799.0@justin-prod-sched02.dune.hep.ac.uk | |
| Workflow ID | 3717 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2024-10-24 02:05:55 | |
| Site | UK_Manchester | |
| Entry | UBoone_T2_UK_Manchester_ce01 | |
| Last heartbeat | 2024-10-25 16:33:28 | |
| From worker node | Hostname | wn2209240.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7513 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 257400 (71 hours) | |
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2024-10-24 02:07:41 | |
| Input files | hd-protodune:np04hd_raw_run031107_0086_dataflow0_datawriter_0_20241018T183543.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 1d (138286s) | |
| CPU time | 1d (135925s = 98%) | |
| Outputting started | 2024-10-25 16:32:27 | |
| Output files | hd-protodune-det-reco:np04hd_raw_run031107_0086_dataflow0_datawriter_0_20241018T183543_reco_stage1_reco_stage2_20241025T163220_keepup.root hd-protodune-det-reco:np04hd_raw_run031107_0086_dataflow0_datawriter_0_20241018T183543_reco_stage1_reco_stage2_20241025T163220_keepup_hists.root | |
| Finished | 2024-10-25 16:33:28 | |
| Saved logs | justin-logs:85799.0-justin-prod-sched02.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
TPC 1
12456 hits in TPC 2
10912 hits in TPC 3
4746 hits in TPC 4
9785 hits in TPC 5
6812 hits in TPC 6
4331 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:2 230815 XUs and 199222 XVs -> 27158 XUVs
C:0 T:3 233 XUs and 263 XVs -> 6 XUVs
C:0 T:4 88 XUs and 51 XVs -> 2 XUVs
C:0 T:5 53114 XUs and 38553 XVs -> 1377 XUVs
C:0 T:6 22351 XUs and 28465 XVs -> 2504 XUVs
C:0 T:7 91 XUs and 95 XVs -> 2 XUVs
31049 XUVs total
4822 collection wire objects
31049 potential space points
Neighbour search...
10383477 tests to find 2057478 neighbours
Iterating with no regularization...
Begin: 6.46747e+07
0 3.37804e+07
1 3.0181e+07
2 2.96405e+07
3 2.94951e+07
4 2.94377e+07
5 2.94097e+07
Now with regularization...
Begin: 2.50381e+07
0 2.49208e+07
1 2.48878e+07
2 2.48733e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 0 event 3458 TrkackID 15 startx, y, z 8.05798 597.443 76.735 wireno, peakt tpcno 188 1492.22 2 dist 413.932min T, max_T6.22612 1520.98
no of hits closeby 0 event 3458 TrkackID 15 startx, y, z 8.05798 597.443 76.735 wireno, peakt tpcno 188 1492.22 2 dist 413.932min T, max_T6.22612 1520.98
25-Oct-2024 17:32:20 BST Closed output file "np04hd_raw_run031107_0086_dataflow0_datawriter_0_20241018T183543_reco_stage1_reco_stage2_20241025T163220_keepup.root"
25-Oct-2024 17:32:20 BST Closed input file "np04hd_raw_run031107_0086_dataflow0_datawriter_0_20241018T183543_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 76.791 7138.44 130503 246.663 29078.2 19
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000546707 0.00446274 0.0124877 0.00243255 0.0036632 19
produce:fembfilter:PDHDFEMBFilter 0.769814 1.35151 1.99498 1.40908 0.378813 19
produce:wclsdatahd:WireCellToolkit 66.2924 109.348 144.449 119.262 27.0758 19
produce:gaushit:GausHitFinder 0.577644 1.24803 2.46259 1.2118 0.486743 19
produce:nhitsfilter:NumberOfHitsFilter 0.000348114 0.000590726 0.00145001 0.000514427 0.000270199 19
[art]:TriggerResults:TriggerResultInserter 1.8324e-05 6.21041e-05 0.000138039 6.5964e-05 2.99468e-05 19
end_path:out1:RootOutput 5.48e-06 1.52601e-05 4.5976e-05 1.4046e-05 8.95587e-06 19
end_path:michelremoving:michelremoving 2.0268e-05 0.102273 0.369858 0.0608024 0.117472 19
end_path:michelremovinggnocchi:michelremoving 1.2924e-05 0.100975 0.394766 0.0573208 0.12349 19
end_path:calibanagnocchi:CalibAnaTree 9.237e-06 1.79131 7.41738 1.57693 1.99698 19
end_path:out1:RootOutput(write) 0.24898 1.24508 2.36186 1.21622 0.620465 19
produce:reco3d:SpacePointSolver 2.24799 21.3728 181.105 6.95514 46.3158 13
produce:hitpdune:DisambigFromSpacePoints 1.42425 2.51102 3.95374 2.02287 0.878235 13
produce:pandora:StandardPandora 20.5138 10160.5 130160 76.1129 34641.5 13
produce:pandoraWriter:StandardPandora 0.208516 0.362598 0.638108 0.329859 0.125998 13
produce:pandoraTrack:LArPandoraTrackCreation 2.75776 7.39615 23.7322 4.65038 5.8233 13
produce:pandoraShower:LArPandoraShowerCreation 2.32099 6.55717 12.711 6.91813 3.24409 13
produce:pandoracalo:Calorimetry 0.959867 2.76902 7.01802 1.91303 1.75841 13
produce:pandoracalonosce:Calorimetry 0.965002 2.61569 6.50705 1.868 1.57829 13
produce:pandorapid:Chi2ParticleID 0.00187166 0.00332202 0.00519944 0.00324625 0.00112021 13
produce:pandoraShowercalo:ShowerCalorimetry 2.04097 5.19775 9.86485 5.59895 2.05665 13
produce:pandoraShowercalonosce:ShowerCalorimetry 1.93399 5.11049 9.45694 4.47022 2.18724 13
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0779926 0.177033 0.298801 0.151565 0.0650433 13
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0343559 0.0740187 0.109658 0.066702 0.0241166 13
produce:emtrkmichelid:EmTrackMichelId 27.3244 49.5878 80.6666 48.8617 15.2876 13
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 6541.67 MB
Peak resident set size usage (VmHWM): 4172.36 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run031107_0086_dataflow0_datawriter_0_20241018T183543_reco_stage1_reco_stage2_20241025T163220_keepup.root
\tHists: np04hd_raw_run031107_0086_dataflow0_datawriter_0_20241018T183543_reco_stage1_reco_stage2_20241025T163220_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run031107_0086_dataflow0_datawriter_0_20241018T183543_reco_stage1_reco_stage2_20241025T163220_keepup.root
Ran successfully
{
"name": "np04hd_raw_run031107_0086_dataflow0_datawriter_0_20241018T183543_reco_stage1_reco_stage2_20241025T163220_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1729738251.0,
"core.end_time": 1729873941.0,
"core.events": [
3422,
3424,
3426,
3428,
3430,
3432,
3434,
3436,
3438,
3440,
3442,
3444,
3446,
3448,
3450,
3452,
3454,
3456,
3458
],
"core.event_count": 19,
"core.first_event_number": 3422,
"core.last_event_number": 3458,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
31107
],
"core.runs_subruns": [
3110700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run031107_0086_dataflow0_datawriter_0_20241018T183543.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run031107_0086_dataflow0_datawriter_0_20241018T183543_reco_stage1_reco_stage2_20241025T163220_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1729738251.0,
"core.end_time": 1729873941.0,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
31107
],
"core.runs_subruns": [
3110700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run031107_0086_dataflow0_datawriter_0_20241018T183543.hdf5"
}
]
}