Jobsub ID 262679.43@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 262679.43@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 3447 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2024-09-26 02:50:20 | |
| Site | UK_Durham | |
| Entry | DUNE_UK_SGridDurham_ce3 | |
| Last heartbeat | 2024-09-26 06:42:30 | |
| From worker node | Hostname | n240.dur.scotgrid.ac.uk |
| cpuinfo | AMD EPYC 7352 24-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2024-09-26 03:56:21 | |
| Input files | hd-protodune:np04hd_raw_run029081_1062_dataflow3_datawriter_0_20240905T095713.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 1h (5827s) | |
| CPU time | 1h (3823s = 65%) | |
| Outputting started | 2024-09-26 05:33:29 | |
| Output files | hd-protodune-det-reco:np04hd_raw_run029081_1062_dataflow3_datawriter_0_20240905T095713_reco_stage1_reco_stage2_20240926T053320_keepup.root hd-protodune-det-reco:np04hd_raw_run029081_1062_dataflow3_datawriter_0_20240905T095713_reco_stage1_reco_stage2_20240926T053320_keepup_hists.root | |
| Finished | 2024-09-26 06:42:30 | |
| Saved logs | justin-logs:262679.43-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
aver: q=935240 n=698730 tag=wiener
3598 hits in TPC 0
4392 hits in TPC 1
3268 hits in TPC 2
2361 hits in TPC 3
2313 hits in TPC 4
4455 hits in TPC 5
5332 hits in TPC 6
3813 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 412 XUs and 166 XVs -> 9 XUVs
C:0 T:2 5719 XUs and 25398 XVs -> 438 XUVs
C:0 T:3 106 XUs and 169 XVs -> 8 XUVs
C:0 T:4 44 XUs and 59 XVs -> 0 XUVs
C:0 T:5 9208 XUs and 7139 XVs -> 361 XUVs
C:0 T:6 24155 XUs and 45428 XVs -> 5048 XUVs
C:0 T:7 109 XUs and 350 XVs -> 7 XUVs
5871 XUVs total
1146 collection wire objects
5871 potential space points
Neighbour search...
1018315 tests to find 427016 neighbours
Iterating with no regularization...
Begin: 9.23286e+06
0 8.6125e+06
1 8.5308e+06
2 8.5216e+06
3 8.51784e+06
Now with regularization...
Begin: 8.13481e+06
0 8.1324e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 4 event 255115 TrkackID 6 startx, y, z -128.171 599.192 149.847 wireno, peakt tpcno 136 4038.61 6 dist 0.0258832min T, max_T2717.83 4372.5
no of hits closeby 4 event 255115 TrkackID 6 startx, y, z -128.171 599.192 149.847 wireno, peakt tpcno 136 4038.61 6 dist 0.0258832min T, max_T2717.83 4372.5
26-Sep-2024 06:33:20 BST Closed output file "np04hd_raw_run029081_1062_dataflow3_datawriter_0_20240905T095713_reco_stage1_reco_stage2_20240926T053320_keepup.root"
26-Sep-2024 06:33:20 BST Closed input file "np04hd_raw_run029081_1062_dataflow3_datawriter_0_20240905T095713_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 38.7214 94.9953 173.599 87.2456 27.4558 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000536027 0.00248092 0.00535414 0.00259289 0.0012653 30
produce:fembfilter:PDHDFEMBFilter 0.528249 0.731616 0.896896 0.764785 0.0959845 30
produce:wclsdatahd:WireCellToolkit 30.4817 40.0452 50.6494 38.5614 5.03387 30
produce:gaushit:GausHitFinder 0.31226 0.762037 1.17486 0.778232 0.233171 30
produce:nhitsfilter:NumberOfHitsFilter 0.000265489 0.000435405 0.000679647 0.000447932 0.00010405 30
produce:reco3d:SpacePointSolver 0.121062 1.01732 3.47361 0.682667 0.814521 29
produce:hitpdune:DisambigFromSpacePoints 0.138761 0.624048 1.45969 0.584493 0.359492 29
produce:pandora:StandardPandora 3.53066 15.3001 44.5798 11.9018 10.0695 29
produce:pandoraWriter:StandardPandora 0.0814562 0.164453 0.281282 0.154595 0.0498903 29
produce:pandoraTrack:LArPandoraTrackCreation 0.365548 1.29822 2.88494 1.15428 0.666072 29
produce:pandoraShower:LArPandoraShowerCreation 0.386829 1.51349 4.14337 1.26902 0.935016 29
produce:pandoracalo:Calorimetry 0.193287 0.65277 1.32165 0.59538 0.28336 29
produce:pandoracalonosce:Calorimetry 0.163861 0.595032 1.24349 0.528143 0.27326 29
produce:pandorapid:Chi2ParticleID 0.00117765 0.00198401 0.00285743 0.00196218 0.0004715 29
produce:pandoraShowercalo:ShowerCalorimetry 0.337577 1.40803 3.88149 1.11953 0.870191 29
produce:pandoraShowercalonosce:ShowerCalorimetry 0.327089 1.35584 3.71884 1.07418 0.829276 29
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0781551 0.159446 0.278559 0.147813 0.0507734 29
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0254997 0.0535831 0.0886922 0.0498154 0.0161023 29
produce:emtrkmichelid:EmTrackMichelId 16.2498 29.422 63.6721 26.0493 10.2739 29
[art]:TriggerResults:TriggerResultInserter 1.6361e-05 3.57207e-05 0.000117341 2.676e-05 2.03678e-05 30
end_path:out1:RootOutput 8.706e-06 1.16422e-05 2.5107e-05 1.0385e-05 3.45846e-06 30
end_path:michelremoving:michelremoving 3.2441e-05 0.0907215 0.300188 0.0444422 0.0805402 30
end_path:michelremovinggnocchi:michelremoving 1.0921e-05 0.0877353 0.270394 0.042989 0.0776033 30
end_path:calibanagnocchi:CalibAnaTree 1.2123e-05 0.491686 1.28728 0.449594 0.252788 30
end_path:out1:RootOutput(write) 0.304569 0.882792 1.47062 0.860365 0.290131 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4942.94 MB
Peak resident set size usage (VmHWM): 2615.28 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029081_1062_dataflow3_datawriter_0_20240905T095713_reco_stage1_reco_stage2_20240926T053320_keepup.root
\tHists: np04hd_raw_run029081_1062_dataflow3_datawriter_0_20240905T095713_reco_stage1_reco_stage2_20240926T053320_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029081_1062_dataflow3_datawriter_0_20240905T095713_reco_stage1_reco_stage2_20240926T053320_keepup.root
Ran successfully
{
"name": "np04hd_raw_run029081_1062_dataflow3_datawriter_0_20240905T095713_reco_stage1_reco_stage2_20240926T053320_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727325913.0,
"core.end_time": 1727328801.0,
"core.events": [
254883,
254891,
254899,
254907,
254915,
254923,
254931,
254939,
254947,
254955,
254963,
254971,
254979,
254987,
254995,
255003,
255011,
255019,
255027,
255035,
255043,
255051,
255059,
255067,
255075,
255083,
255091,
255099,
255107,
255115
],
"core.event_count": 30,
"core.first_event_number": 254883,
"core.last_event_number": 255115,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29081
],
"core.runs_subruns": [
2908100001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029081_1062_dataflow3_datawriter_0_20240905T095713.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run029081_1062_dataflow3_datawriter_0_20240905T095713_reco_stage1_reco_stage2_20240926T053320_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727325913.0,
"core.end_time": 1727328801.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29081
],
"core.runs_subruns": [
2908100001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029081_1062_dataflow3_datawriter_0_20240905T095713.hdf5"
}
]
}