Jobsub ID 266082.13@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 266082.13@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 3552 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2024-09-28 22:17:53 | |
| Site | UK_Edinburgh | |
| Entry | DUNE_UK_SGridECDF_ce1_multicore | |
| Last heartbeat | 2024-09-28 23:40:24 | |
| From worker node | Hostname | node1G23.ecdf.ed.ac.uk |
| cpuinfo | Intel(R) Xeon(R) Gold 5218 CPU @ 2.30GHz | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2024-09-28 22:19:28 | |
| Input files | hd-protodune:np04hd_raw_run029389_0018_dataflow1_datawriter_0_20240928T212619.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 1h (4784s) | |
| CPU time | 1h (4305s = 89%) | |
| Outputting started | 2024-09-28 23:39:13 | |
| Output files | hd-protodune-det-reco:np04hd_raw_run029389_0018_dataflow1_datawriter_0_20240928T212619_reco_stage1_reco_stage2_20240928T233905_keepup.root hd-protodune-det-reco:np04hd_raw_run029389_0018_dataflow1_datawriter_0_20240928T212619_reco_stage1_reco_stage2_20240928T233905_keepup_hists.root | |
| Finished | 2024-09-28 23:40:24 | |
| Saved logs | justin-logs:266082.13-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
wiener"
FrameSaver: q=736983 n=572576 tag=wiener
3510 hits in TPC 0
3402 hits in TPC 1
4530 hits in TPC 2
1788 hits in TPC 3
694 hits in TPC 4
1107 hits in TPC 5
5533 hits in TPC 6
2673 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 3136 XUs and 3027 XVs -> 138 XUVs
C:0 T:2 14461 XUs and 8508 XVs -> 179 XUVs
C:0 T:3 65 XUs and 53 XVs -> 0 XUVs
C:0 T:4 15 XUs and 18 XVs -> 3 XUVs
C:0 T:5 2301 XUs and 8747 XVs -> 61 XUVs
C:0 T:6 18247 XUs and 15784 XVs -> 347 XUVs
C:0 T:7 245 XUs and 298 XVs -> 24 XUVs
752 XUVs total
432 collection wire objects
752 potential space points
Neighbour search...
16170 tests to find 10316 neighbours
Iterating with no regularization...
Begin: 1.97155e+06
0 1.85159e+06
1 1.84829e+06
2 1.84785e+06
Now with regularization...
Begin: 1.76928e+06
0 1.76913e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLArTPCIntercepts - inconsistent number of intercepts between a line and the LArTPC
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
29-Sep-2024 00:39:05 BST Closed output file "np04hd_raw_run029389_0018_dataflow1_datawriter_0_20240928T212619_reco_stage1_reco_stage2_20240928T233905_keepup.root"
29-Sep-2024 00:39:05 BST Closed input file "np04hd_raw_run029389_0018_dataflow1_datawriter_0_20240928T212619_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 63.0405 88.5048 124.878 87.8988 16.5121 39
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000300615 0.00101047 0.00397579 0.000778021 0.000831828 39
produce:fembfilter:PDHDFEMBFilter 0.61344 0.630211 0.665567 0.628461 0.00902118 39
produce:wclsdatahd:WireCellToolkit 39.3512 41.2713 42.6488 41.2753 0.726394 39
produce:gaushit:GausHitFinder 0.382816 0.681133 1.00796 0.674496 0.157478 39
produce:nhitsfilter:NumberOfHitsFilter 0.000289153 0.000409438 0.000582261 0.00040439 7.55473e-05 39
produce:reco3d:SpacePointSolver 0.125861 1.24391 4.51466 0.795463 1.18144 39
produce:hitpdune:DisambigFromSpacePoints 0.160906 0.54426 1.1214 0.48723 0.271933 39
produce:pandora:StandardPandora 5.18107 12.7486 34.4841 12.0397 6.42854 39
produce:pandoraWriter:StandardPandora 0.07946 0.153906 0.235637 0.148044 0.0358451 39
produce:pandoraTrack:LArPandoraTrackCreation 0.403526 1.68605 3.56456 1.52422 0.737934 39
produce:pandoraShower:LArPandoraShowerCreation 0.423117 2.02913 4.44987 1.85907 0.989638 39
produce:pandoracalo:Calorimetry 0.229993 0.753026 1.56087 0.707399 0.304647 39
produce:pandoracalonosce:Calorimetry 0.192853 0.700633 1.47796 0.647066 0.293103 39
produce:pandorapid:Chi2ParticleID 0.00118583 0.00163768 0.00266595 0.0015844 0.000331264 39
produce:pandoraShowercalo:ShowerCalorimetry 0.377516 1.83624 4.36353 1.66909 0.930571 39
produce:pandoraShowercalonosce:ShowerCalorimetry 0.371989 1.80407 4.29601 1.5906 0.908043 39
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0744683 0.119538 0.183249 0.119665 0.0262792 39
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0291401 0.0468697 0.0768637 0.0458239 0.0111119 39
produce:emtrkmichelid:EmTrackMichelId 12.8756 20.6241 31.137 20.0245 4.67352 39
[art]:TriggerResults:TriggerResultInserter 2.2799e-05 3.36672e-05 6.4032e-05 3.2393e-05 6.79561e-06 39
end_path:out1:RootOutput 8.248e-06 1.01105e-05 1.8076e-05 9.682e-06 1.74452e-06 39
end_path:michelremoving:michelremoving 0.0206682 0.0841532 0.357239 0.0429955 0.0725657 39
end_path:michelremovinggnocchi:michelremoving 0.020135 0.0815792 0.368919 0.0385439 0.0740309 39
end_path:calibanagnocchi:CalibAnaTree 0.218325 0.562751 1.32568 0.550456 0.225354 39
end_path:out1:RootOutput(write) 0.424029 0.722358 1.08926 0.700859 0.165298 39
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5813.54 MB
Peak resident set size usage (VmHWM): 2874.79 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029389_0018_dataflow1_datawriter_0_20240928T212619_reco_stage1_reco_stage2_20240928T233905_keepup.root
\tHists: np04hd_raw_run029389_0018_dataflow1_datawriter_0_20240928T212619_reco_stage1_reco_stage2_20240928T233905_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029389_0018_dataflow1_datawriter_0_20240928T212619_reco_stage1_reco_stage2_20240928T233905_keepup.root
Ran successfully
{
"name": "np04hd_raw_run029389_0018_dataflow1_datawriter_0_20240928T212619_reco_stage1_reco_stage2_20240928T233905_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727563260.0,
"core.end_time": 1727566746.0,
"core.events": [
1405,
1407,
1409,
1411,
1413,
1415,
1417,
1419,
1421,
1423,
1425,
1427,
1429,
1431,
1433,
1435,
1437,
1439,
1441,
1443,
1445,
1447,
1449,
1451,
1453,
1455,
1457,
1459,
1461,
1463,
1465,
1467,
1469,
1471,
1473,
1475,
1477,
1479,
1481
],
"core.event_count": 39,
"core.first_event_number": 1405,
"core.last_event_number": 1481,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29389
],
"core.runs_subruns": [
2938900001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029389_0018_dataflow1_datawriter_0_20240928T212619.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run029389_0018_dataflow1_datawriter_0_20240928T212619_reco_stage1_reco_stage2_20240928T233905_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727563260.0,
"core.end_time": 1727566746.0,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29389
],
"core.runs_subruns": [
2938900001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029389_0018_dataflow1_datawriter_0_20240928T212619.hdf5"
}
]
}