Jobsub ID 83010.54@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 83010.54@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3701 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-10-17 05:26:43 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2024-10-17 13:44:53 |
| From worker node | Hostname | dunegli-4189404-0-fnpc23032.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| Inner Apptainer? | True |
| Job state | stalled |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-10-17 11:53:27 |
| Input files | hd-protodune:np04hd_raw_run027328_0009_dataflow1_datawriter_0_20240620T150436.hdf5
|
| Outputting started | 2024-10-17 13:28:26 |
| Output files | |
| Finished | 2024-10-17 14:25:27 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
871 traces tagged "wiener"
FrameSaver: q=3.28986e+06 n=1105062 tag=wiener
4989 hits in TPC 0
5163 hits in TPC 1
7810 hits in TPC 2
5291 hits in TPC 3
4461 hits in TPC 4
9567 hits in TPC 5
8109 hits in TPC 6
6352 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 11 XUs and 9 XVs -> 3 XUVs
C:0 T:1 6927 XUs and 5427 XVs -> 376 XUVs
C:0 T:2 41730 XUs and 42500 XVs -> 1864 XUVs
C:0 T:3 331 XUs and 255 XVs -> 5 XUVs
C:0 T:4 201 XUs and 169 XVs -> 4 XUVs
C:0 T:5 44508 XUs and 34369 XVs -> 2039 XUVs
C:0 T:6 35063 XUs and 58154 XVs -> 4675 XUVs
C:0 T:7 1300 XUs and 1526 XVs -> 127 XUVs
9093 XUVs total
2595 collection wire objects
9093 potential space points
Neighbour search...
626899 tests to find 276254 neighbours
Iterating with no regularization...
Begin: 1.72396e+08
0 1.56262e+08
1 1.54761e+08
2 1.54577e+08
3 1.54522e+08
Now with regularization...
Begin: 1.47832e+08
0 1.47745e+08
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
17-Oct-2024 13:28:20 UTC Closed output file "np04hd_raw_run027328_0009_dataflow1_datawriter_0_20240620T150436_reco_stage1_reco_stage2_20241017T132820_keepup.root"
17-Oct-2024 13:28:21 UTC Closed input file "np04hd_raw_run027328_0009_dataflow1_datawriter_0_20240620T150436_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 44.8953 90.1544 226.665 75.2399 47.5144 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000395918 0.00128272 0.00305234 0.001075 0.000678644 35
produce:fembfilter:PDHDFEMBFilter 0.44659 0.650627 0.951148 0.638188 0.15649 35
produce:wclsdatahd:WireCellToolkit 21.822 26.9449 35.4279 24.4843 4.53012 35
produce:gaushit:GausHitFinder 0.250363 0.627129 1.3181 0.571766 0.289895 35
produce:nhitsfilter:NumberOfHitsFilter 0.000141571 0.000324045 0.00100307 0.00028202 0.000172673 35
produce:reco3d:SpacePointSolver 0.121424 0.811686 2.85797 0.607786 0.686484 35
produce:hitpdune:DisambigFromSpacePoints 0.123556 0.641416 2.31691 0.46269 0.561201 35
produce:pandora:StandardPandora 3.95561 27.5646 119.322 13.6507 31.5145 35
produce:pandoraWriter:StandardPandora 0.0520249 0.130067 0.26339 0.112938 0.0599596 35
produce:pandoraTrack:LArPandoraTrackCreation 0.345638 1.39886 4.49376 1.27457 0.972972 35
produce:pandoraShower:LArPandoraShowerCreation 0.333021 1.447 5.03221 1.28122 1.03962 35
produce:pandoracalo:Calorimetry 0.198761 0.726975 2.19478 0.628442 0.493891 35
produce:pandoracalonosce:Calorimetry 0.180015 0.67934 2.12526 0.593028 0.473517 35
produce:pandorapid:Chi2ParticleID 0.000703998 0.00178995 0.00544327 0.00160688 0.00090191 35
produce:pandoraShowercalo:ShowerCalorimetry 0.291543 1.3778 4.68332 1.08375 0.992184 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.279695 1.31956 4.63199 1.07104 0.960766 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0406087 0.106974 0.198903 0.0967952 0.041555 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0147664 0.0355555 0.0672061 0.0334622 0.0139915 35
produce:emtrkmichelid:EmTrackMichelId 11.6276 24.3656 43.4661 22.2984 8.02415 35
[art]:TriggerResults:TriggerResultInserter 1.2885e-05 1.88386e-05 6.3853e-05 1.585e-05 8.78809e-06 35
end_path:out1:RootOutput 5.33e-06 7.13503e-06 2.3776e-05 6.673e-06 2.98357e-06 35
end_path:michelremoving:michelremoving 0.00911544 0.0294238 0.127504 0.0227666 0.023876 35
end_path:michelremovinggnocchi:michelremoving 0.00801368 0.0272538 0.123844 0.0197262 0.0237326 35
end_path:calibanagnocchi:CalibAnaTree 0.126144 0.515398 1.67095 0.45979 0.345818 35
end_path:out1:RootOutput(write) 0.309791 0.672189 1.47968 0.625625 0.266618 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5009.6 MB
Peak resident set size usage (VmHWM): 2686.01 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027328_0009_dataflow1_datawriter_0_20240620T150436_reco_stage1_reco_stage2_20241017T132820_keepup.root
\tHists: np04hd_raw_run027328_0009_dataflow1_datawriter_0_20240620T150436_reco_stage1_reco_stage2_20241017T132820_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027328_0009_dataflow1_datawriter_0_20240620T150436_reco_stage1_reco_stage2_20241017T132820_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027328_0009_dataflow1_datawriter_0_20240620T150436_reco_stage1_reco_stage2_20241017T132820_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1729168509.0,
"core.end_time": 1729171701.0,
"core.events": [
1297,
1301,
1305,
1309,
1313,
1317,
1321,
1325,
1329,
1333,
1337,
1341,
1345,
1349,
1353,
1357,
1361,
1365,
1369,
1373,
1377,
1381,
1385,
1389,
1393,
1397,
1401,
1405,
1409,
1413,
1417,
1421,
1425,
1429,
1433
],
"core.event_count": 35,
"core.first_event_number": 1297,
"core.last_event_number": 1433,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27328
],
"core.runs_subruns": [
2732800001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027328_0009_dataflow1_datawriter_0_20240620T150436.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027328_0009_dataflow1_datawriter_0_20240620T150436_reco_stage1_reco_stage2_20241017T132820_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1729168509.0,
"core.end_time": 1729171701.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27328
],
"core.runs_subruns": [
2732800001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027328_0009_dataflow1_datawriter_0_20240620T150436.hdf5"
}
]
} 