Jobsub ID 262688.19@justin-prod-sched01.dune.hep.ac.uk
Jobsub ID | 262688.19@justin-prod-sched01.dune.hep.ac.uk |
Workflow ID | 3449 |
Stage ID | 1 |
User name | calcuttj@fnal.gov |
HTCondor Group | group_dune.prod_mcsim |
Requested | Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 18000 (5 hours) |
Submitted time | 2024-09-26 02:58:41 |
Site | CERN |
Entry | CMSHTPC_T2_CH_CERN_ce512 |
Last heartbeat | 2024-09-26 05:59:27 |
From worker node | Hostname | b9p04p0179.cern.ch |
cpuinfo | AMD EPYC 7543 32-Core Processor |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 171000 (47 hours) |
Inner Apptainer? | True |
Job state | aborted |
Allocator name | justin-allocator-pro.dune.hep.ac.uk |
Started | 2024-09-26 04:19:01 |
Input files | hd-protodune:np04hd_raw_run029107_0410_dataflow5_datawriter_0_20240906T224246.hdf5
|
Outputting started | 2024-09-26 05:21:26 |
Output files | |
Finished | 2024-09-26 05:59:27 |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
ver: saving 25898 traces tagged "gauss"
FrameSaver: q=549965 n=460027 tag=gauss
wclsFrameSaver: saving 35820 traces tagged "wiener"
FrameSaver: q=583732 n=407054 tag=wiener
1829 hits in TPC 0
1805 hits in TPC 1
1715 hits in TPC 2
1095 hits in TPC 3
2710 hits in TPC 4
4658 hits in TPC 5
2568 hits in TPC 6
780 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 219 XUs and 60 XVs -> 4 XUVs
C:0 T:2 4472 XUs and 2254 XVs -> 167 XUVs
C:0 T:3 46 XUs and 56 XVs -> 3 XUVs
C:0 T:4 71 XUs and 104 XVs -> 1 XUVs
C:0 T:5 11957 XUs and 7188 XVs -> 731 XUVs
C:0 T:6 2927 XUs and 10341 XVs -> 383 XUVs
C:0 T:7 40 XUs and 48 XVs -> 0 XUVs
1289 XUVs total
629 collection wire objects
1289 potential space points
Neighbour search...
19647 tests to find 11722 neighbours
Iterating with no regularization...
Begin: 2.83236e+06
0 2.58174e+06
1 2.56764e+06
2 2.56652e+06
Now with regularization...
Begin: 2.30358e+06
0 2.30336e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 07:20:01 CEST Closed output file "np04hd_raw_run029107_0410_dataflow5_datawriter_0_20240906T224246_reco_stage1_reco_stage2_20240926T052001_keepup.root"
26-Sep-2024 07:20:01 CEST Closed input file "np04hd_raw_run029107_0410_dataflow5_datawriter_0_20240906T224246_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 58.9366 87.9793 130.098 85.9895 15.9492 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000494793 0.00209028 0.00378754 0.00206411 0.000870689 30
produce:fembfilter:PDHDFEMBFilter 0.554117 0.673324 0.784675 0.681995 0.0677493 30
produce:wclsdatahd:WireCellToolkit 35.2704 37.6111 39.8065 37.4593 0.985374 30
produce:gaushit:GausHitFinder 0.411092 0.728607 1.20864 0.725609 0.1813 30
produce:nhitsfilter:NumberOfHitsFilter 0.000245641 0.000377511 0.000636933 0.000344022 9.882e-05 30
produce:reco3d:SpacePointSolver 0.144974 1.04744 2.44131 0.858521 0.732802 30
produce:hitpdune:DisambigFromSpacePoints 0.18743 0.589377 1.37461 0.546189 0.265776 30
produce:pandora:StandardPandora 4.32726 12.5738 30.7318 11.0998 5.82471 30
produce:pandoraWriter:StandardPandora 0.0862168 0.15752 0.264809 0.148681 0.0428183 30
produce:pandoraTrack:LArPandoraTrackCreation 0.383028 1.11694 2.15362 1.01368 0.43673 30
produce:pandoraShower:LArPandoraShowerCreation 0.301196 1.17066 2.51477 1.0532 0.532345 30
produce:pandoracalo:Calorimetry 0.235388 0.5749 0.974287 0.542849 0.186538 30
produce:pandoracalonosce:Calorimetry 0.198467 0.525583 0.956007 0.510742 0.179711 30
produce:pandorapid:Chi2ParticleID 0.00132122 0.00203264 0.00466464 0.00204251 0.000593302 30
produce:pandoraShowercalo:ShowerCalorimetry 0.2558 1.09435 2.60154 1.01177 0.520298 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.251528 1.07439 2.76801 1.00866 0.531094 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0644678 0.144541 0.227878 0.145423 0.03954 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.01867 0.0479396 0.0729479 0.0475543 0.0132248 30
produce:emtrkmichelid:EmTrackMichelId 13.4685 27.3967 45.1689 27.0639 6.77241 30
[art]:TriggerResults:TriggerResultInserter 2.0281e-05 4.14149e-05 0.000156071 3.35755e-05 2.77302e-05 30
end_path:out1:RootOutput 7.33e-06 1.03574e-05 3.3811e-05 9.435e-06 4.56361e-06 30
end_path:michelremoving:michelremoving 0.0136007 0.052649 0.235556 0.0274739 0.0612918 30
end_path:michelremovinggnocchi:michelremoving 0.0132293 0.0508137 0.231622 0.0257236 0.0601888 30
end_path:calibanagnocchi:CalibAnaTree 0.134514 0.41537 0.839324 0.401582 0.166471 30
end_path:out1:RootOutput(write) 0.416028 0.799739 1.2611 0.780044 0.202622 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4942.83 MB
Peak resident set size usage (VmHWM): 2605.66 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_0410_dataflow5_datawriter_0_20240906T224246_reco_stage1_reco_stage2_20240926T052001_keepup.root
\tHists: np04hd_raw_run029107_0410_dataflow5_datawriter_0_20240906T224246_reco_stage1_reco_stage2_20240926T052001_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_0410_dataflow5_datawriter_0_20240906T224246_reco_stage1_reco_stage2_20240926T052001_keepup.root
Ran successfully
{
"name": "np04hd_raw_run029107_0410_dataflow5_datawriter_0_20240906T224246_reco_stage1_reco_stage2_20240926T052001_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727325313.0,
"core.end_time": 1727328002.0,
"core.events": [
98429,
98437,
98445,
98453,
98461,
98469,
98477,
98485,
98493,
98501,
98509,
98517,
98525,
98533,
98541,
98549,
98557,
98565,
98573,
98581,
98589,
98597,
98605,
98613,
98621,
98629,
98637,
98645,
98653,
98661
],
"core.event_count": 30,
"core.first_event_number": 98429,
"core.last_event_number": 98661,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29107
],
"core.runs_subruns": [
2910700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029107_0410_dataflow5_datawriter_0_20240906T224246.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run029107_0410_dataflow5_datawriter_0_20240906T224246_reco_stage1_reco_stage2_20240926T052001_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727325313.0,
"core.end_time": 1727328002.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29107
],
"core.runs_subruns": [
2910700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029107_0410_dataflow5_datawriter_0_20240906T224246.hdf5"
}
]
}