Jobsub ID 262522.119@justin-prod-sched01.dune.hep.ac.uk
Jobsub ID | 262522.119@justin-prod-sched01.dune.hep.ac.uk |
Workflow ID | 3459 |
Stage ID | 1 |
User name | calcuttj@fnal.gov |
HTCondor Group | group_dune.prod_mcsim |
Requested | Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 18000 (5 hours) |
Submitted time | 2024-09-25 21:45:22 |
Site | CERN |
Entry | CMSHTPC_T2_CH_CERN_ce512 |
Last heartbeat | 2024-09-26 01:38:36 |
From worker node | Hostname | b9p10p8449.cern.ch |
cpuinfo | AMD EPYC 7543 32-Core Processor |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 171000 (47 hours) |
Inner Apptainer? | True |
Job state | aborted |
Allocator name | justin-allocator-pro.dune.hep.ac.uk |
Started | 2024-09-26 00:03:34 |
Input files | hd-protodune:np04hd_raw_run029125_0415_dataflow6_datawriter_0_20240911T002407.hdf5
|
Outputting started | 2024-09-26 01:16:09 |
Output files | |
Finished | 2024-09-26 01:38:36 |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
etagger: tagging trace set: gauss with 47198 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 47198 traces tagged "gauss"
FrameSaver: q=1.28073e+06 n=965556 tag=gauss
wclsFrameSaver: saving 59869 traces tagged "wiener"
FrameSaver: q=1.36061e+06 n=892677 tag=wiener
2465 hits in TPC 0
3246 hits in TPC 1
6875 hits in TPC 2
5652 hits in TPC 3
3729 hits in TPC 4
5808 hits in TPC 5
6796 hits in TPC 6
2832 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 504 XUs and 478 XVs -> 26 XUVs
C:0 T:2 14779 XUs and 14294 XVs -> 1759 XUVs
C:0 T:3 919 XUs and 701 XVs -> 56 XUVs
C:0 T:4 475 XUs and 511 XVs -> 45 XUVs
C:0 T:5 38326 XUs and 26593 XVs -> 1698 XUVs
C:0 T:6 21925 XUs and 19881 XVs -> 927 XUVs
C:0 T:7 112 XUs and 127 XVs -> 11 XUVs
4522 XUVs total
1655 collection wire objects
4522 potential space points
Neighbour search...
238942 tests to find 129008 neighbours
Iterating with no regularization...
Begin: 1.3209e+07
0 1.15877e+07
1 1.14617e+07
2 1.14494e+07
3 1.14466e+07
Now with regularization...
Begin: 1.0744e+07
0 1.07374e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 03:15:56 CEST Closed output file "np04hd_raw_run029125_0415_dataflow6_datawriter_0_20240911T002407_reco_stage1_reco_stage2_20240926T011556_keepup.root"
26-Sep-2024 03:15:56 CEST Closed input file "np04hd_raw_run029125_0415_dataflow6_datawriter_0_20240911T002407_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 65.9211 108.324 175.787 108.18 19.7534 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.00101049 0.00264635 0.0050444 0.00247138 0.00107027 30
produce:fembfilter:PDHDFEMBFilter 0.609408 0.768257 0.923581 0.775764 0.0681727 30
produce:wclsdatahd:WireCellToolkit 39.1834 43.619 46.7428 43.8811 1.69984 30
produce:gaushit:GausHitFinder 0.373174 0.84184 1.32441 0.869227 0.188169 30
produce:nhitsfilter:NumberOfHitsFilter 0.000226691 0.000378331 0.000601082 0.000380672 8.28099e-05 30
produce:reco3d:SpacePointSolver 0.0515482 1.12965 3.27795 0.970335 0.765709 30
produce:hitpdune:DisambigFromSpacePoints 0.0823127 0.67719 1.33956 0.67569 0.236137 30
produce:pandora:StandardPandora 3.3416 16.8983 63.0938 15.8841 9.85421 30
produce:pandoraWriter:StandardPandora 0.0785907 0.174338 0.24224 0.172685 0.0387662 30
produce:pandoraTrack:LArPandoraTrackCreation 0.259069 1.20449 2.08048 1.19266 0.397387 30
produce:pandoraShower:LArPandoraShowerCreation 0.227499 1.39439 2.80754 1.33397 0.557002 30
produce:pandoracalo:Calorimetry 0.169989 0.676184 1.03125 0.705704 0.204037 30
produce:pandoracalonosce:Calorimetry 0.150635 0.591189 0.889388 0.593659 0.185008 30
produce:pandorapid:Chi2ParticleID 0.0011025 0.00221769 0.00475784 0.00218516 0.000661997 30
produce:pandoraShowercalo:ShowerCalorimetry 0.219413 1.27894 2.58086 1.2177 0.507273 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.204789 1.23183 2.34771 1.22869 0.461732 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.061454 0.161941 0.255842 0.15322 0.0418072 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0231025 0.0544344 0.0778372 0.0522042 0.0130271 30
produce:emtrkmichelid:EmTrackMichelId 16.0696 35.91 50.8234 36.3416 7.34888 30
[art]:TriggerResults:TriggerResultInserter 2.5381e-05 4.31092e-05 9.5631e-05 3.828e-05 1.46826e-05 30
end_path:out1:RootOutput 9.01e-06 1.1625e-05 3.187e-05 1.027e-05 4.21963e-06 30
end_path:michelremoving:michelremoving 0.0257487 0.0922279 0.401982 0.0371891 0.0900708 30
end_path:michelremovinggnocchi:michelremoving 0.0134925 0.0865811 0.408404 0.0305237 0.0926768 30
end_path:calibanagnocchi:CalibAnaTree 0.131487 0.499915 0.997905 0.487667 0.17286 30
end_path:out1:RootOutput(write) 0.362762 0.885033 1.24229 0.890643 0.189948 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4928.06 MB
Peak resident set size usage (VmHWM): 2589.8 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029125_0415_dataflow6_datawriter_0_20240911T002407_reco_stage1_reco_stage2_20240926T011556_keepup.root
\tHists: np04hd_raw_run029125_0415_dataflow6_datawriter_0_20240911T002407_reco_stage1_reco_stage2_20240926T011556_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029125_0415_dataflow6_datawriter_0_20240911T002407_reco_stage1_reco_stage2_20240926T011556_keepup.root
Ran successfully
{
"name": "np04hd_raw_run029125_0415_dataflow6_datawriter_0_20240911T002407_reco_stage1_reco_stage2_20240926T011556_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727310060.0,
"core.end_time": 1727313357.0,
"core.events": [
99630,
99638,
99646,
99662,
99670,
99678,
99686,
99694,
99702,
99710,
99718,
99726,
99734,
99742,
99750,
99758,
99766,
99774,
99782,
99790,
99798,
99806,
99814,
99822,
99830,
99838,
99846,
99854,
99862,
99870
],
"core.event_count": 30,
"core.first_event_number": 99630,
"core.last_event_number": 99870,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29125
],
"core.runs_subruns": [
2912500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029125_0415_dataflow6_datawriter_0_20240911T002407.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run029125_0415_dataflow6_datawriter_0_20240911T002407_reco_stage1_reco_stage2_20240926T011556_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727310060.0,
"core.end_time": 1727313357.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29125
],
"core.runs_subruns": [
2912500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029125_0415_dataflow6_datawriter_0_20240911T002407.hdf5"
}
]
}