Jobsub ID 262682.41@justin-prod-sched01.dune.hep.ac.uk
Jobsub ID | 262682.41@justin-prod-sched01.dune.hep.ac.uk |
Workflow ID | 3450 |
Stage ID | 1 |
User name | calcuttj@fnal.gov |
HTCondor Group | group_dune.prod_mcsim |
Requested | Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 18000 (5 hours) |
Submitted time | 2024-09-26 02:52:24 |
Site | CERN |
Entry | CMSHTPC_T2_CH_CERN_ce512 |
Last heartbeat | 2024-09-26 05:58:38 |
From worker node | Hostname | b9p21p6972.cern.ch |
cpuinfo | AMD EPYC 7302 16-Core Processor |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 171000 (47 hours) |
Inner Apptainer? | True |
Job state | aborted |
Allocator name | justin-allocator-pro.dune.hep.ac.uk |
Started | 2024-09-26 04:09:13 |
Input files | hd-protodune:np04hd_raw_run029107_1465_dataflow7_datawriter_0_20240907T160928.hdf5
|
Outputting started | 2024-09-26 05:06:53 |
Output files | |
Finished | 2024-09-26 05:58:38 |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
aver: saving 42094 traces tagged "gauss"
FrameSaver: q=968814 n=831318 tag=gauss
wclsFrameSaver: saving 54734 traces tagged "wiener"
FrameSaver: q=1.02617e+06 n=758967 tag=wiener
1418 hits in TPC 0
2004 hits in TPC 1
4677 hits in TPC 2
3493 hits in TPC 3
5186 hits in TPC 4
7159 hits in TPC 5
3241 hits in TPC 6
2590 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 0 XUs and 0 XVs -> 0 XUVs
C:0 T:1 30 XUs and 28 XVs -> 1 XUVs
C:0 T:2 14055 XUs and 13675 XVs -> 706 XUVs
C:0 T:3 77 XUs and 83 XVs -> 4 XUVs
C:0 T:4 421 XUs and 466 XVs -> 7 XUVs
C:0 T:5 30247 XUs and 31922 XVs -> 2780 XUVs
C:0 T:6 4340 XUs and 5435 XVs -> 212 XUVs
C:0 T:7 411 XUs and 858 XVs -> 36 XUVs
3746 XUVs total
1183 collection wire objects
3746 potential space points
Neighbour search...
318030 tests to find 162388 neighbours
Iterating with no regularization...
Begin: 1.19547e+07
0 1.0627e+07
1 1.05483e+07
2 1.05383e+07
Now with regularization...
Begin: 9.7318e+06
0 9.72635e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 07:06:39 CEST Closed output file "np04hd_raw_run029107_1465_dataflow7_datawriter_0_20240907T160928_reco_stage1_reco_stage2_20240926T050639_keepup.root"
26-Sep-2024 07:06:39 CEST Closed input file "np04hd_raw_run029107_1465_dataflow7_datawriter_0_20240907T160928_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 58.4151 86.4708 112.808 89.5546 12.881 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000622717 0.00302871 0.0057621 0.00296611 0.00126241 30
produce:fembfilter:PDHDFEMBFilter 0.533557 0.677083 0.790695 0.717399 0.0871963 30
produce:wclsdatahd:WireCellToolkit 30.0633 35.5617 39.5379 35.6239 2.03988 30
produce:gaushit:GausHitFinder 0.412882 0.768889 1.04889 0.808005 0.180904 30
produce:nhitsfilter:NumberOfHitsFilter 0.000214092 0.000408093 0.000531296 0.000424995 7.67427e-05 30
produce:reco3d:SpacePointSolver 0.215428 1.10354 4.39657 0.766604 1.0335 30
produce:hitpdune:DisambigFromSpacePoints 0.116057 0.539407 1.02098 0.514102 0.218722 30
produce:pandora:StandardPandora 4.64903 12.5292 25.1177 12.7084 4.35937 30
produce:pandoraWriter:StandardPandora 0.0796545 0.181616 0.263911 0.171091 0.0473004 30
produce:pandoraTrack:LArPandoraTrackCreation 0.280367 1.11286 1.77699 0.99956 0.416106 30
produce:pandoraShower:LArPandoraShowerCreation 0.343754 1.22424 2.2862 1.09826 0.472369 30
produce:pandoracalo:Calorimetry 0.241843 0.59321 0.959482 0.626195 0.185311 30
produce:pandoracalonosce:Calorimetry 0.140465 0.517127 0.847462 0.515906 0.166535 30
produce:pandorapid:Chi2ParticleID 0.0010067 0.0020544 0.00279074 0.002091 0.000453005 30
produce:pandoraShowercalo:ShowerCalorimetry 0.225836 1.11424 1.98866 1.07563 0.429563 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.267591 1.06202 1.84512 1.07661 0.404114 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.101175 0.158519 0.245308 0.151709 0.0407098 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0331938 0.0515072 0.0759239 0.0463646 0.0133478 30
produce:emtrkmichelid:EmTrackMichelId 14.7407 27.6954 37.1571 28.3928 5.33814 30
[art]:TriggerResults:TriggerResultInserter 2.135e-05 4.60322e-05 0.000104091 4.21005e-05 2.09756e-05 30
end_path:out1:RootOutput 1.015e-05 1.48938e-05 3.4061e-05 1.257e-05 6.05745e-06 30
end_path:michelremoving:michelremoving 0.0196316 0.0705466 0.251084 0.0353898 0.0644859 30
end_path:michelremovinggnocchi:michelremoving 0.0187805 0.069866 0.27218 0.0308099 0.0681578 30
end_path:calibanagnocchi:CalibAnaTree 0.1307 0.430047 0.785404 0.458734 0.150573 30
end_path:out1:RootOutput(write) 0.49165 0.869841 1.16039 0.875049 0.199185 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4965.7 MB
Peak resident set size usage (VmHWM): 2605.01 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029107_1465_dataflow7_datawriter_0_20240907T160928_reco_stage1_reco_stage2_20240926T050639_keepup.root
\tHists: np04hd_raw_run029107_1465_dataflow7_datawriter_0_20240907T160928_reco_stage1_reco_stage2_20240926T050639_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029107_1465_dataflow7_datawriter_0_20240907T160928_reco_stage1_reco_stage2_20240926T050639_keepup.root
Ran successfully
{
"name": "np04hd_raw_run029107_1465_dataflow7_datawriter_0_20240907T160928_reco_stage1_reco_stage2_20240926T050639_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727324566.0,
"core.end_time": 1727327200.0,
"core.events": [
351623,
351631,
351639,
351647,
351655,
351663,
351671,
351679,
351687,
351695,
351703,
351711,
351719,
351727,
351735,
351743,
351751,
351759,
351767,
351775,
351783,
351791,
351799,
351807,
351823,
351831,
351839,
351847,
351855,
351863
],
"core.event_count": 30,
"core.first_event_number": 351623,
"core.last_event_number": 351863,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29107
],
"core.runs_subruns": [
2910700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029107_1465_dataflow7_datawriter_0_20240907T160928.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run029107_1465_dataflow7_datawriter_0_20240907T160928_reco_stage1_reco_stage2_20240926T050639_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727324566.0,
"core.end_time": 1727327200.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29107
],
"core.runs_subruns": [
2910700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029107_1465_dataflow7_datawriter_0_20240907T160928.hdf5"
}
]
}