Jobsub ID 273192.69@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 273192.69@justin-prod-sched01.dune.hep.ac.uk |
| Workflow ID | 3671 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-10-11 02:41:37 |
| Site | UK_Brunel |
| Entry | CMSHTPC_T2_UK_London_Brunel_dc2_22 |
| Last heartbeat | 2024-10-11 06:07:38 |
| From worker node | Hostname | wn-b1-15-00.brunel.ac.uk |
| cpuinfo | Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | aborted |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-10-11 04:25:23 |
| Input files | hd-protodune:np04hd_raw_run027971_0301_dataflow1_datawriter_0_20240710T203819.hdf5
|
| Outputting started | 2024-10-11 06:06:22 |
| Output files | |
| Finished | 2024-10-11 06:07:38 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
ace set: gauss with 68663 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 68663 traces tagged "gauss"
FrameSaver: q=2.57842e+06 n=1219247 tag=gauss
wclsFrameSaver: saving 92706 traces tagged "wiener"
FrameSaver: q=2.78856e+06 n=1096841 tag=wiener
6442 hits in TPC 0
4873 hits in TPC 1
6725 hits in TPC 2
3748 hits in TPC 3
5268 hits in TPC 4
8103 hits in TPC 5
9009 hits in TPC 6
6381 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 14684 XUs and 8336 XVs -> 284 XUVs
C:0 T:2 30377 XUs and 46809 XVs -> 1204 XUVs
C:0 T:3 413 XUs and 435 XVs -> 16 XUVs
C:0 T:4 225 XUs and 447 XVs -> 11 XUVs
C:0 T:5 32290 XUs and 31861 XVs -> 866 XUVs
C:0 T:6 38827 XUs and 46475 XVs -> 1839 XUVs
C:0 T:7 1655 XUs and 2156 XVs -> 31 XUVs
4251 XUVs total
2222 collection wire objects
4251 potential space points
Neighbour search...
75415 tests to find 42714 neighbours
Iterating with no regularization...
Begin: 3.37728e+07
0 3.10536e+07
1 3.08839e+07
2 3.08694e+07
Now with regularization...
Begin: 2.85845e+07
0 2.85789e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
11-Oct-2024 07:06:13 BST Closed output file "np04hd_raw_run027971_0301_dataflow1_datawriter_0_20240710T203819_reco_stage1_reco_stage2_20241011T060613_keepup.root"
11-Oct-2024 07:06:13 BST Closed input file "np04hd_raw_run027971_0301_dataflow1_datawriter_0_20240710T203819_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 62.9496 112.217 170.533 110.939 23.0925 32
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000410914 0.00171302 0.00441664 0.00113389 0.00107949 32
produce:fembfilter:PDHDFEMBFilter 1.17574 1.29932 1.47752 1.28842 0.0625871 32
produce:wclsdatahd:WireCellToolkit 37.3719 40.6154 43.8018 40.7039 1.61152 32
produce:gaushit:GausHitFinder 0.440161 0.860657 1.22568 0.853084 0.179327 32
produce:nhitsfilter:NumberOfHitsFilter 0.000169557 0.0003606 0.00056693 0.000349431 9.11706e-05 32
produce:reco3d:SpacePointSolver 0.208904 1.19982 2.9318 0.943884 0.737989 32
produce:hitpdune:DisambigFromSpacePoints 0.18853 0.771573 1.71493 0.706677 0.369759 32
produce:pandora:StandardPandora 6.09237 27.9044 71.2206 28.6487 12.6461 32
produce:pandoraWriter:StandardPandora 0.0654196 0.172554 0.333878 0.152064 0.0584843 32
produce:pandoraTrack:LArPandoraTrackCreation 0.538298 1.96442 4.5237 1.79426 0.878898 32
produce:pandoraShower:LArPandoraShowerCreation 0.483033 2.03964 5.58211 1.818 1.07547 32
produce:pandoracalo:Calorimetry 0.285096 0.961861 2.1388 0.836208 0.420909 32
produce:pandoracalonosce:Calorimetry 0.256258 0.909796 1.93825 0.809147 0.394832 32
produce:pandorapid:Chi2ParticleID 0.000997775 0.00204642 0.0032717 0.00200923 0.000468432 32
produce:pandoraShowercalo:ShowerCalorimetry 0.429726 1.92642 5.04895 1.63985 1.04918 32
produce:pandoraShowercalonosce:ShowerCalorimetry 0.422507 1.8345 4.81586 1.57345 0.977694 32
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0668271 0.130161 0.215301 0.119719 0.0316266 32
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0226848 0.0446334 0.0702487 0.0408506 0.0103576 32
produce:emtrkmichelid:EmTrackMichelId 13.8588 27.6976 40.3904 27.3755 5.55059 32
[art]:TriggerResults:TriggerResultInserter 1.7881e-05 2.41457e-05 6.6683e-05 2.20815e-05 8.86223e-06 32
end_path:out1:RootOutput 6.044e-06 8.41175e-06 2.4222e-05 8.0325e-06 2.9158e-06 32
end_path:michelremoving:michelremoving 0.0217023 0.0966643 0.418151 0.0374132 0.0970209 32
end_path:michelremovinggnocchi:michelremoving 0.0196248 0.0937803 0.41022 0.0341425 0.0962986 32
end_path:calibanagnocchi:CalibAnaTree 0.267344 0.75565 1.6418 0.711789 0.330927 32
end_path:out1:RootOutput(write) 0.468041 0.848753 1.28707 0.823352 0.188608 32
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5008.97 MB
Peak resident set size usage (VmHWM): 2652.66 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027971_0301_dataflow1_datawriter_0_20240710T203819_reco_stage1_reco_stage2_20241011T060613_keepup.root
\tHists: np04hd_raw_run027971_0301_dataflow1_datawriter_0_20240710T203819_reco_stage1_reco_stage2_20241011T060613_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027971_0301_dataflow1_datawriter_0_20240710T203819_reco_stage1_reco_stage2_20241011T060613_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027971_0301_dataflow1_datawriter_0_20240710T203819_reco_stage1_reco_stage2_20241011T060613_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1728623138.0,
"core.end_time": 1728626774.0,
"core.events": [
77081,
77089,
77097,
77105,
77113,
77121,
77129,
77137,
77145,
77153,
77161,
77169,
77177,
77185,
77193,
77201,
77209,
77217,
77225,
77233,
77241,
77249,
77257,
77265,
77273,
77281,
77289,
77297,
77305,
77313,
77321,
77329
],
"core.event_count": 32,
"core.first_event_number": 77081,
"core.last_event_number": 77329,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27971
],
"core.runs_subruns": [
2797100001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027971_0301_dataflow1_datawriter_0_20240710T203819.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027971_0301_dataflow1_datawriter_0_20240710T203819_reco_stage1_reco_stage2_20241011T060613_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1728623138.0,
"core.end_time": 1728626774.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27971
],
"core.runs_subruns": [
2797100001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027971_0301_dataflow1_datawriter_0_20240710T203819.hdf5"
}
]
} 