Jobsub ID 79713.41@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 79713.41@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3513 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 01:23:03 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw6 |
| Last heartbeat | 2024-09-27 16:55:04 |
| From worker node | Hostname | mh-7763-1.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 06:12:49 |
| Input files | hd-protodune:np04hd_raw_run027357_0058_dataflow0_datawriter_0_20240621T224121.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 10h (36586s) |
| CPU time | 52m (3132s = 8%) |
| Outputting started | 2024-09-27 16:22:36 |
| Output files | |
| Finished | 2024-09-27 16:55:04 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
s, 61083 summary
Retagger: tagging trace set: gauss with 44896 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 44896 traces tagged "gauss"
FrameSaver: q=1.47975e+06 n=782804 tag=gauss
wclsFrameSaver: saving 61083 traces tagged "wiener"
FrameSaver: q=1.61507e+06 n=697551 tag=wiener
5245 hits in TPC 0
3722 hits in TPC 1
5791 hits in TPC 2
4580 hits in TPC 3
1896 hits in TPC 4
3989 hits in TPC 5
5282 hits in TPC 6
2128 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 59 XUs and 22 XVs -> 0 XUVs
C:0 T:1 5291 XUs and 4360 XVs -> 616 XUVs
C:0 T:2 50631 XUs and 52930 XVs -> 2544 XUVs
C:0 T:3 781 XUs and 663 XVs -> 8 XUVs
C:0 T:4 113 XUs and 82 XVs -> 4 XUVs
C:0 T:5 6197 XUs and 6398 XVs -> 151 XUVs
C:0 T:6 39056 XUs and 47792 XVs -> 1188 XUVs
C:0 T:7 215 XUs and 110 XVs -> 7 XUVs
4518 XUVs total
1372 collection wire objects
4518 potential space points
Neighbour search...
213178 tests to find 115252 neighbours
Iterating with no regularization...
Begin: 2.07601e+07
0 1.81137e+07
1 1.78573e+07
2 1.78215e+07
3 1.78112e+07
Now with regularization...
Begin: 1.7029e+07
0 1.70234e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 09:22:28 PDT Closed output file "np04hd_raw_run027357_0058_dataflow0_datawriter_0_20240621T224121_reco_stage1_reco_stage2_20240927T162228_keepup.root"
27-Sep-2024 09:22:28 PDT Closed input file "np04hd_raw_run027357_0058_dataflow0_datawriter_0_20240621T224121_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 48.6757 70.5231 97.7778 69.0238 11.5045 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000347458 0.00163678 0.00429857 0.00162651 0.00087714 35
produce:fembfilter:PDHDFEMBFilter 0.500008 0.52215 0.54906 0.522023 0.0111183 35
produce:wclsdatahd:WireCellToolkit 25.7749 27.2101 29.1524 27.1212 0.692861 35
produce:gaushit:GausHitFinder 0.303471 0.533104 0.805417 0.528818 0.10299 35
produce:nhitsfilter:NumberOfHitsFilter 0.000201039 0.000280281 0.000450786 0.000270698 4.77978e-05 35
produce:reco3d:SpacePointSolver 0.184648 0.813783 2.02989 0.752406 0.484185 35
produce:hitpdune:DisambigFromSpacePoints 0.143912 0.417072 0.884676 0.381358 0.15548 35
produce:pandora:StandardPandora 4.98613 11.9013 22.864 10.9614 4.86505 35
produce:pandoraWriter:StandardPandora 0.0649508 0.1172 0.165024 0.115549 0.0223279 35
produce:pandoraTrack:LArPandoraTrackCreation 0.432734 1.11553 2.09352 1.11513 0.354493 35
produce:pandoraShower:LArPandoraShowerCreation 0.379958 1.30117 2.58893 1.25388 0.516904 35
produce:pandoracalo:Calorimetry 0.247858 0.596796 1.0972 0.569546 0.187109 35
produce:pandoracalonosce:Calorimetry 0.222448 0.548935 1.03254 0.533969 0.169384 35
produce:pandorapid:Chi2ParticleID 0.00125324 0.00162956 0.00359558 0.00153416 0.000418384 35
produce:pandoraShowercalo:ShowerCalorimetry 0.354206 1.22757 2.63053 1.21202 0.488829 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.331373 1.17263 2.53402 1.14243 0.468923 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.051845 0.0933398 0.130291 0.0945304 0.0201564 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0179427 0.0317708 0.0455663 0.032358 0.00637211 35
produce:emtrkmichelid:EmTrackMichelId 12.4617 21.6394 29.7616 20.9764 3.94889 35
[art]:TriggerResults:TriggerResultInserter 1.5169e-05 2.54387e-05 7.513e-05 2.1959e-05 1.17077e-05 35
end_path:out1:RootOutput 6.61e-06 8.93249e-06 2.385e-05 7.84e-06 3.248e-06 35
end_path:michelremoving:michelremoving 0.0111377 0.050497 0.214145 0.0210472 0.0521124 35
end_path:michelremovinggnocchi:michelremoving 0.0108895 0.0494766 0.211409 0.0204884 0.0517204 35
end_path:calibanagnocchi:CalibAnaTree 0.187055 0.451175 0.923613 0.421687 0.167509 35
end_path:out1:RootOutput(write) 0.348281 0.610378 0.856986 0.593752 0.127478 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5049.74 MB
Peak resident set size usage (VmHWM): 2697.58 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027357_0058_dataflow0_datawriter_0_20240621T224121_reco_stage1_reco_stage2_20240927T162228_keepup.root
\tHists: np04hd_raw_run027357_0058_dataflow0_datawriter_0_20240621T224121_reco_stage1_reco_stage2_20240927T162228_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027357_0058_dataflow0_datawriter_0_20240621T224121_reco_stage1_reco_stage2_20240927T162228_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027357_0058_dataflow0_datawriter_0_20240621T224121_reco_stage1_reco_stage2_20240927T162228_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727451651.0,
"core.end_time": 1727454149.0,
"core.events": [
8128,
8132,
8136,
8140,
8144,
8148,
8152,
8156,
8160,
8164,
8168,
8172,
8176,
8180,
8184,
8188,
8192,
8196,
8200,
8204,
8208,
8212,
8216,
8220,
8224,
8228,
8232,
8236,
8240,
8244,
8248,
8252,
8256,
8260,
8264
],
"core.event_count": 35,
"core.first_event_number": 8128,
"core.last_event_number": 8264,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27357
],
"core.runs_subruns": [
2735700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027357_0058_dataflow0_datawriter_0_20240621T224121.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027357_0058_dataflow0_datawriter_0_20240621T224121_reco_stage1_reco_stage2_20240927T162228_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727451651.0,
"core.end_time": 1727454149.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27357
],
"core.runs_subruns": [
2735700001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027357_0058_dataflow0_datawriter_0_20240621T224121.hdf5"
}
]
} 