Jobsub ID 79989.75@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 79989.75@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3518 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 08:41:25 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw7 |
| Last heartbeat | 2024-09-27 16:34:45 |
| From worker node | Hostname | mh-7763-8.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7763 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 13:54:38 |
| Input files | hd-protodune:np04hd_raw_run027406_0120_dataflow2_datawriter_0_20240624T141809.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 2h (8322s) |
| CPU time | 49m (2948s = 35%) |
| Outputting started | 2024-09-27 16:13:22 |
| Output files | |
| Finished | 2024-09-27 16:34:45 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
31835 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 31835 traces tagged "gauss"
FrameSaver: q=1.10566e+06 n=581874 tag=gauss
wclsFrameSaver: saving 40749 traces tagged "wiener"
FrameSaver: q=1.17239e+06 n=526300 tag=wiener
2328 hits in TPC 0
3121 hits in TPC 1
3561 hits in TPC 2
2532 hits in TPC 3
2643 hits in TPC 4
3301 hits in TPC 5
4418 hits in TPC 6
2089 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 4536 XUs and 1691 XVs -> 36 XUVs
C:0 T:2 5282 XUs and 4816 XVs -> 168 XUVs
C:0 T:3 783 XUs and 933 XVs -> 43 XUVs
C:0 T:4 175 XUs and 348 XVs -> 62 XUVs
C:0 T:5 11119 XUs and 6415 XVs -> 178 XUVs
C:0 T:6 8565 XUs and 6114 XVs -> 214 XUVs
C:0 T:7 129 XUs and 172 XVs -> 3 XUVs
704 XUVs total
474 collection wire objects
704 potential space points
Neighbour search...
10026 tests to find 6206 neighbours
Iterating with no regularization...
Begin: 8.41972e+06
0 8.24367e+06
1 8.2325e+06
2 8.23114e+06
Now with regularization...
Begin: 7.81171e+06
0 7.81123e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 09:13:15 PDT Closed output file "np04hd_raw_run027406_0120_dataflow2_datawriter_0_20240624T141809_reco_stage1_reco_stage2_20240927T161315_keepup.root"
27-Sep-2024 09:13:15 PDT Closed input file "np04hd_raw_run027406_0120_dataflow2_datawriter_0_20240624T141809_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 40.3623 65.4994 88.5837 62.884 12.5004 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000341206 0.0012711 0.00277317 0.00120197 0.000625879 35
produce:fembfilter:PDHDFEMBFilter 0.524819 0.559548 0.620657 0.558026 0.0172658 35
produce:wclsdatahd:WireCellToolkit 24.5348 28.2847 31.8329 28.7829 2.15921 35
produce:gaushit:GausHitFinder 0.222888 0.46593 0.667256 0.440664 0.114019 35
produce:nhitsfilter:NumberOfHitsFilter 0.000135738 0.000235275 0.000367237 0.000241267 4.97528e-05 35
produce:reco3d:SpacePointSolver 0.0903241 0.441296 1.0548 0.422835 0.21873 35
produce:hitpdune:DisambigFromSpacePoints 0.0911381 0.338997 0.648603 0.317828 0.154396 35
produce:pandora:StandardPandora 2.53592 8.54831 15.3898 7.90869 3.41058 35
produce:pandoraWriter:StandardPandora 0.046606 0.0917773 0.138705 0.0887328 0.0243121 35
produce:pandoraTrack:LArPandoraTrackCreation 0.330551 0.874308 1.3776 0.862868 0.271326 35
produce:pandoraShower:LArPandoraShowerCreation 0.267711 1.05588 1.94567 1.00843 0.437526 35
produce:pandoracalo:Calorimetry 0.163506 0.479676 0.758078 0.484145 0.148095 35
produce:pandoracalonosce:Calorimetry 0.15154 0.44501 0.690436 0.443903 0.138142 35
produce:pandorapid:Chi2ParticleID 0.000947579 0.00143394 0.00285195 0.0013877 0.000312172 35
produce:pandoraShowercalo:ShowerCalorimetry 0.225506 1.04284 1.81995 1.04394 0.445533 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.220647 0.993782 1.73164 1.00411 0.415663 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0346257 0.0814433 0.113628 0.0818322 0.0203372 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0130758 0.0282807 0.0398028 0.0291927 0.00679673 35
produce:emtrkmichelid:EmTrackMichelId 10.1219 20.6304 31.705 19.9417 5.48602 35
[art]:TriggerResults:TriggerResultInserter 1.365e-05 2.21418e-05 8.0559e-05 2.129e-05 1.08205e-05 35
end_path:out1:RootOutput 3.76e-06 8.19011e-06 2.577e-05 7.84e-06 3.8441e-06 35
end_path:michelremoving:michelremoving 0.00886043 0.0749087 0.349081 0.0227593 0.0833155 35
end_path:michelremovinggnocchi:michelremoving 0.00857076 0.0738499 0.346 0.0218642 0.0831197 35
end_path:calibanagnocchi:CalibAnaTree 0.123634 0.369215 0.632167 0.376235 0.118627 35
end_path:out1:RootOutput(write) 0.26191 0.533432 0.983576 0.496634 0.145994 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5009.07 MB
Peak resident set size usage (VmHWM): 2625.34 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027406_0120_dataflow2_datawriter_0_20240624T141809_reco_stage1_reco_stage2_20240927T161315_keepup.root
\tHists: np04hd_raw_run027406_0120_dataflow2_datawriter_0_20240624T141809_reco_stage1_reco_stage2_20240927T161315_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027406_0120_dataflow2_datawriter_0_20240624T141809_reco_stage1_reco_stage2_20240927T161315_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027406_0120_dataflow2_datawriter_0_20240624T141809_reco_stage1_reco_stage2_20240927T161315_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727451274.0,
"core.end_time": 1727453595.0,
"core.events": [
16802,
16806,
16810,
16814,
16818,
16822,
16826,
16830,
16834,
16838,
16842,
16846,
16850,
16854,
16858,
16862,
16866,
16870,
16874,
16878,
16882,
16886,
16890,
16894,
16898,
16902,
16906,
16910,
16914,
16918,
16922,
16926,
16930,
16934,
16938
],
"core.event_count": 35,
"core.first_event_number": 16802,
"core.last_event_number": 16938,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27406
],
"core.runs_subruns": [
2740600001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027406_0120_dataflow2_datawriter_0_20240624T141809.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027406_0120_dataflow2_datawriter_0_20240624T141809_reco_stage1_reco_stage2_20240927T161315_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727451274.0,
"core.end_time": 1727453595.0,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27406
],
"core.runs_subruns": [
2740600001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027406_0120_dataflow2_datawriter_0_20240624T141809.hdf5"
}
]
} 