Jobsub ID 80022.17@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 80022.17@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3513 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 09:07:03 |
| Site | US_UCSD |
| Entry | CMSHTPC_T2_US_UCSD_gw6 |
| Last heartbeat | 2024-09-27 16:43:46 |
| From worker node | Hostname | mh-7662-6.t2.ucsd.edu |
| cpuinfo | AMD EPYC 7662 64-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 171000 (47 hours) |
| Inner Apptainer? | True |
| Job state | outputting_failed |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 14:39:09 |
| Input files | hd-protodune:np04hd_raw_run027365_0061_dataflow1_datawriter_0_20240622T024346.hdf5
|
| Jobscript | Exit code | 0 |
| Real time | 1h (5951s) |
| CPU time | 1h (4391s = 73%) |
| Outputting started | 2024-09-27 16:18:21 |
| Output files | |
| Finished | 2024-09-27 16:43:46 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
56 summary
Retagger: tagging trace set: gauss with 54400 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 54400 traces tagged "gauss"
FrameSaver: q=1.95834e+06 n=953063 tag=gauss
wclsFrameSaver: saving 73556 traces tagged "wiener"
FrameSaver: q=2.13129e+06 n=857845 tag=wiener
4962 hits in TPC 0
4486 hits in TPC 1
8946 hits in TPC 2
4891 hits in TPC 3
4754 hits in TPC 4
5223 hits in TPC 5
5004 hits in TPC 6
2800 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 77 XUs and 118 XVs -> 12 XUVs
C:0 T:1 8451 XUs and 7077 XVs -> 128 XUVs
C:0 T:2 49381 XUs and 43872 XVs -> 2026 XUVs
C:0 T:3 80 XUs and 83 XVs -> 3 XUVs
C:0 T:4 919 XUs and 1083 XVs -> 74 XUVs
C:0 T:5 18469 XUs and 28938 XVs -> 1154 XUVs
C:0 T:6 47977 XUs and 24694 XVs -> 1216 XUVs
C:0 T:7 144 XUs and 141 XVs -> 8 XUVs
4621 XUVs total
1850 collection wire objects
4621 potential space points
Neighbour search...
206533 tests to find 109972 neighbours
Iterating with no regularization...
Begin: 4.09216e+07
0 3.61168e+07
1 3.57014e+07
2 3.56626e+07
3 3.5652e+07
Now with regularization...
Begin: 3.39692e+07
0 3.39636e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 09:18:12 PDT Closed output file "np04hd_raw_run027365_0061_dataflow1_datawriter_0_20240622T024346_reco_stage1_reco_stage2_20240927T161812_keepup.root"
27-Sep-2024 09:18:12 PDT Closed input file "np04hd_raw_run027365_0061_dataflow1_datawriter_0_20240622T024346_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 70.4632 103.232 160.552 101.174 21.0822 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000522094 0.00239555 0.00470642 0.00246105 0.00122072 35
produce:fembfilter:PDHDFEMBFilter 0.680154 0.728472 0.799185 0.727138 0.0269946 35
produce:wclsdatahd:WireCellToolkit 34.4504 38.343 45.5544 37.2667 2.9616 35
produce:gaushit:GausHitFinder 0.472038 0.787246 1.14107 0.771211 0.167293 35
produce:nhitsfilter:NumberOfHitsFilter 0.000289219 0.000408754 0.000626028 0.000397981 8.72421e-05 35
produce:reco3d:SpacePointSolver 0.164955 1.29615 5.70726 0.97234 1.0308 35
produce:hitpdune:DisambigFromSpacePoints 0.156482 0.652395 1.60299 0.608998 0.293554 35
produce:pandora:StandardPandora 5.85536 21.3926 58.2391 19.5804 10.6095 35
produce:pandoraWriter:StandardPandora 0.104593 0.176722 0.257432 0.172753 0.0383626 35
produce:pandoraTrack:LArPandoraTrackCreation 0.546594 1.70438 3.34658 1.56914 0.649255 35
produce:pandoraShower:LArPandoraShowerCreation 0.420047 1.85363 4.62977 1.52244 0.926897 35
produce:pandoracalo:Calorimetry 0.297572 0.815582 1.58972 0.749677 0.280931 35
produce:pandoracalonosce:Calorimetry 0.249282 0.760937 1.44963 0.707703 0.266719 35
produce:pandorapid:Chi2ParticleID 0.00120062 0.00208135 0.0032523 0.00195209 0.000421618 35
produce:pandoraShowercalo:ShowerCalorimetry 0.37086 1.6413 4.08739 1.44298 0.814961 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.357637 1.55869 4.01444 1.33962 0.782616 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0712154 0.136679 0.220076 0.13228 0.0311074 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0247032 0.0479499 0.0784979 0.0464143 0.0106119 35
produce:emtrkmichelid:EmTrackMichelId 18.2389 29.5312 44.0984 30.0906 6.4027 35
[art]:TriggerResults:TriggerResultInserter 1.552e-05 3.15386e-05 8.4942e-05 2.7561e-05 1.32762e-05 35
end_path:out1:RootOutput 8.53e-06 1.36252e-05 6.5102e-05 1.17e-05 9.24514e-06 35
end_path:michelremoving:michelremoving 0.0149998 0.0583235 0.422721 0.0334791 0.0721572 35
end_path:michelremovinggnocchi:michelremoving 0.014508 0.0555373 0.492452 0.0283896 0.0829011 35
end_path:calibanagnocchi:CalibAnaTree 0.244596 0.615498 1.14755 0.578478 0.217522 35
end_path:out1:RootOutput(write) 0.455076 0.932202 1.34754 0.89373 0.208952 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5031.61 MB
Peak resident set size usage (VmHWM): 2683.29 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027365_0061_dataflow1_datawriter_0_20240622T024346_reco_stage1_reco_stage2_20240927T161812_keepup.root
\tHists: np04hd_raw_run027365_0061_dataflow1_datawriter_0_20240622T024346_reco_stage1_reco_stage2_20240927T161812_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027365_0061_dataflow1_datawriter_0_20240622T024346_reco_stage1_reco_stage2_20240927T161812_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027365_0061_dataflow1_datawriter_0_20240622T024346_reco_stage1_reco_stage2_20240927T161812_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727450236.0,
"core.end_time": 1727453892.0,
"core.events": [
8545,
8549,
8553,
8557,
8561,
8565,
8569,
8573,
8577,
8581,
8585,
8589,
8593,
8597,
8601,
8605,
8609,
8613,
8617,
8621,
8625,
8629,
8633,
8637,
8641,
8645,
8649,
8653,
8657,
8661,
8665,
8669,
8673,
8677,
8681
],
"core.event_count": 35,
"core.first_event_number": 8545,
"core.last_event_number": 8681,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27365
],
"core.runs_subruns": [
2736500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027365_0061_dataflow1_datawriter_0_20240622T024346.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027365_0061_dataflow1_datawriter_0_20240622T024346_reco_stage1_reco_stage2_20240927T161812_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727450236.0,
"core.end_time": 1727453892.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27365
],
"core.runs_subruns": [
2736500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027365_0061_dataflow1_datawriter_0_20240622T024346.hdf5"
}
]
} 