Jobsub ID 263057.98@justin-prod-sched01.dune.hep.ac.uk
Jobsub ID | 263057.98@justin-prod-sched01.dune.hep.ac.uk |
Workflow ID | 3447 |
Stage ID | 1 |
User name | calcuttj@fnal.gov |
HTCondor Group | group_dune.prod_mcsim |
Requested | Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 18000 (5 hours) |
Submitted time | 2024-09-26 07:52:56 |
Site | FR_CCIN2P3 |
Entry | DUNE_FR_CCIN2P3_cccondorce03 |
Last heartbeat | 2024-09-26 09:15:30 |
From worker node | Hostname | ccwcondor0622 |
cpuinfo | AMD EPYC 7453 28-Core Processor |
OS release | Scientific Linux release 7.9 (Nitrogen) |
Processors | 1 |
RSS bytes | 4193255424 (3999 MiB) |
Wall seconds limit | 106200 (29 hours) |
Inner Apptainer? | True |
Job state | stalled |
Allocator name | justin-allocator-pro.dune.hep.ac.uk |
Started | 2024-09-26 07:55:28 |
Input files | hd-protodune:np04hd_raw_run029092_0297_dataflow3_datawriter_0_20240905T212209.hdf5
|
Outputting started | 2024-09-26 08:57:12 |
Output files | |
Finished | 2024-09-26 09:57:03 |
List job events Wrapper job log |
Jobscript log (last 10,000 characters)
5203 traces tagged "wiener"
FrameSaver: q=1.51087e+06 n=1155712 tag=wiener
5682 hits in TPC 0
6099 hits in TPC 1
5530 hits in TPC 2
2744 hits in TPC 3
3205 hits in TPC 4
6785 hits in TPC 5
8904 hits in TPC 6
5922 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 7002 XUs and 5755 XVs -> 195 XUVs
C:0 T:2 26499 XUs and 32554 XVs -> 1138 XUVs
C:0 T:3 15 XUs and 15 XVs -> 0 XUVs
C:0 T:4 192 XUs and 205 XVs -> 3 XUVs
C:0 T:5 26167 XUs and 34101 XVs -> 864 XUVs
C:0 T:6 36361 XUs and 41823 XVs -> 1045 XUVs
C:0 T:7 1254 XUs and 1025 XVs -> 43 XUVs
3288 XUVs total
1929 collection wire objects
3288 potential space points
Neighbour search...
126724 tests to find 65234 neighbours
Iterating with no regularization...
Begin: 1.13595e+07
0 1.0892e+07
1 1.08755e+07
2 1.08727e+07
Now with regularization...
Begin: 1.02434e+07
0 1.02425e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
no of hits closeby 5 event 71531 TrkackID 4 startx, y, z 116.15 598.11 247.936 wireno, peakt tpcno 424 1425.43 5 dist 0.276199min T, max_T248.423 1727.25
no of hits closeby 5 event 71531 TrkackID 4 startx, y, z 116.15 598.11 247.936 wireno, peakt tpcno 424 1425.43 5 dist 0.276199min T, max_T248.423 1727.25
26-Sep-2024 10:56:36 CEST Closed output file "np04hd_raw_run029092_0297_dataflow3_datawriter_0_20240905T212209_reco_stage1_reco_stage2_20240926T085636_keepup.root"
26-Sep-2024 10:56:36 CEST Closed input file "np04hd_raw_run029092_0297_dataflow3_datawriter_0_20240905T212209_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 61.2216 92.7985 147.515 88.3014 22.1861 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000708652 0.00294389 0.00530078 0.00283522 0.00105759 30
produce:fembfilter:PDHDFEMBFilter 0.485602 0.617718 0.789827 0.593473 0.102064 30
produce:wclsdatahd:WireCellToolkit 29.937 37.191 48.4162 36.5685 4.67867 30
produce:gaushit:GausHitFinder 0.282123 0.632841 1.28179 0.567137 0.223954 30
produce:nhitsfilter:NumberOfHitsFilter 0.000187429 0.000359549 0.00103999 0.000335235 0.000165631 30
produce:reco3d:SpacePointSolver 0.20323 1.20989 9.79071 0.859195 1.68792 30
produce:hitpdune:DisambigFromSpacePoints 0.113922 0.457351 1.28083 0.403071 0.259556 30
produce:pandora:StandardPandora 4.32042 11.7726 24.2242 11.5265 5.15997 30
produce:pandoraWriter:StandardPandora 0.0912647 0.149946 0.235761 0.150606 0.0373421 30
produce:pandoraTrack:LArPandoraTrackCreation 0.624617 1.71337 3.37988 1.62686 0.723963 30
produce:pandoraShower:LArPandoraShowerCreation 0.580182 2.23197 6.09119 1.81945 1.35334 30
produce:pandoracalo:Calorimetry 0.271742 0.81581 1.55196 0.727325 0.346508 30
produce:pandoracalonosce:Calorimetry 0.24305 0.775607 1.60539 0.699491 0.344973 30
produce:pandorapid:Chi2ParticleID 0.00122263 0.00198568 0.0035222 0.00195844 0.000544294 30
produce:pandoraShowercalo:ShowerCalorimetry 0.518352 1.83161 6.85901 1.49506 1.21062 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.498933 1.81701 7.9034 1.42885 1.42313 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0595376 0.129365 0.273593 0.111208 0.0555704 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0247373 0.0486632 0.108467 0.042501 0.0197257 30
produce:emtrkmichelid:EmTrackMichelId 17.8945 29.7523 48.0505 29.2183 7.56051 30
[art]:TriggerResults:TriggerResultInserter 3.265e-05 6.11387e-05 0.000105787 6.1635e-05 1.82023e-05 30
end_path:out1:RootOutput 8.956e-06 1.6439e-05 3.3964e-05 1.5429e-05 5.08507e-06 30
end_path:michelremoving:michelremoving 0.0181487 0.0718075 0.472154 0.0438458 0.0867507 30
end_path:michelremovinggnocchi:michelremoving 0.0177284 0.0689235 0.473141 0.0423862 0.0884955 30
end_path:calibanagnocchi:CalibAnaTree 0.185538 0.576832 1.25254 0.481902 0.263615 30
end_path:out1:RootOutput(write) 0.367051 0.71761 1.10004 0.662968 0.200247 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4924.09 MB
Peak resident set size usage (VmHWM): 2344.42 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029092_0297_dataflow3_datawriter_0_20240905T212209_reco_stage1_reco_stage2_20240926T085636_keepup.root
\tHists: np04hd_raw_run029092_0297_dataflow3_datawriter_0_20240905T212209_reco_stage1_reco_stage2_20240926T085636_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029092_0297_dataflow3_datawriter_0_20240905T212209_reco_stage1_reco_stage2_20240926T085636_keepup.root
Ran successfully
{
"name": "np04hd_raw_run029092_0297_dataflow3_datawriter_0_20240905T212209_reco_stage1_reco_stage2_20240926T085636_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727338158.0,
"core.end_time": 1727340997.0,
"core.events": [
71283,
71291,
71299,
71307,
71315,
71323,
71331,
71339,
71347,
71355,
71363,
71371,
71379,
71387,
71395,
71403,
71411,
71419,
71427,
71435,
71443,
71451,
71459,
71467,
71475,
71483,
71491,
71499,
71523,
71531
],
"core.event_count": 30,
"core.first_event_number": 71283,
"core.last_event_number": 71531,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29092
],
"core.runs_subruns": [
2909200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029092_0297_dataflow3_datawriter_0_20240905T212209.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run029092_0297_dataflow3_datawriter_0_20240905T212209_reco_stage1_reco_stage2_20240926T085636_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727338158.0,
"core.end_time": 1727340997.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29092
],
"core.runs_subruns": [
2909200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029092_0297_dataflow3_datawriter_0_20240905T212209.hdf5"
}
]
}