Jobsub ID 79665.101@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 79665.101@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3512 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-09-27 00:30:56 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2024-09-27 16:44:54 |
| From worker node | Hostname | dunegli-4171579-0-fnpc19107.fnal.gov |
| cpuinfo | AMD EPYC 7502 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| Inner Apptainer? | True |
| Job state | stalled |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-09-27 04:53:50 |
| Input files | hd-protodune:np04hd_raw_run027335_0610_dataflow3_datawriter_0_20240621T090817.hdf5
|
| Outputting started | 2024-09-27 16:17:30 |
| Output files | |
| Finished | 2024-09-27 17:36:31 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 66768 traces tagged "gauss"
FrameSaver: q=2.35441e+06 n=1157654 tag=gauss
wclsFrameSaver: saving 89193 traces tagged "wiener"
FrameSaver: q=2.57009e+06 n=1040786 tag=wiener
6700 hits in TPC 0
5265 hits in TPC 1
6746 hits in TPC 2
4397 hits in TPC 3
3897 hits in TPC 4
5971 hits in TPC 5
9854 hits in TPC 6
5729 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 9191 XUs and 7987 XVs -> 343 XUVs
C:0 T:2 54532 XUs and 42265 XVs -> 934 XUVs
C:0 T:3 125 XUs and 122 XVs -> 3 XUVs
C:0 T:4 500 XUs and 423 XVs -> 27 XUVs
C:0 T:5 19254 XUs and 23349 XVs -> 295 XUVs
C:0 T:6 57847 XUs and 48617 XVs -> 1953 XUVs
C:0 T:7 1003 XUs and 733 XVs -> 16 XUVs
3571 XUVs total
1710 collection wire objects
3571 potential space points
Neighbour search...
88057 tests to find 50676 neighbours
Iterating with no regularization...
Begin: 3.00763e+07
0 2.75109e+07
1 2.73361e+07
2 2.73158e+07
Now with regularization...
Begin: 2.60379e+07
0 2.6031e+07
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
27-Sep-2024 16:17:24 UTC Closed output file "np04hd_raw_run027335_0610_dataflow3_datawriter_0_20240621T090817_reco_stage1_reco_stage2_20240927T161724_keepup.root"
27-Sep-2024 16:17:24 UTC Closed input file "np04hd_raw_run027335_0610_dataflow3_datawriter_0_20240621T090817_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 48.796 105.9 211.315 90.3452 41.5363 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000405393 0.00169031 0.00384618 0.0015297 0.000983209 35
produce:fembfilter:PDHDFEMBFilter 0.544185 0.622847 0.788642 0.568114 0.080974 35
produce:wclsdatahd:WireCellToolkit 25.4984 27.3797 29.2342 27.2745 0.857411 35
produce:gaushit:GausHitFinder 0.313916 0.679771 1.20511 0.670981 0.174652 35
produce:nhitsfilter:NumberOfHitsFilter 0.000213981 0.000384905 0.000587455 0.000382383 8.10365e-05 35
produce:reco3d:SpacePointSolver 0.23364 1.38022 4.11998 1.16503 0.908062 35
produce:hitpdune:DisambigFromSpacePoints 0.184249 0.732486 1.97481 0.642169 0.403395 35
produce:pandora:StandardPandora 5.49422 38.3806 117.022 25.3432 29.9202 35
produce:pandoraWriter:StandardPandora 0.0719251 0.167085 0.29193 0.161736 0.047255 35
produce:pandoraTrack:LArPandoraTrackCreation 0.483662 1.92138 5.65042 1.56883 1.11949 35
produce:pandoraShower:LArPandoraShowerCreation 0.351694 1.87491 6.73237 1.57384 1.24899 35
produce:pandoracalo:Calorimetry 0.242806 0.880924 2.28233 0.775494 0.455873 35
produce:pandoracalonosce:Calorimetry 0.21655 0.828322 2.07647 0.725687 0.431418 35
produce:pandorapid:Chi2ParticleID 0.0010827 0.00192205 0.00343304 0.00179678 0.000511931 35
produce:pandoraShowercalo:ShowerCalorimetry 0.320464 1.61893 5.13003 1.37327 0.996566 35
produce:pandoraShowercalonosce:ShowerCalorimetry 0.305514 1.53922 4.85226 1.31445 0.937915 35
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0566243 0.11942 0.200905 0.118762 0.0310963 35
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0210232 0.0412554 0.0707405 0.0399685 0.0109657 35
produce:emtrkmichelid:EmTrackMichelId 12.2136 25.9621 42.8399 25.6649 6.38563 35
[art]:TriggerResults:TriggerResultInserter 1.5261e-05 2.27528e-05 5.4581e-05 1.878e-05 9.6467e-06 35
end_path:out1:RootOutput 6.11e-06 9.24466e-06 2.019e-05 8.37e-06 3.2137e-06 35
end_path:michelremoving:michelremoving 0.0125191 0.0586605 0.272909 0.0293246 0.0565705 35
end_path:michelremovinggnocchi:michelremoving 0.0125968 0.0561181 0.268915 0.0257744 0.056656 35
end_path:calibanagnocchi:CalibAnaTree 0.179653 0.68691 1.99173 0.584579 0.369082 35
end_path:out1:RootOutput(write) 0.411269 0.851789 1.4881 0.814109 0.224538 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5094.89 MB
Peak resident set size usage (VmHWM): 2764.3 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027335_0610_dataflow3_datawriter_0_20240621T090817_reco_stage1_reco_stage2_20240927T161724_keepup.root
\tHists: np04hd_raw_run027335_0610_dataflow3_datawriter_0_20240621T090817_reco_stage1_reco_stage2_20240927T161724_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027335_0610_dataflow3_datawriter_0_20240621T090817_reco_stage1_reco_stage2_20240927T161724_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027335_0610_dataflow3_datawriter_0_20240621T090817_reco_stage1_reco_stage2_20240927T161724_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727450107.0,
"core.end_time": 1727453845.0,
"core.events": [
85407,
85411,
85415,
85419,
85423,
85427,
85431,
85435,
85439,
85443,
85447,
85451,
85455,
85459,
85463,
85467,
85471,
85475,
85479,
85483,
85487,
85491,
85495,
85499,
85503,
85507,
85511,
85515,
85519,
85523,
85527,
85531,
85535,
85539,
85543
],
"core.event_count": 35,
"core.first_event_number": 85407,
"core.last_event_number": 85543,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27335
],
"core.runs_subruns": [
2733500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027335_0610_dataflow3_datawriter_0_20240621T090817.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027335_0610_dataflow3_datawriter_0_20240621T090817_reco_stage1_reco_stage2_20240927T161724_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727450107.0,
"core.end_time": 1727453845.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27335
],
"core.runs_subruns": [
2733500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027335_0610_dataflow3_datawriter_0_20240621T090817.hdf5"
}
]
} 