Jobsub ID 83013.131@justin-prod-sched02.dune.hep.ac.uk
| Jobsub ID | 83013.131@justin-prod-sched02.dune.hep.ac.uk |
| Workflow ID | 3704 |
| Stage ID | 1 |
| User name | calcuttj@fnal.gov |
| HTCondor Group | group_dune.prod_mcsim |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 18000 (5 hours) |
| Submitted time | 2024-10-17 05:37:29 |
| Site | US_FNAL-FermiGrid |
| Entry | FNAL_GPGrid_ce04_mcore_op_duneonly |
| Last heartbeat | 2024-10-17 13:33:29 |
| From worker node | Hostname | dunegli-4189401-0-fnpc22006.fnal.gov |
| cpuinfo | AMD EPYC 7543 32-Core Processor |
| OS release | Scientific Linux release 7.9 (Nitrogen) |
| Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) |
| Wall seconds limit | 172800 (48 hours) |
| Inner Apptainer? | True |
| Job state | stalled |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk |
| Started | 2024-10-17 12:23:25 |
| Input files | hd-protodune:np04hd_raw_run027392_0358_dataflow1_datawriter_0_20240623T145910.hdf5
|
| Outputting started | 2024-10-17 13:24:01 |
| Output files | |
| Finished | 2024-10-17 14:25:27 |
| List job events Wrapper job log |
Jobscript log (last 10,000 characters)
ing trace set: gauss with 34890 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 34890 traces tagged "gauss"
FrameSaver: q=1.26724e+06 n=667402 tag=gauss
wclsFrameSaver: saving 44948 traces tagged "wiener"
FrameSaver: q=1.38354e+06 n=619735 tag=wiener
2571 hits in TPC 0
3332 hits in TPC 1
6319 hits in TPC 2
3264 hits in TPC 3
3072 hits in TPC 4
3285 hits in TPC 5
5116 hits in TPC 6
1862 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:0 253 XUs and 246 XVs -> 12 XUVs
C:0 T:1 2132 XUs and 1419 XVs -> 120 XUVs
C:0 T:2 41551 XUs and 35873 XVs -> 1401 XUVs
C:0 T:3 175 XUs and 216 XVs -> 15 XUVs
C:0 T:4 133 XUs and 260 XVs -> 11 XUVs
C:0 T:5 6692 XUs and 12505 XVs -> 491 XUVs
C:0 T:6 16081 XUs and 14794 XVs -> 253 XUVs
C:0 T:7 1035 XUs and 1183 XVs -> 123 XUVs
2426 XUVs total
1270 collection wire objects
2426 potential space points
Neighbour search...
67406 tests to find 40776 neighbours
Iterating with no regularization...
Begin: 1.55334e+07
0 1.42061e+07
1 1.41169e+07
2 1.41083e+07
Now with regularization...
Begin: 1.33287e+07
0 1.33256e+07
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
17-Oct-2024 13:23:54 UTC Closed output file "np04hd_raw_run027392_0358_dataflow1_datawriter_0_20240623T145910_reco_stage1_reco_stage2_20241017T132354_keepup.root"
17-Oct-2024 13:23:54 UTC Closed input file "np04hd_raw_run027392_0358_dataflow1_datawriter_0_20240623T145910_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 24.5926 54.7919 78.5482 55.1215 9.63317 35
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000457864 0.0011491 0.0020526 0.00118169 0.000442795 35
produce:fembfilter:PDHDFEMBFilter 0.423988 0.439014 0.452272 0.439453 0.00488462 35
produce:wclsdatahd:WireCellToolkit 21.6484 22.6012 23.8939 22.5748 0.462014 35
produce:gaushit:GausHitFinder 0.283172 0.433965 0.762837 0.408022 0.104595 35
produce:nhitsfilter:NumberOfHitsFilter 0.000162557 0.000260444 0.000478554 0.0002487 5.52457e-05 35
produce:reco3d:SpacePointSolver 0.125309 0.508216 1.2431 0.44598 0.320604 34
produce:hitpdune:DisambigFromSpacePoints 0.131908 0.328514 0.74697 0.295053 0.144365 34
produce:pandora:StandardPandora 4.10046 8.5243 15.9075 8.79311 2.66815 34
produce:pandoraWriter:StandardPandora 0.0506711 0.0793629 0.12641 0.0808064 0.0161453 34
produce:pandoraTrack:LArPandoraTrackCreation 0.369201 0.733376 1.2276 0.701438 0.208383 34
produce:pandoraShower:LArPandoraShowerCreation 0.323921 0.978883 2.25568 0.929051 0.435006 34
produce:pandoracalo:Calorimetry 0.201352 0.416288 0.748089 0.397349 0.119138 34
produce:pandoracalonosce:Calorimetry 0.182797 0.385251 0.700777 0.366272 0.11376 34
produce:pandorapid:Chi2ParticleID 0.000808376 0.00119694 0.00314434 0.00116403 0.000369193 34
produce:pandoraShowercalo:ShowerCalorimetry 0.293798 0.976782 2.56063 0.903023 0.45317 34
produce:pandoraShowercalonosce:ShowerCalorimetry 0.282513 0.932361 2.4377 0.866124 0.432037 34
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0420659 0.0732542 0.113703 0.0756067 0.0171705 34
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0140126 0.0245585 0.0376997 0.0241645 0.00579299 34
produce:emtrkmichelid:EmTrackMichelId 11.2399 17.2722 25.2662 17.0879 3.21635 34
[art]:TriggerResults:TriggerResultInserter 1.4929e-05 2.07545e-05 0.000106281 1.7944e-05 1.48111e-05 35
end_path:out1:RootOutput 4.709e-06 1.14858e-05 3.6139e-05 1.0831e-05 4.4407e-06 35
end_path:michelremoving:michelremoving 1.4467e-05 0.0554356 0.228487 0.0178644 0.0617068 35
end_path:michelremovinggnocchi:michelremoving 3.887e-06 0.0538866 0.224971 0.0157442 0.0612474 35
end_path:calibanagnocchi:CalibAnaTree 3.456e-06 0.306438 0.613389 0.287602 0.107826 35
end_path:out1:RootOutput(write) 0.256055 0.501474 0.771582 0.494235 0.11261 35
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5011.8 MB
Peak resident set size usage (VmHWM): 2665.26 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027392_0358_dataflow1_datawriter_0_20240623T145910_reco_stage1_reco_stage2_20241017T132354_keepup.root
\tHists: np04hd_raw_run027392_0358_dataflow1_datawriter_0_20240623T145910_reco_stage1_reco_stage2_20241017T132354_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027392_0358_dataflow1_datawriter_0_20240623T145910_reco_stage1_reco_stage2_20241017T132354_keepup.root
Ran successfully
{
"name": "np04hd_raw_run027392_0358_dataflow1_datawriter_0_20240623T145910_reco_stage1_reco_stage2_20241017T132354_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1729169490.0,
"core.end_time": 1729171435.0,
"core.events": [
50121,
50125,
50129,
50133,
50137,
50141,
50145,
50149,
50153,
50157,
50161,
50165,
50169,
50173,
50177,
50181,
50185,
50189,
50193,
50197,
50201,
50205,
50209,
50213,
50217,
50221,
50225,
50229,
50233,
50237,
50241,
50245,
50249,
50253,
50257
],
"core.event_count": 35,
"core.first_event_number": 50121,
"core.last_event_number": 50257,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27392
],
"core.runs_subruns": [
2739200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027392_0358_dataflow1_datawriter_0_20240623T145910.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run027392_0358_dataflow1_datawriter_0_20240623T145910_reco_stage1_reco_stage2_20241017T132354_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1729169490.0,
"core.end_time": 1729171435.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
27392
],
"core.runs_subruns": [
2739200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run027392_0358_dataflow1_datawriter_0_20240623T145910.hdf5"
}
]
} 