Jobsub ID 255378.3@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 255378.3@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 3199 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2024-09-12 16:59:03 | |
| Site | UK_Manchester | |
| Entry | UBoone_T2_UK_Manchester_ce01 | |
| Last heartbeat | 2024-09-12 18:55:49 | |
| From worker node | Hostname | wn1208240.tier2.hep.manchester.ac.uk |
| cpuinfo | AMD EPYC 7702P 64-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 257400 (71 hours) | |
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2024-09-12 17:00:22 | |
| Input files | hd-protodune:np04hd_raw_run028765_0311_dataflow3_datawriter_0_20240819T100017.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 1h (5897s) | |
| CPU time | 1h (4517s = 76%) | |
| Outputting started | 2024-09-12 18:38:39 | |
| Output files | hd-protodune-det-reco:np04hd_raw_run028765_0311_dataflow3_datawriter_0_20240819T100017_reco_stage1_reco_stage2_20240912T183830_keepup.root hd-protodune-det-reco:np04hd_raw_run028765_0311_dataflow3_datawriter_0_20240819T100017_reco_stage1_reco_stage2_20240912T183830_keepup_hists.root | |
| Finished | 2024-09-12 18:55:49 | |
| Saved logs | justin-logs:255378.3-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
ects
input nticks=5859 keeping as is
Retagger: tagging trace set: wiener with 52989 traces, 52989 summary
Retagger: tagging trace set: gauss with 38531 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 38531 traces tagged "gauss"
FrameSaver: q=840683 n=693635 tag=gauss
wclsFrameSaver: saving 52989 traces tagged "wiener"
FrameSaver: q=942184 n=623591 tag=wiener
3669 hits in TPC 0
4829 hits in TPC 1
5173 hits in TPC 2
1974 hits in TPC 3
2449 hits in TPC 4
3421 hits in TPC 5
4601 hits in TPC 6
2124 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 14978 XUs and 8682 XVs -> 1079 XUVs
C:0 T:2 12301 XUs and 15246 XVs -> 468 XUVs
C:0 T:3 81 XUs and 100 XVs -> 6 XUVs
C:0 T:4 35 XUs and 34 XVs -> 2 XUVs
C:0 T:5 11054 XUs and 16286 XVs -> 2202 XUVs
C:0 T:6 15180 XUs and 15831 XVs -> 765 XUVs
C:0 T:7 24 XUs and 18 XVs -> 3 XUVs
4525 XUVs total
860 collection wire objects
4525 potential space points
Neighbour search...
315717 tests to find 177154 neighbours
Iterating with no regularization...
Begin: 8.89023e+06
0 8.45061e+06
1 8.40366e+06
2 8.39775e+06
Now with regularization...
Begin: 8.11866e+06
0 8.11608e+06
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
12-Sep-2024 19:38:30 BST Closed output file "np04hd_raw_run028765_0311_dataflow3_datawriter_0_20240819T100017_reco_stage1_reco_stage2_20240912T183830_keepup.root"
12-Sep-2024 19:38:30 BST Closed input file "np04hd_raw_run028765_0311_dataflow3_datawriter_0_20240819T100017_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 66.9456 108.236 185.782 102.924 26.8184 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000343666 0.00261808 0.00487403 0.0024563 0.00121625 30
produce:fembfilter:PDHDFEMBFilter 0.596089 0.704411 0.960066 0.674286 0.110293 30
produce:wclsdatahd:WireCellToolkit 32.0811 38.5795 49.9423 38.1976 4.8308 30
produce:gaushit:GausHitFinder 0.42271 0.830332 1.57489 0.803228 0.267823 30
produce:nhitsfilter:NumberOfHitsFilter 0.000263386 0.0011843 0.0225668 0.000392599 0.00397428 30
produce:reco3d:SpacePointSolver 0.147727 1.29366 5.13295 1.00704 1.09494 30
produce:hitpdune:DisambigFromSpacePoints 0.169663 0.623524 1.44609 0.590253 0.303448 30
produce:pandora:StandardPandora 4.6159 22.8526 60.5936 21.2197 10.8739 30
produce:pandoraWriter:StandardPandora 0.0994488 0.203402 0.300974 0.206252 0.0477356 30
produce:pandoraTrack:LArPandoraTrackCreation 0.502795 1.79188 4.36774 1.64938 0.821422 30
produce:pandoraShower:LArPandoraShowerCreation 0.428716 1.93615 4.13226 1.56473 1.0298 30
produce:pandoracalo:Calorimetry 0.276816 0.887259 2.57592 0.767905 0.465903 30
produce:pandoracalonosce:Calorimetry 0.234933 0.803625 2.16522 0.69967 0.376506 30
produce:pandorapid:Chi2ParticleID 0.00123837 0.00231214 0.00546963 0.00208789 0.000823667 30
produce:pandoraShowercalo:ShowerCalorimetry 0.363519 1.63348 3.87891 1.37187 0.834399 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.341444 1.6283 4.94147 1.39342 0.950699 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0887551 0.157963 0.345163 0.157447 0.05069 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0307647 0.0565666 0.119826 0.0566869 0.0173043 30
produce:emtrkmichelid:EmTrackMichelId 16.8276 32.2019 51.8852 29.9845 8.85677 30
[art]:TriggerResults:TriggerResultInserter 1.5839e-05 3.44371e-05 7.6073e-05 3.33325e-05 1.54611e-05 30
end_path:out1:RootOutput 3.567e-06 6.17857e-06 2.0559e-05 4.9695e-06 3.31275e-06 30
end_path:michelremoving:michelremoving 0.0220144 0.0926845 0.599677 0.0408234 0.120108 30
end_path:michelremovinggnocchi:michelremoving 0.0207479 0.0806204 0.369242 0.0382842 0.0857447 30
end_path:calibanagnocchi:CalibAnaTree 0.268031 0.672212 1.63272 0.573265 0.303829 30
end_path:out1:RootOutput(write) 0.607623 1.03247 1.77471 0.946555 0.282622 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 5004.9 MB
Peak resident set size usage (VmHWM): 2630.57 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run028765_0311_dataflow3_datawriter_0_20240819T100017_reco_stage1_reco_stage2_20240912T183830_keepup.root
\tHists: np04hd_raw_run028765_0311_dataflow3_datawriter_0_20240819T100017_reco_stage1_reco_stage2_20240912T183830_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run028765_0311_dataflow3_datawriter_0_20240819T100017_reco_stage1_reco_stage2_20240912T183830_keepup.root
Ran successfully
{
"name": "np04hd_raw_run028765_0311_dataflow3_datawriter_0_20240819T100017_reco_stage1_reco_stage2_20240912T183830_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1726163002.0,
"core.end_time": 1726166310.0,
"core.events": [
74619,
74627,
74635,
74667,
74675,
74683,
74691,
74699,
74707,
74715,
74723,
74731,
74739,
74747,
74755,
74763,
74771,
74779,
74787,
74795,
74803,
74811,
74819,
74827,
74835,
74843,
74851,
74859,
74867,
74875
],
"core.event_count": 30,
"core.first_event_number": 74619,
"core.last_event_number": 74875,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
28765
],
"core.runs_subruns": [
2876500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run028765_0311_dataflow3_datawriter_0_20240819T100017.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run028765_0311_dataflow3_datawriter_0_20240819T100017_reco_stage1_reco_stage2_20240912T183830_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1726163002.0,
"core.end_time": 1726166310.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
28765
],
"core.runs_subruns": [
2876500001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run028765_0311_dataflow3_datawriter_0_20240819T100017.hdf5"
}
]
}