Jobsub ID 262992.147@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 262992.147@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 3448 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2024-09-26 06:57:03 | |
| Site | UK_Durham | |
| Entry | DUNE_UK_SGridDurham_ce4 | |
| Last heartbeat | 2024-09-26 09:29:51 | |
| From worker node | Hostname | n246.dur.scotgrid.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2024-09-26 07:09:36 | |
| Input files | hd-protodune:np04hd_raw_run029094_0118_dataflow3_datawriter_0_20240906T093056.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 1h (5260s) | |
| CPU time | 54m (3283s = 62%) | |
| Outputting started | 2024-09-26 08:37:16 | |
| Output files | hd-protodune-det-reco:np04hd_raw_run029094_0118_dataflow3_datawriter_0_20240906T093056_reco_stage1_reco_stage2_20240926T083706_keepup.root hd-protodune-det-reco:np04hd_raw_run029094_0118_dataflow3_datawriter_0_20240906T093056_reco_stage1_reco_stage2_20240926T083706_keepup_hists.root | |
| Finished | 2024-09-26 09:29:45 | |
| Saved logs | justin-logs:262992.147-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
4 traces, 63544 summary
Retagger: tagging trace set: gauss with 48625 traces, 0 summary
wclsFrameSaver saving cooked to 5859 ticks
wclsFrameSaver: saving 48625 traces tagged "gauss"
FrameSaver: q=1.08487e+06 n=907766 tag=gauss
wclsFrameSaver: saving 63544 traces tagged "wiener"
FrameSaver: q=1.1528e+06 n=824853 tag=wiener
1882 hits in TPC 0
2182 hits in TPC 1
7056 hits in TPC 2
5294 hits in TPC 3
3898 hits in TPC 4
5702 hits in TPC 5
4114 hits in TPC 6
2471 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 815 XUs and 498 XVs -> 11 XUVs
C:0 T:2 18474 XUs and 33113 XVs -> 2395 XUVs
C:0 T:3 305 XUs and 652 XVs -> 12 XUVs
C:0 T:4 28 XUs and 23 XVs -> 2 XUVs
C:0 T:5 25488 XUs and 14912 XVs -> 483 XUVs
C:0 T:6 5999 XUs and 8928 XVs -> 437 XUVs
C:0 T:7 48 XUs and 59 XVs -> 2 XUVs
3342 XUVs total
1324 collection wire objects
3342 potential space points
Neighbour search...
119138 tests to find 73168 neighbours
Iterating with no regularization...
Begin: 8.03422e+06
0 7.25928e+06
1 7.18933e+06
2 7.18249e+06
Now with regularization...
Begin: 6.5941e+06
0 6.59126e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 09:37:06 BST Closed output file "np04hd_raw_run029094_0118_dataflow3_datawriter_0_20240906T093056_reco_stage1_reco_stage2_20240926T083706_keepup.root"
26-Sep-2024 09:37:06 BST Closed input file "np04hd_raw_run029094_0118_dataflow3_datawriter_0_20240906T093056_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 47.8414 81.9435 113.285 80.3274 14.6272 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000420194 0.00226286 0.00421663 0.00233072 0.00112014 30
produce:fembfilter:PDHDFEMBFilter 0.451814 0.654699 0.811339 0.682901 0.0788204 30
produce:wclsdatahd:WireCellToolkit 27.9643 34.9059 42.7052 35.4235 2.52257 30
produce:gaushit:GausHitFinder 0.242357 0.715628 1.0223 0.751103 0.193581 30
produce:nhitsfilter:NumberOfHitsFilter 0.00019539 0.000330393 0.000630201 0.00032504 7.33169e-05 30
produce:reco3d:SpacePointSolver 0.0485811 0.692931 2.76804 0.573935 0.562985 30
produce:hitpdune:DisambigFromSpacePoints 0.0648727 0.56017 0.968031 0.587395 0.22873 30
produce:pandora:StandardPandora 2.69387 11.6545 23.1602 10.7563 4.69339 30
produce:pandoraWriter:StandardPandora 0.0443237 0.151895 0.26017 0.152653 0.0431976 30
produce:pandoraTrack:LArPandoraTrackCreation 0.205688 0.992669 2.09042 1.00532 0.372893 30
produce:pandoraShower:LArPandoraShowerCreation 0.131954 1.23214 2.64047 1.10296 0.596746 30
produce:pandoracalo:Calorimetry 0.120637 0.562593 1.055 0.561943 0.18666 30
produce:pandoracalonosce:Calorimetry 0.103278 0.503686 0.962605 0.499475 0.17024 30
produce:pandorapid:Chi2ParticleID 0.000786858 0.00193689 0.00493641 0.00189701 0.000674921 30
produce:pandoraShowercalo:ShowerCalorimetry 0.11134 1.15799 2.69119 1.06296 0.565362 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.111636 1.1369 2.70343 1.0269 0.569352 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0410318 0.153299 0.238544 0.159834 0.0425664 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0135488 0.050014 0.0779954 0.0504398 0.0142728 30
produce:emtrkmichelid:EmTrackMichelId 12.6675 25.2843 40.6187 25.7703 6.15555 30
[art]:TriggerResults:TriggerResultInserter 2.2973e-05 3.69693e-05 6.892e-05 3.6479e-05 1.09718e-05 30
end_path:out1:RootOutput 8.166e-06 1.18176e-05 2.2583e-05 1.1156e-05 3.01876e-06 30
end_path:michelremoving:michelremoving 0.0126211 0.107124 0.378073 0.065233 0.103658 30
end_path:michelremovinggnocchi:michelremoving 0.0106887 0.104798 0.373701 0.0615244 0.104821 30
end_path:calibanagnocchi:CalibAnaTree 0.124679 0.412716 0.794426 0.388717 0.146287 30
end_path:out1:RootOutput(write) 0.352581 0.78874 1.15461 0.776472 0.177825 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4925.44 MB
Peak resident set size usage (VmHWM): 2591.95 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029094_0118_dataflow3_datawriter_0_20240906T093056_reco_stage1_reco_stage2_20240926T083706_keepup.root
\tHists: np04hd_raw_run029094_0118_dataflow3_datawriter_0_20240906T093056_reco_stage1_reco_stage2_20240926T083706_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029094_0118_dataflow3_datawriter_0_20240906T093056_reco_stage1_reco_stage2_20240926T083706_keepup.root
Ran successfully
{
"name": "np04hd_raw_run029094_0118_dataflow3_datawriter_0_20240906T093056_reco_stage1_reco_stage2_20240926T083706_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727337320.0,
"core.end_time": 1727339827.0,
"core.events": [
28315,
28323,
28331,
28339,
28355,
28363,
28371,
28379,
28387,
28395,
28403,
28411,
28419,
28427,
28435,
28443,
28451,
28459,
28467,
28475,
28483,
28491,
28499,
28507,
28515,
28523,
28531,
28539,
28547,
28555
],
"core.event_count": 30,
"core.first_event_number": 28315,
"core.last_event_number": 28555,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29094
],
"core.runs_subruns": [
2909400001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029094_0118_dataflow3_datawriter_0_20240906T093056.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run029094_0118_dataflow3_datawriter_0_20240906T093056_reco_stage1_reco_stage2_20240926T083706_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727337320.0,
"core.end_time": 1727339827.0,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29094
],
"core.runs_subruns": [
2909400001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029094_0118_dataflow3_datawriter_0_20240906T093056.hdf5"
}
]
}