Jobsub ID 262961.154@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 262961.154@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 3448 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2024-09-26 06:20:35 | |
| Site | UK_Durham | |
| Entry | DUNE_UK_SGridDurham_ce4 | |
| Last heartbeat | 2024-09-26 08:59:33 | |
| From worker node | Hostname | n257.dur.scotgrid.ac.uk |
| cpuinfo | AMD EPYC 7763 64-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2024-09-26 06:40:54 | |
| Input files | hd-protodune:np04hd_raw_run029072_0301_dataflow1_datawriter_0_20240903T205649.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 1h (5900s) | |
| CPU time | 58m (3528s = 59%) | |
| Outputting started | 2024-09-26 08:19:15 | |
| Output files | hd-protodune-det-reco:np04hd_raw_run029072_0301_dataflow1_datawriter_0_20240903T205649_reco_stage1_reco_stage2_20240926T081905_keepup.root hd-protodune-det-reco:np04hd_raw_run029072_0301_dataflow1_datawriter_0_20240903T205649_reco_stage1_reco_stage2_20240926T081905_keepup_hists.root | |
| Finished | 2024-09-26 08:59:33 | |
| Saved logs | justin-logs:262961.154-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
aving cooked to 5859 ticks
wclsFrameSaver: saving 58934 traces tagged "gauss"
FrameSaver: q=1.26462e+06 n=1112657 tag=gauss
wclsFrameSaver: saving 78066 traces tagged "wiener"
FrameSaver: q=1.36124e+06 n=1011541 tag=wiener
6387 hits in TPC 0
4775 hits in TPC 1
6231 hits in TPC 2
3887 hits in TPC 3
4431 hits in TPC 4
5733 hits in TPC 5
6158 hits in TPC 6
3684 hits in TPC 7
0 X, 0 U, 0 V bad channels
Finding XUV coincidences...
C:0 T:1 1534 XUs and 1523 XVs -> 117 XUVs
C:0 T:2 23167 XUs and 22599 XVs -> 1304 XUVs
C:0 T:3 31 XUs and 36 XVs -> 2 XUVs
C:0 T:4 13 XUs and 39 XVs -> 0 XUVs
C:0 T:5 28081 XUs and 23870 XVs -> 1714 XUVs
C:0 T:6 25512 XUs and 23327 XVs -> 595 XUVs
C:0 T:7 973 XUs and 1117 XVs -> 59 XUVs
3791 XUVs total
1290 collection wire objects
3791 potential space points
Neighbour search...
120925 tests to find 77080 neighbours
Iterating with no regularization...
Begin: 1.11263e+07
0 1.04262e+07
1 1.03565e+07
2 1.03439e+07
3 1.03395e+07
Now with regularization...
Begin: 9.63446e+06
0 9.63152e+06
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
BdtBeamParticleIdTool::SliceFeatures::GetLeadingCaloHits - empty calo hit list
---INTERPRETED-MATCHING-OUTPUT------------------------------------------------------------------
---SUMMARY--------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
26-Sep-2024 09:19:05 BST Closed output file "np04hd_raw_run029072_0301_dataflow1_datawriter_0_20240903T205649_reco_stage1_reco_stage2_20240926T081905_keepup.root"
26-Sep-2024 09:19:05 BST Closed input file "np04hd_raw_run029072_0301_dataflow1_datawriter_0_20240903T205649_reco_stage1.root"
========================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
========================================================================================================================================
Full event 56.0494 85.9171 138.793 82.4197 20.8469 30
----------------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000348021 0.00229325 0.00481749 0.00209951 0.0010206 30
produce:fembfilter:PDHDFEMBFilter 0.544842 0.721224 0.909698 0.641474 0.120224 30
produce:wclsdatahd:WireCellToolkit 29.8775 36.1041 43.3118 34.8096 5.15775 30
produce:gaushit:GausHitFinder 0.374439 0.731336 1.21378 0.664242 0.259437 30
produce:nhitsfilter:NumberOfHitsFilter 0.000238143 0.000377742 0.000671616 0.000362489 0.000109226 30
produce:reco3d:SpacePointSolver 0.151641 0.825531 2.84191 0.620171 0.624921 30
produce:hitpdune:DisambigFromSpacePoints 0.144846 0.589154 1.5847 0.454176 0.378032 30
produce:pandora:StandardPandora 4.69923 11.8565 28.7027 9.82502 6.37754 30
produce:pandoraWriter:StandardPandora 0.0794751 0.156752 0.269936 0.145208 0.0500361 30
produce:pandoraTrack:LArPandoraTrackCreation 0.414209 1.12405 3.228 0.970786 0.607622 30
produce:pandoraShower:LArPandoraShowerCreation 0.460736 1.45742 3.97564 1.21101 0.858264 30
produce:pandoracalo:Calorimetry 0.241052 0.604671 1.40576 0.521745 0.27143 30
produce:pandoracalonosce:Calorimetry 0.211862 0.539177 1.2617 0.474321 0.244702 30
produce:pandorapid:Chi2ParticleID 0.00115882 0.00197761 0.00329386 0.00184216 0.000602155 30
produce:pandoraShowercalo:ShowerCalorimetry 0.419678 1.30413 3.15358 1.09611 0.681755 30
produce:pandoraShowercalonosce:ShowerCalorimetry 0.408703 1.2799 2.95686 1.10754 0.653087 30
produce:pandoraGnocchiCalo:GnocchiCalorimetry 0.0695306 0.159228 0.309841 0.165159 0.0606536 30
produce:pandoraGnocchiCalonosce:GnocchiCalorimetry 0.0236221 0.0539726 0.0869924 0.056803 0.0179381 30
produce:emtrkmichelid:EmTrackMichelId 14.9841 26.8635 43.5559 26.3755 7.45255 30
[art]:TriggerResults:TriggerResultInserter 1.9738e-05 3.32428e-05 6.308e-05 3.1069e-05 1.22504e-05 30
end_path:out1:RootOutput 8.245e-06 1.15298e-05 2.3274e-05 1.049e-05 3.40541e-06 30
end_path:michelremoving:michelremoving 0.0151504 0.084251 0.25676 0.0366862 0.0795329 30
end_path:michelremovinggnocchi:michelremoving 0.0144189 0.0807507 0.254725 0.0335904 0.079069 30
end_path:calibanagnocchi:CalibAnaTree 0.169588 0.423797 0.880276 0.404704 0.177144 30
end_path:out1:RootOutput(write) 0.440226 0.822004 1.37675 0.8106 0.239647 30
========================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 4929.27 MB
Peak resident set size usage (VmHWM): 2597.81 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029072_0301_dataflow1_datawriter_0_20240903T205649_reco_stage1_reco_stage2_20240926T081905_keepup.root
\tHists: np04hd_raw_run029072_0301_dataflow1_datawriter_0_20240903T205649_reco_stage1_reco_stage2_20240926T081905_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029072_0301_dataflow1_datawriter_0_20240903T205649_reco_stage1_reco_stage2_20240926T081905_keepup.root
Ran successfully
{
"name": "np04hd_raw_run029072_0301_dataflow1_datawriter_0_20240903T205649_reco_stage1_reco_stage2_20240926T081905_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727336121.0,
"core.end_time": 1727338745.0,
"core.events": [
72233,
72241,
72249,
72257,
72273,
72281,
72289,
72297,
72305,
72313,
72321,
72329,
72337,
72345,
72353,
72361,
72369,
72377,
72385,
72393,
72401,
72409,
72417,
72425,
72433,
72441,
72449,
72457,
72465,
72497
],
"core.event_count": 30,
"core.first_event_number": 72233,
"core.last_event_number": 72497,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29072
],
"core.runs_subruns": [
2907200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029072_0301_dataflow1_datawriter_0_20240903T205649.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run029072_0301_dataflow1_datawriter_0_20240903T205649_reco_stage1_reco_stage2_20240926T081905_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727336121.0,
"core.end_time": 1727338745.0,
"core.data_stream": "physics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29072
],
"core.runs_subruns": [
2907200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029072_0301_dataflow1_datawriter_0_20240903T205649.hdf5"
}
]
}