Jobsub ID 265678.8@justin-prod-sched01.dune.hep.ac.uk
| Jobsub ID | 265678.8@justin-prod-sched01.dune.hep.ac.uk | |
| Workflow ID | 3531 | |
| Stage ID | 1 | |
| User name | calcuttj@fnal.gov | |
| HTCondor Group | group_dune.prod_mcsim | |
| Requested | Processors | 1 |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 18000 (5 hours) | |
| Submitted time | 2024-09-28 04:18:47 | |
| Site | UK_Brunel | |
| Entry | CMSHTPC_T2_UK_London_Brunel_dc2_26 | |
| Last heartbeat | 2024-09-28 04:31:49 | |
| From worker node | Hostname | wn-a4-15 |
| cpuinfo | AMD EPYC 7452 32-Core Processor | |
| OS release | Scientific Linux release 7.9 (Nitrogen) | |
| Processors | 1 | |
| RSS bytes | 4193255424 (3999 MiB) | |
| Wall seconds limit | 171000 (47 hours) | |
| Inner Apptainer? | True | |
| Job state | finished | |
| Allocator name | justin-allocator-pro.dune.hep.ac.uk | |
| Started | 2024-09-28 04:21:07 | |
| Input files | hd-protodune:np04hd_raw_run029382_0042_dataflow1_datawriter_0_20240928T033358.hdf5 | |
| Jobscript | Exit code | 0 |
| Real time | 9m (574s) | |
| CPU time | 3m (225s = 39%) | |
| Outputting started | 2024-09-28 04:30:41 | |
| Output files | hd-protodune-det-reco:np04hd_raw_run029382_0042_dataflow1_datawriter_0_20240928T033358_reco_stage1_reco_stage2_20240928T043031_keepup.root hd-protodune-det-reco:np04hd_raw_run029382_0042_dataflow1_datawriter_0_20240928T033358_reco_stage1_reco_stage2_20240928T043031_keepup_hists.root | |
| Finished | 2024-09-28 04:31:49 | |
| Saved logs | justin-logs:265678.8-justin-prod-sched01.dune.hep.ac.uk.logs.tgz | |
| List job events Wrapper job log | ||
Jobscript log (last 10,000 characters)
d. run: 29382 subRun: 1 event: 3277 at 28-Sep-2024 05:30:10 BST
28-Sep-2024 05:30:10 BST Opened output file with pattern "%ifb_reco_stage2_%tc_keepup.root"
Begin processing the 2nd record. run: 29382 subRun: 1 event: 3279 at 28-Sep-2024 05:30:11 BST
Begin processing the 3rd record. run: 29382 subRun: 1 event: 3281 at 28-Sep-2024 05:30:11 BST
Begin processing the 4th record. run: 29382 subRun: 1 event: 3283 at 28-Sep-2024 05:30:12 BST
Begin processing the 5th record. run: 29382 subRun: 1 event: 3285 at 28-Sep-2024 05:30:12 BST
Begin processing the 6th record. run: 29382 subRun: 1 event: 3287 at 28-Sep-2024 05:30:13 BST
Begin processing the 7th record. run: 29382 subRun: 1 event: 3289 at 28-Sep-2024 05:30:13 BST
Begin processing the 8th record. run: 29382 subRun: 1 event: 3291 at 28-Sep-2024 05:30:14 BST
Begin processing the 9th record. run: 29382 subRun: 1 event: 3293 at 28-Sep-2024 05:30:14 BST
Begin processing the 10th record. run: 29382 subRun: 1 event: 3295 at 28-Sep-2024 05:30:15 BST
Begin processing the 11th record. run: 29382 subRun: 1 event: 3297 at 28-Sep-2024 05:30:16 BST
Begin processing the 12th record. run: 29382 subRun: 1 event: 3299 at 28-Sep-2024 05:30:16 BST
Begin processing the 13th record. run: 29382 subRun: 1 event: 3301 at 28-Sep-2024 05:30:17 BST
Begin processing the 14th record. run: 29382 subRun: 1 event: 3303 at 28-Sep-2024 05:30:17 BST
Begin processing the 15th record. run: 29382 subRun: 1 event: 3305 at 28-Sep-2024 05:30:18 BST
Begin processing the 16th record. run: 29382 subRun: 1 event: 3307 at 28-Sep-2024 05:30:18 BST
Begin processing the 17th record. run: 29382 subRun: 1 event: 3309 at 28-Sep-2024 05:30:19 BST
Begin processing the 18th record. run: 29382 subRun: 1 event: 3311 at 28-Sep-2024 05:30:19 BST
Begin processing the 19th record. run: 29382 subRun: 1 event: 3313 at 28-Sep-2024 05:30:20 BST
Begin processing the 20th record. run: 29382 subRun: 1 event: 3315 at 28-Sep-2024 05:30:20 BST
Begin processing the 21st record. run: 29382 subRun: 1 event: 3317 at 28-Sep-2024 05:30:21 BST
Begin processing the 22nd record. run: 29382 subRun: 1 event: 3319 at 28-Sep-2024 05:30:21 BST
Begin processing the 23rd record. run: 29382 subRun: 1 event: 3321 at 28-Sep-2024 05:30:22 BST
Begin processing the 24th record. run: 29382 subRun: 1 event: 3323 at 28-Sep-2024 05:30:22 BST
Begin processing the 25th record. run: 29382 subRun: 1 event: 3325 at 28-Sep-2024 05:30:23 BST
Begin processing the 26th record. run: 29382 subRun: 1 event: 3327 at 28-Sep-2024 05:30:23 BST
Begin processing the 27th record. run: 29382 subRun: 1 event: 3329 at 28-Sep-2024 05:30:24 BST
Begin processing the 28th record. run: 29382 subRun: 1 event: 3331 at 28-Sep-2024 05:30:24 BST
Begin processing the 29th record. run: 29382 subRun: 1 event: 3333 at 28-Sep-2024 05:30:25 BST
Begin processing the 30th record. run: 29382 subRun: 1 event: 3335 at 28-Sep-2024 05:30:25 BST
Begin processing the 31st record. run: 29382 subRun: 1 event: 3337 at 28-Sep-2024 05:30:26 BST
Begin processing the 32nd record. run: 29382 subRun: 1 event: 3339 at 28-Sep-2024 05:30:26 BST
Begin processing the 33rd record. run: 29382 subRun: 1 event: 3341 at 28-Sep-2024 05:30:27 BST
Begin processing the 34th record. run: 29382 subRun: 1 event: 3343 at 28-Sep-2024 05:30:27 BST
Begin processing the 35th record. run: 29382 subRun: 1 event: 3345 at 28-Sep-2024 05:30:28 BST
Begin processing the 36th record. run: 29382 subRun: 1 event: 3347 at 28-Sep-2024 05:30:28 BST
Begin processing the 37th record. run: 29382 subRun: 1 event: 3349 at 28-Sep-2024 05:30:29 BST
Begin processing the 38th record. run: 29382 subRun: 1 event: 3351 at 28-Sep-2024 05:30:29 BST
Begin processing the 39th record. run: 29382 subRun: 1 event: 3353 at 28-Sep-2024 05:30:30 BST
28-Sep-2024 05:30:31 BST Closed output file "np04hd_raw_run029382_0042_dataflow1_datawriter_0_20240928T033358_reco_stage1_reco_stage2_20240928T043031_keepup.root"
28-Sep-2024 05:30:31 BST Closed input file "np04hd_raw_run029382_0042_dataflow1_datawriter_0_20240928T033358_reco_stage1.root"
===================================================================================================================================
TimeTracker printout (sec) Min Avg Max Median RMS nEvts
===================================================================================================================================
Full event 0.496965 0.510952 0.540268 0.505724 0.0111505 39
-----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read) 0.000155874 0.000251246 0.00135972 0.000199715 0.000214612 39
produce:fembfilter:PDHDFEMBFilter 0.495874 0.509389 0.534017 0.50438 0.0104943 39
[art]:TriggerResults:TriggerResultInserter 3.0401e-05 3.92141e-05 7.7632e-05 3.8071e-05 8.79915e-06 39
end_path:out1:RootOutput 3.46e-06 5.11705e-06 1.4321e-05 4.15e-06 1.91529e-06 39
end_path:michelremoving:michelremoving 9.21e-06 2.60601e-05 0.000342278 1.191e-05 5.747e-05 39
end_path:michelremovinggnocchi:michelremoving 3.111e-06 5.18944e-06 6.1822e-05 3.49e-06 9.20414e-06 39
end_path:calibanagnocchi:CalibAnaTree 2.87e-06 5.59462e-06 5.9061e-05 3.361e-06 9.27161e-06 39
end_path:out1:RootOutput(write) 0.000464052 0.000858153 0.00432749 0.000551274 0.000718564 39
===================================================================================================================================
====================================================================================================
MemoryTracker summary (base-10 MB units used)
Peak virtual memory usage (VmPeak) : 3676.95 MB
Peak resident set size usage (VmHWM): 1272.85 MB
Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029382_0042_dataflow1_datawriter_0_20240928T033358_reco_stage1_reco_stage2_20240928T043031_keepup.root
\tHists: np04hd_raw_run029382_0042_dataflow1_datawriter_0_20240928T033358_reco_stage1_reco_stage2_20240928T043031_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029382_0042_dataflow1_datawriter_0_20240928T033358_reco_stage1_reco_stage2_20240928T043031_keepup.root
Ran successfully
{
"name": "np04hd_raw_run029382_0042_dataflow1_datawriter_0_20240928T033358_reco_stage1_reco_stage2_20240928T043031_keepup.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "artroot",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "full-reconstructed",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727497781.0,
"core.end_time": 1727497831.0,
"core.events": [
3277,
3279,
3281,
3283,
3285,
3287,
3289,
3291,
3293,
3295,
3297,
3299,
3301,
3303,
3305,
3307,
3309,
3311,
3313,
3315,
3317,
3319,
3321,
3323,
3325,
3327,
3329,
3331,
3333,
3335,
3337,
3339,
3341,
3343,
3345,
3347,
3349,
3351,
3353
],
"core.event_count": 39,
"core.first_event_number": 3277,
"core.last_event_number": 3353,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29382
],
"core.runs_subruns": [
2938200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029382_0042_dataflow1_datawriter_0_20240928T033358.hdf5"
}
]
}Forming hist metadata
formed
{
"name": "np04hd_raw_run029382_0042_dataflow1_datawriter_0_20240928T033358_reco_stage1_reco_stage2_20240928T043031_keepup_hists.root",
"namespace": "hd-protodune-det-reco",
"metadata": {
"core.file_format": "root",
"core.application.name": "reco",
"core.application.family": "dunesw",
"core.application.version": "v09_91_02d01",
"core.data_tier": "root-tuple-virtual",
"dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
"dune.campaign": "hd-protodune-reco-keepup-v0",
"core.start_time": 1727497781.0,
"core.end_time": 1727497831.0,
"core.data_stream": "cosmics",
"core.file_content_status": "good",
"core.file_type": "detector",
"core.run_type": "hd-protodune",
"core.runs": [
29382
],
"core.runs_subruns": [
2938200001
],
"dune.daq_test": false,
"retention.status": "active",
"retention.class": "physics",
"origin.applications.config_files": {
"reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
},
"origin.applications.versions": {
"reco1": "v09_91_02d01"
},
"origin.applications.names": [
"reco1"
]
},
"parents": [
{
"did": "hd-protodune:np04hd_raw_run029382_0042_dataflow1_datawriter_0_20240928T033358.hdf5"
}
]
}