justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265678.7@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID265678.7@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3531
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-28 04:18:47
SiteUK_Liverpool
EntryDUNE_UK_Liverpool_hepgrid5
Last heartbeat2024-09-28 05:00:45
From worker nodeHostnamer21-n08.ph.liv.ac.uk
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit259200 (72 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-28 04:21:08
Input fileshd-protodune:np04hd_raw_run029382_0041_dataflow0_datawriter_0_20240928T032118.hdf5
JobscriptExit code0
Real time38m (2313s)
CPU time3m (239s = 10%)
Outputting started2024-09-28 04:59:42
Output fileshd-protodune-det-reco:np04hd_raw_run029382_0041_dataflow0_datawriter_0_20240928T032118_reco_stage1_reco_stage2_20240928T045927_keepup.root
hd-protodune-det-reco:np04hd_raw_run029382_0041_dataflow0_datawriter_0_20240928T032118_reco_stage1_reco_stage2_20240928T045927_keepup_hists.root
Finished2024-09-28 05:00:45
Saved logsjustin-logs:265678.7-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

d. run: 29382 subRun: 1 event: 3200 at 28-Sep-2024 05:59:08 BST
28-Sep-2024 05:59:08 BST  Opened output file with pattern "%ifb_reco_stage2_%tc_keepup.root"
Begin processing the 2nd record. run: 29382 subRun: 1 event: 3202 at 28-Sep-2024 05:59:10 BST
Begin processing the 3rd record. run: 29382 subRun: 1 event: 3204 at 28-Sep-2024 05:59:10 BST
Begin processing the 4th record. run: 29382 subRun: 1 event: 3206 at 28-Sep-2024 05:59:11 BST
Begin processing the 5th record. run: 29382 subRun: 1 event: 3208 at 28-Sep-2024 05:59:11 BST
Begin processing the 6th record. run: 29382 subRun: 1 event: 3210 at 28-Sep-2024 05:59:12 BST
Begin processing the 7th record. run: 29382 subRun: 1 event: 3212 at 28-Sep-2024 05:59:12 BST
Begin processing the 8th record. run: 29382 subRun: 1 event: 3214 at 28-Sep-2024 05:59:13 BST
Begin processing the 9th record. run: 29382 subRun: 1 event: 3216 at 28-Sep-2024 05:59:13 BST
Begin processing the 10th record. run: 29382 subRun: 1 event: 3218 at 28-Sep-2024 05:59:13 BST
Begin processing the 11th record. run: 29382 subRun: 1 event: 3220 at 28-Sep-2024 05:59:14 BST
Begin processing the 12th record. run: 29382 subRun: 1 event: 3222 at 28-Sep-2024 05:59:14 BST
Begin processing the 13th record. run: 29382 subRun: 1 event: 3224 at 28-Sep-2024 05:59:15 BST
Begin processing the 14th record. run: 29382 subRun: 1 event: 3226 at 28-Sep-2024 05:59:15 BST
Begin processing the 15th record. run: 29382 subRun: 1 event: 3228 at 28-Sep-2024 05:59:16 BST
Begin processing the 16th record. run: 29382 subRun: 1 event: 3230 at 28-Sep-2024 05:59:16 BST
Begin processing the 17th record. run: 29382 subRun: 1 event: 3232 at 28-Sep-2024 05:59:16 BST
Begin processing the 18th record. run: 29382 subRun: 1 event: 3234 at 28-Sep-2024 05:59:17 BST
Begin processing the 19th record. run: 29382 subRun: 1 event: 3236 at 28-Sep-2024 05:59:17 BST
Begin processing the 20th record. run: 29382 subRun: 1 event: 3238 at 28-Sep-2024 05:59:18 BST
Begin processing the 21st record. run: 29382 subRun: 1 event: 3240 at 28-Sep-2024 05:59:18 BST
Begin processing the 22nd record. run: 29382 subRun: 1 event: 3242 at 28-Sep-2024 05:59:19 BST
Begin processing the 23rd record. run: 29382 subRun: 1 event: 3244 at 28-Sep-2024 05:59:19 BST
Begin processing the 24th record. run: 29382 subRun: 1 event: 3246 at 28-Sep-2024 05:59:19 BST
Begin processing the 25th record. run: 29382 subRun: 1 event: 3248 at 28-Sep-2024 05:59:20 BST
Begin processing the 26th record. run: 29382 subRun: 1 event: 3250 at 28-Sep-2024 05:59:20 BST
Begin processing the 27th record. run: 29382 subRun: 1 event: 3252 at 28-Sep-2024 05:59:21 BST
Begin processing the 28th record. run: 29382 subRun: 1 event: 3254 at 28-Sep-2024 05:59:21 BST
Begin processing the 29th record. run: 29382 subRun: 1 event: 3256 at 28-Sep-2024 05:59:22 BST
Begin processing the 30th record. run: 29382 subRun: 1 event: 3258 at 28-Sep-2024 05:59:22 BST
Begin processing the 31st record. run: 29382 subRun: 1 event: 3260 at 28-Sep-2024 05:59:22 BST
Begin processing the 32nd record. run: 29382 subRun: 1 event: 3262 at 28-Sep-2024 05:59:23 BST
Begin processing the 33rd record. run: 29382 subRun: 1 event: 3264 at 28-Sep-2024 05:59:23 BST
Begin processing the 34th record. run: 29382 subRun: 1 event: 3266 at 28-Sep-2024 05:59:24 BST
Begin processing the 35th record. run: 29382 subRun: 1 event: 3268 at 28-Sep-2024 05:59:24 BST
Begin processing the 36th record. run: 29382 subRun: 1 event: 3270 at 28-Sep-2024 05:59:25 BST
Begin processing the 37th record. run: 29382 subRun: 1 event: 3272 at 28-Sep-2024 05:59:25 BST
Begin processing the 38th record. run: 29382 subRun: 1 event: 3274 at 28-Sep-2024 05:59:26 BST
Begin processing the 39th record. run: 29382 subRun: 1 event: 3276 at 28-Sep-2024 05:59:26 BST
28-Sep-2024 05:59:27 BST  Closed output file "np04hd_raw_run029382_0041_dataflow0_datawriter_0_20240928T032118_reco_stage1_reco_stage2_20240928T045927_keepup.root"
28-Sep-2024 05:59:27 BST  Closed input file "np04hd_raw_run029382_0041_dataflow0_datawriter_0_20240928T032118_reco_stage1.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.422189      0.433748      0.494738      0.428562      0.0164213       39     
-----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                           0.000170159   0.000220761    0.001095     0.000193783   0.000143088      39     
produce:fembfilter:PDHDFEMBFilter                 0.421242      0.432554      0.493745      0.427529      0.0158694       39     
[art]:TriggerResults:TriggerResultInserter       2.8684e-05    3.42676e-05   9.6982e-05    3.2101e-05    1.0429e-05       39     
end_path:out1:RootOutput                          2.324e-06    3.43051e-06    1.579e-05     3.116e-06    2.05992e-06      39     
end_path:michelremoving:michelremoving           1.1011e-05    1.71463e-05   0.000184517   1.2103e-05    2.73425e-05      39     
end_path:michelremovinggnocchi:michelremoving     2.655e-06    4.49092e-06   5.6817e-05     3.076e-06    8.49485e-06      39     
end_path:calibanagnocchi:CalibAnaTree             2.174e-06    3.51521e-06   3.9203e-05     2.524e-06    5.80383e-06      39     
end_path:out1:RootOutput(write)                  0.000442821   0.000625554   0.00499014    0.000471585   0.000713306      39     
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3652.33 MB
  Peak resident set size usage (VmHWM): 1043.18 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029382_0041_dataflow0_datawriter_0_20240928T032118_reco_stage1_reco_stage2_20240928T045927_keepup.root
\tHists: np04hd_raw_run029382_0041_dataflow0_datawriter_0_20240928T032118_reco_stage1_reco_stage2_20240928T045927_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029382_0041_dataflow0_datawriter_0_20240928T032118_reco_stage1_reco_stage2_20240928T045927_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029382_0041_dataflow0_datawriter_0_20240928T032118_reco_stage1_reco_stage2_20240928T045927_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727499505.0,
    "core.end_time": 1727499567.0,
    "core.events": [
      3200,
      3202,
      3204,
      3206,
      3208,
      3210,
      3212,
      3214,
      3216,
      3218,
      3220,
      3222,
      3224,
      3226,
      3228,
      3230,
      3232,
      3234,
      3236,
      3238,
      3240,
      3242,
      3244,
      3246,
      3248,
      3250,
      3252,
      3254,
      3256,
      3258,
      3260,
      3262,
      3264,
      3266,
      3268,
      3270,
      3272,
      3274,
      3276
    ],
    "core.event_count": 39,
    "core.first_event_number": 3200,
    "core.last_event_number": 3276,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29382
    ],
    "core.runs_subruns": [
      2938200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029382_0041_dataflow0_datawriter_0_20240928T032118.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029382_0041_dataflow0_datawriter_0_20240928T032118_reco_stage1_reco_stage2_20240928T045927_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727499505.0,
    "core.end_time": 1727499567.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29382
    ],
    "core.runs_subruns": [
      2938200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029382_0041_dataflow0_datawriter_0_20240928T032118.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:31:17 UTC       justIN version: 01.01.08