justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265592.13@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID265592.13@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3531
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-28 02:15:08
SiteUK_Liverpool
EntryDUNE_UK_Liverpool_hepgrid5
Last heartbeat2024-09-28 02:43:51
From worker nodeHostnamer12-n05.ph.liv.ac.uk
cpuinfoAMD EPYC 7453 28-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit259200 (72 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-28 02:16:59
Input fileshd-protodune:np04hd_raw_run029382_0034_dataflow0_datawriter_0_20240928T015012.hdf5
JobscriptExit code0
Real time25m (1536s)
CPU time4m (269s = 17%)
Outputting started2024-09-28 02:42:36
Output fileshd-protodune-det-reco:np04hd_raw_run029382_0034_dataflow0_datawriter_0_20240928T015012_reco_stage1_reco_stage2_20240928T024221_keepup.root
hd-protodune-det-reco:np04hd_raw_run029382_0034_dataflow0_datawriter_0_20240928T015012_reco_stage1_reco_stage2_20240928T024221_keepup_hists.root
Finished2024-09-28 02:43:51
Saved logsjustin-logs:265592.13-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

d. run: 29382 subRun: 1 event: 2654 at 28-Sep-2024 03:41:58 BST
28-Sep-2024 03:41:59 BST  Opened output file with pattern "%ifb_reco_stage2_%tc_keepup.root"
Begin processing the 2nd record. run: 29382 subRun: 1 event: 2656 at 28-Sep-2024 03:42:01 BST
Begin processing the 3rd record. run: 29382 subRun: 1 event: 2658 at 28-Sep-2024 03:42:01 BST
Begin processing the 4th record. run: 29382 subRun: 1 event: 2660 at 28-Sep-2024 03:42:02 BST
Begin processing the 5th record. run: 29382 subRun: 1 event: 2662 at 28-Sep-2024 03:42:02 BST
Begin processing the 6th record. run: 29382 subRun: 1 event: 2664 at 28-Sep-2024 03:42:03 BST
Begin processing the 7th record. run: 29382 subRun: 1 event: 2666 at 28-Sep-2024 03:42:03 BST
Begin processing the 8th record. run: 29382 subRun: 1 event: 2668 at 28-Sep-2024 03:42:04 BST
Begin processing the 9th record. run: 29382 subRun: 1 event: 2670 at 28-Sep-2024 03:42:04 BST
Begin processing the 10th record. run: 29382 subRun: 1 event: 2672 at 28-Sep-2024 03:42:05 BST
Begin processing the 11th record. run: 29382 subRun: 1 event: 2674 at 28-Sep-2024 03:42:05 BST
Begin processing the 12th record. run: 29382 subRun: 1 event: 2676 at 28-Sep-2024 03:42:06 BST
Begin processing the 13th record. run: 29382 subRun: 1 event: 2678 at 28-Sep-2024 03:42:06 BST
Begin processing the 14th record. run: 29382 subRun: 1 event: 2680 at 28-Sep-2024 03:42:07 BST
Begin processing the 15th record. run: 29382 subRun: 1 event: 2682 at 28-Sep-2024 03:42:07 BST
Begin processing the 16th record. run: 29382 subRun: 1 event: 2684 at 28-Sep-2024 03:42:08 BST
Begin processing the 17th record. run: 29382 subRun: 1 event: 2686 at 28-Sep-2024 03:42:08 BST
Begin processing the 18th record. run: 29382 subRun: 1 event: 2688 at 28-Sep-2024 03:42:09 BST
Begin processing the 19th record. run: 29382 subRun: 1 event: 2690 at 28-Sep-2024 03:42:09 BST
Begin processing the 20th record. run: 29382 subRun: 1 event: 2692 at 28-Sep-2024 03:42:10 BST
Begin processing the 21st record. run: 29382 subRun: 1 event: 2694 at 28-Sep-2024 03:42:11 BST
Begin processing the 22nd record. run: 29382 subRun: 1 event: 2696 at 28-Sep-2024 03:42:11 BST
Begin processing the 23rd record. run: 29382 subRun: 1 event: 2698 at 28-Sep-2024 03:42:12 BST
Begin processing the 24th record. run: 29382 subRun: 1 event: 2700 at 28-Sep-2024 03:42:12 BST
Begin processing the 25th record. run: 29382 subRun: 1 event: 2702 at 28-Sep-2024 03:42:13 BST
Begin processing the 26th record. run: 29382 subRun: 1 event: 2704 at 28-Sep-2024 03:42:13 BST
Begin processing the 27th record. run: 29382 subRun: 1 event: 2706 at 28-Sep-2024 03:42:14 BST
Begin processing the 28th record. run: 29382 subRun: 1 event: 2708 at 28-Sep-2024 03:42:14 BST
Begin processing the 29th record. run: 29382 subRun: 1 event: 2710 at 28-Sep-2024 03:42:15 BST
Begin processing the 30th record. run: 29382 subRun: 1 event: 2712 at 28-Sep-2024 03:42:15 BST
Begin processing the 31st record. run: 29382 subRun: 1 event: 2714 at 28-Sep-2024 03:42:16 BST
Begin processing the 32nd record. run: 29382 subRun: 1 event: 2716 at 28-Sep-2024 03:42:16 BST
Begin processing the 33rd record. run: 29382 subRun: 1 event: 2718 at 28-Sep-2024 03:42:17 BST
Begin processing the 34th record. run: 29382 subRun: 1 event: 2720 at 28-Sep-2024 03:42:17 BST
Begin processing the 35th record. run: 29382 subRun: 1 event: 2722 at 28-Sep-2024 03:42:18 BST
Begin processing the 36th record. run: 29382 subRun: 1 event: 2724 at 28-Sep-2024 03:42:18 BST
Begin processing the 37th record. run: 29382 subRun: 1 event: 2726 at 28-Sep-2024 03:42:19 BST
Begin processing the 38th record. run: 29382 subRun: 1 event: 2728 at 28-Sep-2024 03:42:19 BST
Begin processing the 39th record. run: 29382 subRun: 1 event: 2730 at 28-Sep-2024 03:42:20 BST
28-Sep-2024 03:42:21 BST  Closed output file "np04hd_raw_run029382_0034_dataflow0_datawriter_0_20240928T015012_reco_stage1_reco_stage2_20240928T024221_keepup.root"
28-Sep-2024 03:42:21 BST  Closed input file "np04hd_raw_run029382_0034_dataflow0_datawriter_0_20240928T015012_reco_stage1.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.454545      0.511779      0.630721      0.502074      0.052617        39     
-----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                           0.000187201   0.000254684    0.0011771    0.000220204   0.000153876      39     
produce:fembfilter:PDHDFEMBFilter                 0.453472       0.51036      0.629052      0.501031      0.0525252       39     
[art]:TriggerResults:TriggerResultInserter       3.6218e-05    4.5353e-05    0.000135064   4.1778e-05    1.52466e-05      39     
end_path:out1:RootOutput                          3.908e-06    5.29964e-06   2.4285e-05     4.629e-06    3.23241e-06      39     
end_path:michelremoving:michelremoving           1.2103e-05    2.30534e-05   0.000293331    1.58e-05     4.39023e-05      39     
end_path:michelremovinggnocchi:michelremoving     3.056e-06    5.43721e-06   6.5113e-05     3.667e-06    9.72658e-06      39     
end_path:calibanagnocchi:CalibAnaTree             2.304e-06    4.12767e-06   4.6527e-05     2.675e-06    6.96815e-06      39     
end_path:out1:RootOutput(write)                  0.000481435   0.000739355   0.00517609    0.000560192   0.000741761      39     
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3630.08 MB
  Peak resident set size usage (VmHWM): 1043.89 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029382_0034_dataflow0_datawriter_0_20240928T015012_reco_stage1_reco_stage2_20240928T024221_keepup.root
\tHists: np04hd_raw_run029382_0034_dataflow0_datawriter_0_20240928T015012_reco_stage1_reco_stage2_20240928T024221_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029382_0034_dataflow0_datawriter_0_20240928T015012_reco_stage1_reco_stage2_20240928T024221_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029382_0034_dataflow0_datawriter_0_20240928T015012_reco_stage1_reco_stage2_20240928T024221_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727491273.0,
    "core.end_time": 1727491341.0,
    "core.events": [
      2654,
      2656,
      2658,
      2660,
      2662,
      2664,
      2666,
      2668,
      2670,
      2672,
      2674,
      2676,
      2678,
      2680,
      2682,
      2684,
      2686,
      2688,
      2690,
      2692,
      2694,
      2696,
      2698,
      2700,
      2702,
      2704,
      2706,
      2708,
      2710,
      2712,
      2714,
      2716,
      2718,
      2720,
      2722,
      2724,
      2726,
      2728,
      2730
    ],
    "core.event_count": 39,
    "core.first_event_number": 2654,
    "core.last_event_number": 2730,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29382
    ],
    "core.runs_subruns": [
      2938200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029382_0034_dataflow0_datawriter_0_20240928T015012.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029382_0034_dataflow0_datawriter_0_20240928T015012_reco_stage1_reco_stage2_20240928T024221_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727491273.0,
    "core.end_time": 1727491341.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29382
    ],
    "core.runs_subruns": [
      2938200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029382_0034_dataflow0_datawriter_0_20240928T015012.hdf5"
    }
  ]
}
justIN time: 2024-11-17 03:18:35 UTC       justIN version: 01.01.09