justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264652.3@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID264652.3@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3520
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 04:39:46
SiteUK_RAL-Tier1
EntryLIGO_UK_RAL_arc_ce04
Last heartbeat2024-09-27 04:56:19
From worker nodeHostnamedune001-2298645.0-lcg2607.gridpp.rl.ac.uk
cpuinfoAMD EPYC 7763 64-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 04:41:17
Input fileshd-protodune:np04hd_raw_run029350_0073_dataflow0_datawriter_0_20240927T034804.hdf5
JobscriptExit code0
Real time13m (817s)
CPU time5m (349s = 42%)
Outputting started2024-09-27 04:54:55
Output fileshd-protodune-det-reco:np04hd_raw_run029350_0073_dataflow0_datawriter_0_20240927T034804_reco_stage1_reco_stage2_20240927T045441_keepup.root
hd-protodune-det-reco:np04hd_raw_run029350_0073_dataflow0_datawriter_0_20240927T034804_reco_stage1_reco_stage2_20240927T045441_keepup_hists.root
Finished2024-09-27 04:56:19
Saved logsjustin-logs:264652.3-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

d. run: 29350 subRun: 1 event: 5696 at 27-Sep-2024 04:54:07 UTC
27-Sep-2024 04:54:08 UTC  Opened output file with pattern "%ifb_reco_stage2_%tc_keepup.root"
Begin processing the 2nd record. run: 29350 subRun: 1 event: 5698 at 27-Sep-2024 04:54:09 UTC
Begin processing the 3rd record. run: 29350 subRun: 1 event: 5700 at 27-Sep-2024 04:54:10 UTC
Begin processing the 4th record. run: 29350 subRun: 1 event: 5702 at 27-Sep-2024 04:54:11 UTC
Begin processing the 5th record. run: 29350 subRun: 1 event: 5704 at 27-Sep-2024 04:54:12 UTC
Begin processing the 6th record. run: 29350 subRun: 1 event: 5706 at 27-Sep-2024 04:54:13 UTC
Begin processing the 7th record. run: 29350 subRun: 1 event: 5708 at 27-Sep-2024 04:54:14 UTC
Begin processing the 8th record. run: 29350 subRun: 1 event: 5710 at 27-Sep-2024 04:54:14 UTC
Begin processing the 9th record. run: 29350 subRun: 1 event: 5712 at 27-Sep-2024 04:54:15 UTC
Begin processing the 10th record. run: 29350 subRun: 1 event: 5714 at 27-Sep-2024 04:54:16 UTC
Begin processing the 11th record. run: 29350 subRun: 1 event: 5716 at 27-Sep-2024 04:54:17 UTC
Begin processing the 12th record. run: 29350 subRun: 1 event: 5718 at 27-Sep-2024 04:54:18 UTC
Begin processing the 13th record. run: 29350 subRun: 1 event: 5720 at 27-Sep-2024 04:54:19 UTC
Begin processing the 14th record. run: 29350 subRun: 1 event: 5722 at 27-Sep-2024 04:54:19 UTC
Begin processing the 15th record. run: 29350 subRun: 1 event: 5724 at 27-Sep-2024 04:54:20 UTC
Begin processing the 16th record. run: 29350 subRun: 1 event: 5726 at 27-Sep-2024 04:54:21 UTC
Begin processing the 17th record. run: 29350 subRun: 1 event: 5728 at 27-Sep-2024 04:54:22 UTC
Begin processing the 18th record. run: 29350 subRun: 1 event: 5730 at 27-Sep-2024 04:54:23 UTC
Begin processing the 19th record. run: 29350 subRun: 1 event: 5732 at 27-Sep-2024 04:54:23 UTC
Begin processing the 20th record. run: 29350 subRun: 1 event: 5734 at 27-Sep-2024 04:54:24 UTC
Begin processing the 21st record. run: 29350 subRun: 1 event: 5736 at 27-Sep-2024 04:54:25 UTC
Begin processing the 22nd record. run: 29350 subRun: 1 event: 5738 at 27-Sep-2024 04:54:26 UTC
Begin processing the 23rd record. run: 29350 subRun: 1 event: 5740 at 27-Sep-2024 04:54:27 UTC
Begin processing the 24th record. run: 29350 subRun: 1 event: 5742 at 27-Sep-2024 04:54:28 UTC
Begin processing the 25th record. run: 29350 subRun: 1 event: 5744 at 27-Sep-2024 04:54:28 UTC
Begin processing the 26th record. run: 29350 subRun: 1 event: 5746 at 27-Sep-2024 04:54:29 UTC
Begin processing the 27th record. run: 29350 subRun: 1 event: 5748 at 27-Sep-2024 04:54:30 UTC
Begin processing the 28th record. run: 29350 subRun: 1 event: 5750 at 27-Sep-2024 04:54:31 UTC
Begin processing the 29th record. run: 29350 subRun: 1 event: 5752 at 27-Sep-2024 04:54:32 UTC
Begin processing the 30th record. run: 29350 subRun: 1 event: 5754 at 27-Sep-2024 04:54:32 UTC
Begin processing the 31st record. run: 29350 subRun: 1 event: 5756 at 27-Sep-2024 04:54:33 UTC
Begin processing the 32nd record. run: 29350 subRun: 1 event: 5758 at 27-Sep-2024 04:54:34 UTC
Begin processing the 33rd record. run: 29350 subRun: 1 event: 5760 at 27-Sep-2024 04:54:35 UTC
Begin processing the 34th record. run: 29350 subRun: 1 event: 5762 at 27-Sep-2024 04:54:36 UTC
Begin processing the 35th record. run: 29350 subRun: 1 event: 5764 at 27-Sep-2024 04:54:36 UTC
Begin processing the 36th record. run: 29350 subRun: 1 event: 5766 at 27-Sep-2024 04:54:37 UTC
Begin processing the 37th record. run: 29350 subRun: 1 event: 5768 at 27-Sep-2024 04:54:38 UTC
Begin processing the 38th record. run: 29350 subRun: 1 event: 5770 at 27-Sep-2024 04:54:39 UTC
Begin processing the 39th record. run: 29350 subRun: 1 event: 5772 at 27-Sep-2024 04:54:40 UTC
27-Sep-2024 04:54:41 UTC  Closed output file "np04hd_raw_run029350_0073_dataflow0_datawriter_0_20240927T034804_reco_stage1_reco_stage2_20240927T045441_keepup.root"
27-Sep-2024 04:54:41 UTC  Closed input file "np04hd_raw_run029350_0073_dataflow0_datawriter_0_20240927T034804_reco_stage1.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.639746      0.810375      0.876859      0.809998      0.033424        39     
-----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                           0.000209076   0.000279215   0.00131108    0.000236887   0.000171211      39     
produce:fembfilter:PDHDFEMBFilter                 0.629622      0.808476      0.873737      0.808414      0.0343178       39     
[art]:TriggerResults:TriggerResultInserter       3.4921e-05    4.46702e-05   0.000133975   3.9401e-05    1.64974e-05      39     
end_path:out1:RootOutput                          3.551e-06    5.09579e-06   2.2421e-05     4.29e-06     3.11769e-06      39     
end_path:michelremoving:michelremoving           1.3291e-05    2.4409e-05    0.000283359   1.6651e-05    4.21723e-05      39     
end_path:michelremovinggnocchi:michelremoving     4.47e-06     1.07659e-05   0.000112723    7.551e-06    1.67983e-05      39     
end_path:calibanagnocchi:CalibAnaTree             4.06e-06     9.96526e-06   0.000104633    6.94e-06     1.55633e-05      39     
end_path:out1:RootOutput(write)                  0.000575738   0.000999704   0.00676443    0.000654531   0.00104243       39     
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3705.53 MB
  Peak resident set size usage (VmHWM): 1283.38 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029350_0073_dataflow0_datawriter_0_20240927T034804_reco_stage1_reco_stage2_20240927T045441_keepup.root
\tHists: np04hd_raw_run029350_0073_dataflow0_datawriter_0_20240927T034804_reco_stage1_reco_stage2_20240927T045441_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029350_0073_dataflow0_datawriter_0_20240927T034804_reco_stage1_reco_stage2_20240927T045441_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029350_0073_dataflow0_datawriter_0_20240927T034804_reco_stage1_reco_stage2_20240927T045441_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727412795.0,
    "core.end_time": 1727412882.0,
    "core.events": [
      5696,
      5698,
      5700,
      5702,
      5704,
      5706,
      5708,
      5710,
      5712,
      5714,
      5716,
      5718,
      5720,
      5722,
      5724,
      5726,
      5728,
      5730,
      5732,
      5734,
      5736,
      5738,
      5740,
      5742,
      5744,
      5746,
      5748,
      5750,
      5752,
      5754,
      5756,
      5758,
      5760,
      5762,
      5764,
      5766,
      5768,
      5770,
      5772
    ],
    "core.event_count": 39,
    "core.first_event_number": 5696,
    "core.last_event_number": 5772,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29350
    ],
    "core.runs_subruns": [
      2935000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029350_0073_dataflow0_datawriter_0_20240927T034804.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029350_0073_dataflow0_datawriter_0_20240927T034804_reco_stage1_reco_stage2_20240927T045441_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727412795.0,
    "core.end_time": 1727412882.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29350
    ],
    "core.runs_subruns": [
      2935000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029350_0073_dataflow0_datawriter_0_20240927T034804.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:31:29 UTC       justIN version: 01.01.08