justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 264615.9@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID264615.9@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3520
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 03:38:55
SiteCERN
EntryCMSHTPC_T2_CH_CERN_ce513
Last heartbeat2024-09-27 03:47:55
From worker nodeHostnameb9p29p2917.cern.ch
cpuinfoAMD EPYC 7302 16-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 03:41:01
Input fileshd-protodune:np04hd_raw_run029350_0067_dataflow1_datawriter_0_20240927T023001.hdf5
JobscriptExit code0
Real time5m (332s)
CPU time4m (278s = 83%)
Outputting started2024-09-27 03:46:34
Output fileshd-protodune-det-reco:np04hd_raw_run029350_0067_dataflow1_datawriter_0_20240927T023001_reco_stage1_reco_stage2_20240927T034624_keepup.root
hd-protodune-det-reco:np04hd_raw_run029350_0067_dataflow1_datawriter_0_20240927T023001_reco_stage1_reco_stage2_20240927T034624_keepup_hists.root
Finished2024-09-27 03:47:55
Saved logsjustin-logs:264615.9-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Sep-2024 05:45:59 CEST
27-Sep-2024 05:46:00 CEST  Opened output file with pattern "%ifb_reco_stage2_%tc_keepup.root"
Begin processing the 2nd record. run: 29350 subRun: 1 event: 5229 at 27-Sep-2024 05:46:01 CEST
Begin processing the 3rd record. run: 29350 subRun: 1 event: 5231 at 27-Sep-2024 05:46:02 CEST
Begin processing the 4th record. run: 29350 subRun: 1 event: 5233 at 27-Sep-2024 05:46:02 CEST
Begin processing the 5th record. run: 29350 subRun: 1 event: 5235 at 27-Sep-2024 05:46:03 CEST
Begin processing the 6th record. run: 29350 subRun: 1 event: 5237 at 27-Sep-2024 05:46:04 CEST
Begin processing the 7th record. run: 29350 subRun: 1 event: 5239 at 27-Sep-2024 05:46:04 CEST
Begin processing the 8th record. run: 29350 subRun: 1 event: 5241 at 27-Sep-2024 05:46:05 CEST
Begin processing the 9th record. run: 29350 subRun: 1 event: 5243 at 27-Sep-2024 05:46:05 CEST
Begin processing the 10th record. run: 29350 subRun: 1 event: 5245 at 27-Sep-2024 05:46:06 CEST
Begin processing the 11th record. run: 29350 subRun: 1 event: 5247 at 27-Sep-2024 05:46:06 CEST
Begin processing the 12th record. run: 29350 subRun: 1 event: 5249 at 27-Sep-2024 05:46:07 CEST
Begin processing the 13th record. run: 29350 subRun: 1 event: 5251 at 27-Sep-2024 05:46:07 CEST
Begin processing the 14th record. run: 29350 subRun: 1 event: 5253 at 27-Sep-2024 05:46:08 CEST
Begin processing the 15th record. run: 29350 subRun: 1 event: 5255 at 27-Sep-2024 05:46:08 CEST
Begin processing the 16th record. run: 29350 subRun: 1 event: 5257 at 27-Sep-2024 05:46:09 CEST
Begin processing the 17th record. run: 29350 subRun: 1 event: 5259 at 27-Sep-2024 05:46:10 CEST
Begin processing the 18th record. run: 29350 subRun: 1 event: 5261 at 27-Sep-2024 05:46:10 CEST
Begin processing the 19th record. run: 29350 subRun: 1 event: 5263 at 27-Sep-2024 05:46:11 CEST
Begin processing the 20th record. run: 29350 subRun: 1 event: 5265 at 27-Sep-2024 05:46:11 CEST
Begin processing the 21st record. run: 29350 subRun: 1 event: 5267 at 27-Sep-2024 05:46:12 CEST
Begin processing the 22nd record. run: 29350 subRun: 1 event: 5269 at 27-Sep-2024 05:46:12 CEST
Begin processing the 23rd record. run: 29350 subRun: 1 event: 5271 at 27-Sep-2024 05:46:13 CEST
Begin processing the 24th record. run: 29350 subRun: 1 event: 5273 at 27-Sep-2024 05:46:13 CEST
Begin processing the 25th record. run: 29350 subRun: 1 event: 5275 at 27-Sep-2024 05:46:14 CEST
Begin processing the 26th record. run: 29350 subRun: 1 event: 5277 at 27-Sep-2024 05:46:14 CEST
Begin processing the 27th record. run: 29350 subRun: 1 event: 5279 at 27-Sep-2024 05:46:15 CEST
Begin processing the 28th record. run: 29350 subRun: 1 event: 5281 at 27-Sep-2024 05:46:16 CEST
Begin processing the 29th record. run: 29350 subRun: 1 event: 5283 at 27-Sep-2024 05:46:16 CEST
Begin processing the 30th record. run: 29350 subRun: 1 event: 5285 at 27-Sep-2024 05:46:17 CEST
Begin processing the 31st record. run: 29350 subRun: 1 event: 5287 at 27-Sep-2024 05:46:17 CEST
Begin processing the 32nd record. run: 29350 subRun: 1 event: 5289 at 27-Sep-2024 05:46:18 CEST
Begin processing the 33rd record. run: 29350 subRun: 1 event: 5291 at 27-Sep-2024 05:46:19 CEST
Begin processing the 34th record. run: 29350 subRun: 1 event: 5293 at 27-Sep-2024 05:46:20 CEST
Begin processing the 35th record. run: 29350 subRun: 1 event: 5295 at 27-Sep-2024 05:46:20 CEST
Begin processing the 36th record. run: 29350 subRun: 1 event: 5297 at 27-Sep-2024 05:46:21 CEST
Begin processing the 37th record. run: 29350 subRun: 1 event: 5299 at 27-Sep-2024 05:46:21 CEST
Begin processing the 38th record. run: 29350 subRun: 1 event: 5301 at 27-Sep-2024 05:46:22 CEST
Begin processing the 39th record. run: 29350 subRun: 1 event: 5303 at 27-Sep-2024 05:46:23 CEST
27-Sep-2024 05:46:24 CEST  Closed output file "np04hd_raw_run029350_0067_dataflow1_datawriter_0_20240927T023001_reco_stage1_reco_stage2_20240927T034624_keepup.root"
27-Sep-2024 05:46:24 CEST  Closed input file "np04hd_raw_run029350_0067_dataflow1_datawriter_0_20240927T023001_reco_stage1.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.510347      0.589411      0.853654      0.554978      0.0816687       39     
-----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                           0.000157542   0.000239608   0.00121652    0.000201293   0.000176633      39     
produce:fembfilter:PDHDFEMBFilter                 0.509233      0.587936      0.852473      0.553637      0.0813095       39     
[art]:TriggerResults:TriggerResultInserter       3.1031e-05    3.99404e-05   0.000107072   3.5341e-05    1.32998e-05      39     
end_path:out1:RootOutput                           3.1e-06     5.12723e-06    3.122e-05     3.66e-06     5.09978e-06      39     
end_path:michelremoving:michelremoving            1.051e-05    1.8988e-05    0.000246704    1.208e-05    3.69985e-05      39     
end_path:michelremovinggnocchi:michelremoving      2.9e-06     7.06295e-06   0.000115352    3.67e-06     1.7639e-05       39     
end_path:calibanagnocchi:CalibAnaTree             2.86e-06     6.12523e-06   9.0831e-05     3.59e-06     1.37812e-05      39     
end_path:out1:RootOutput(write)                  0.000470788   0.00074441    0.00460679    0.000603959   0.000661803      39     
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3641.06 MB
  Peak resident set size usage (VmHWM): 1277.13 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029350_0067_dataflow1_datawriter_0_20240927T023001_reco_stage1_reco_stage2_20240927T034624_keepup.root
\tHists: np04hd_raw_run029350_0067_dataflow1_datawriter_0_20240927T023001_reco_stage1_reco_stage2_20240927T034624_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029350_0067_dataflow1_datawriter_0_20240927T023001_reco_stage1_reco_stage2_20240927T034624_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029350_0067_dataflow1_datawriter_0_20240927T023001_reco_stage1_reco_stage2_20240927T034624_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727408723.0,
    "core.end_time": 1727408784.0,
    "core.events": [
      5227,
      5229,
      5231,
      5233,
      5235,
      5237,
      5239,
      5241,
      5243,
      5245,
      5247,
      5249,
      5251,
      5253,
      5255,
      5257,
      5259,
      5261,
      5263,
      5265,
      5267,
      5269,
      5271,
      5273,
      5275,
      5277,
      5279,
      5281,
      5283,
      5285,
      5287,
      5289,
      5291,
      5293,
      5295,
      5297,
      5299,
      5301,
      5303
    ],
    "core.event_count": 39,
    "core.first_event_number": 5227,
    "core.last_event_number": 5303,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29350
    ],
    "core.runs_subruns": [
      2935000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029350_0067_dataflow1_datawriter_0_20240927T023001.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029350_0067_dataflow1_datawriter_0_20240927T023001_reco_stage1_reco_stage2_20240927T034624_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727408723.0,
    "core.end_time": 1727408784.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29350
    ],
    "core.runs_subruns": [
      2935000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029350_0067_dataflow1_datawriter_0_20240927T023001.hdf5"
    }
  ]
}
justIN time: 2024-09-29 11:31:33 UTC       justIN version: 01.01.08