justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 79441.128@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID79441.128@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3493
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-26 17:22:10
SiteUS_BNL
EntryDUNE_US_BNL_sp02
Last heartbeat2024-09-26 18:39:29
From worker nodeHostnamespool1505.sdcc.bnl.gov
cpuinfoIntel(R) Xeon(R) Gold 6336Y CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?False
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-26 17:44:35
Input fileshd-protodune:np04hd_raw_run027307_0001_dataflow3_datawriter_0_20240619T180606.hdf5
Outputting started2024-09-26 17:54:08
Output files
Finished2024-09-26 18:39:29
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

bRun: 1 event: 247 at 26-Sep-2024 17:53:36 UTC
Begin processing the 9th record. run: 27307 subRun: 1 event: 251 at 26-Sep-2024 17:53:36 UTC
Begin processing the 10th record. run: 27307 subRun: 1 event: 255 at 26-Sep-2024 17:53:37 UTC
Begin processing the 11th record. run: 27307 subRun: 1 event: 259 at 26-Sep-2024 17:53:38 UTC
Begin processing the 12th record. run: 27307 subRun: 1 event: 263 at 26-Sep-2024 17:53:38 UTC
Begin processing the 13th record. run: 27307 subRun: 1 event: 267 at 26-Sep-2024 17:53:39 UTC
Begin processing the 14th record. run: 27307 subRun: 1 event: 271 at 26-Sep-2024 17:53:39 UTC
Begin processing the 15th record. run: 27307 subRun: 1 event: 275 at 26-Sep-2024 17:53:40 UTC
Begin processing the 16th record. run: 27307 subRun: 1 event: 279 at 26-Sep-2024 17:53:41 UTC
Begin processing the 17th record. run: 27307 subRun: 1 event: 283 at 26-Sep-2024 17:53:41 UTC
Begin processing the 18th record. run: 27307 subRun: 1 event: 287 at 26-Sep-2024 17:53:43 UTC
Begin processing the 19th record. run: 27307 subRun: 1 event: 291 at 26-Sep-2024 17:53:43 UTC
Begin processing the 20th record. run: 27307 subRun: 1 event: 295 at 26-Sep-2024 17:53:44 UTC
Begin processing the 21st record. run: 27307 subRun: 1 event: 299 at 26-Sep-2024 17:53:45 UTC
Begin processing the 22nd record. run: 27307 subRun: 1 event: 303 at 26-Sep-2024 17:53:46 UTC
Begin processing the 23rd record. run: 27307 subRun: 1 event: 307 at 26-Sep-2024 17:53:46 UTC
Begin processing the 24th record. run: 27307 subRun: 1 event: 311 at 26-Sep-2024 17:53:47 UTC
Begin processing the 25th record. run: 27307 subRun: 1 event: 315 at 26-Sep-2024 17:53:47 UTC
Begin processing the 26th record. run: 27307 subRun: 1 event: 319 at 26-Sep-2024 17:53:47 UTC
Begin processing the 27th record. run: 27307 subRun: 1 event: 323 at 26-Sep-2024 17:53:48 UTC
Begin processing the 28th record. run: 27307 subRun: 1 event: 327 at 26-Sep-2024 17:53:48 UTC
Begin processing the 29th record. run: 27307 subRun: 1 event: 331 at 26-Sep-2024 17:53:49 UTC
Begin processing the 30th record. run: 27307 subRun: 1 event: 335 at 26-Sep-2024 17:53:49 UTC
Begin processing the 31st record. run: 27307 subRun: 1 event: 339 at 26-Sep-2024 17:53:49 UTC
Begin processing the 32nd record. run: 27307 subRun: 1 event: 343 at 26-Sep-2024 17:53:50 UTC
Begin processing the 33rd record. run: 27307 subRun: 1 event: 347 at 26-Sep-2024 17:53:50 UTC
Begin processing the 34th record. run: 27307 subRun: 1 event: 351 at 26-Sep-2024 17:53:50 UTC
Begin processing the 35th record. run: 27307 subRun: 1 event: 355 at 26-Sep-2024 17:53:50 UTC
Begin processing the 36th record. run: 27307 subRun: 1 event: 359 at 26-Sep-2024 17:53:51 UTC
Begin processing the 37th record. run: 27307 subRun: 1 event: 363 at 26-Sep-2024 17:53:51 UTC
Begin processing the 38th record. run: 27307 subRun: 1 event: 367 at 26-Sep-2024 17:53:51 UTC
Begin processing the 39th record. run: 27307 subRun: 1 event: 371 at 26-Sep-2024 17:53:52 UTC
Begin processing the 40th record. run: 27307 subRun: 1 event: 375 at 26-Sep-2024 17:53:52 UTC
Begin processing the 41st record. run: 27307 subRun: 1 event: 379 at 26-Sep-2024 17:53:52 UTC
Begin processing the 42nd record. run: 27307 subRun: 1 event: 383 at 26-Sep-2024 17:53:53 UTC
Begin processing the 43rd record. run: 27307 subRun: 1 event: 387 at 26-Sep-2024 17:53:53 UTC
Begin processing the 44th record. run: 27307 subRun: 1 event: 391 at 26-Sep-2024 17:53:53 UTC
Begin processing the 45th record. run: 27307 subRun: 1 event: 395 at 26-Sep-2024 17:53:53 UTC
Begin processing the 46th record. run: 27307 subRun: 1 event: 399 at 26-Sep-2024 17:53:54 UTC
Begin processing the 47th record. run: 27307 subRun: 1 event: 403 at 26-Sep-2024 17:53:54 UTC
26-Sep-2024 17:53:55 UTC  Closed output file "np04hd_raw_run027307_0001_dataflow3_datawriter_0_20240619T180606_reco_stage1_reco_stage2_20240926T175355_keepup.root"
26-Sep-2024 17:53:55 UTC  Closed input file "np04hd_raw_run027307_0001_dataflow3_datawriter_0_20240619T180606_reco_stage1.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.262522      0.484438       1.46612      0.429551      0.225239        47     
-----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                           0.000171584   0.000214305   0.000783362   0.000196571   8.61006e-05      47     
produce:fembfilter:PDHDFEMBFilter                 0.261458      0.483199       1.46502      0.428479      0.225155        47     
[art]:TriggerResults:TriggerResultInserter       3.3417e-05    3.88795e-05    9.827e-05    3.6525e-05    9.81259e-06      47     
end_path:out1:RootOutput                          2.659e-06    3.59372e-06   1.5051e-05     3.175e-06    1.91734e-06      47     
end_path:michelremoving:michelremoving           1.1935e-05    1.82537e-05   0.000200903   1.3892e-05    2.70107e-05      47     
end_path:michelremovinggnocchi:michelremoving     2.756e-06    4.31772e-06   5.6576e-05     3.08e-06      7.714e-06       47     
end_path:calibanagnocchi:CalibAnaTree             2.464e-06    3.85174e-06   5.0904e-05     2.715e-06    6.94975e-06      47     
end_path:out1:RootOutput(write)                  0.000487098   0.000647761   0.00357001    0.000530661   0.000451496      47     
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3907.83 MB
  Peak resident set size usage (VmHWM): 1304.92 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027307_0001_dataflow3_datawriter_0_20240619T180606_reco_stage1_reco_stage2_20240926T175355_keepup.root
\tHists: np04hd_raw_run027307_0001_dataflow3_datawriter_0_20240619T180606_reco_stage1_reco_stage2_20240926T175355_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027307_0001_dataflow3_datawriter_0_20240619T180606_reco_stage1_reco_stage2_20240926T175355_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027307_0001_dataflow3_datawriter_0_20240619T180606_reco_stage1_reco_stage2_20240926T175355_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727373180.0,
    "core.end_time": 1727373235.0,
    "core.events": [
      219,
      223,
      227,
      231,
      235,
      239,
      243,
      247,
      251,
      255,
      259,
      263,
      267,
      271,
      275,
      279,
      283,
      287,
      291,
      295,
      299,
      303,
      307,
      311,
      315,
      319,
      323,
      327,
      331,
      335,
      339,
      343,
      347,
      351,
      355,
      359,
      363,
      367,
      371,
      375,
      379,
      383,
      387,
      391,
      395,
      399,
      403
    ],
    "core.event_count": 47,
    "core.first_event_number": 219,
    "core.last_event_number": 403,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27307
    ],
    "core.runs_subruns": [
      2730700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027307_0001_dataflow3_datawriter_0_20240619T180606.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027307_0001_dataflow3_datawriter_0_20240619T180606_reco_stage1_reco_stage2_20240926T175355_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727373180.0,
    "core.end_time": 1727373235.0,
    "core.data_stream": "physics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27307
    ],
    "core.runs_subruns": [
      2730700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027307_0001_dataflow3_datawriter_0_20240619T180606.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:34:36 UTC       justIN version: 01.01.08