justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 80183.13@justin-prod-sched02.dune.hep.ac.uk

Jobsub ID80183.13@justin-prod-sched02.dune.hep.ac.uk
Workflow ID3522
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-27 15:35:44
SiteUK_Sheffield
EntryDUNE_UK_Sheffield_lcgce1
Last heartbeat2024-09-27 16:11:49
From worker nodeHostnamewn085.hep
cpuinfoIntel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit257400 (71 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-27 15:37:29
Input fileshd-protodune:np04hd_raw_run029350_0121_dataflow0_datawriter_0_20240927T141217.hdf5
JobscriptExit code0
Real time18m (1102s)
CPU time5m (335s = 30%)
Outputting started2024-09-27 15:58:17
Output fileshd-protodune-det-reco:np04hd_raw_run029350_0121_dataflow0_datawriter_0_20240927T141217_reco_stage1_reco_stage2_20240927T155543_keepup.root
hd-protodune-det-reco:np04hd_raw_run029350_0121_dataflow0_datawriter_0_20240927T141217_reco_stage1_reco_stage2_20240927T155543_keepup_hists.root
Finished2024-09-27 16:11:49
Saved logsjustin-logs:80183.13-justin-prod-sched02.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

d. run: 29350 subRun: 1 event: 9440 at 27-Sep-2024 16:55:16 BST
27-Sep-2024 16:55:17 BST  Opened output file with pattern "%ifb_reco_stage2_%tc_keepup.root"
Begin processing the 2nd record. run: 29350 subRun: 1 event: 9442 at 27-Sep-2024 16:55:18 BST
Begin processing the 3rd record. run: 29350 subRun: 1 event: 9444 at 27-Sep-2024 16:55:18 BST
Begin processing the 4th record. run: 29350 subRun: 1 event: 9446 at 27-Sep-2024 16:55:19 BST
Begin processing the 5th record. run: 29350 subRun: 1 event: 9448 at 27-Sep-2024 16:55:20 BST
Begin processing the 6th record. run: 29350 subRun: 1 event: 9450 at 27-Sep-2024 16:55:20 BST
Begin processing the 7th record. run: 29350 subRun: 1 event: 9452 at 27-Sep-2024 16:55:21 BST
Begin processing the 8th record. run: 29350 subRun: 1 event: 9454 at 27-Sep-2024 16:55:21 BST
Begin processing the 9th record. run: 29350 subRun: 1 event: 9456 at 27-Sep-2024 16:55:22 BST
Begin processing the 10th record. run: 29350 subRun: 1 event: 9458 at 27-Sep-2024 16:55:23 BST
Begin processing the 11th record. run: 29350 subRun: 1 event: 9460 at 27-Sep-2024 16:55:23 BST
Begin processing the 12th record. run: 29350 subRun: 1 event: 9462 at 27-Sep-2024 16:55:24 BST
Begin processing the 13th record. run: 29350 subRun: 1 event: 9464 at 27-Sep-2024 16:55:25 BST
Begin processing the 14th record. run: 29350 subRun: 1 event: 9466 at 27-Sep-2024 16:55:25 BST
Begin processing the 15th record. run: 29350 subRun: 1 event: 9468 at 27-Sep-2024 16:55:26 BST
Begin processing the 16th record. run: 29350 subRun: 1 event: 9470 at 27-Sep-2024 16:55:27 BST
Begin processing the 17th record. run: 29350 subRun: 1 event: 9472 at 27-Sep-2024 16:55:27 BST
Begin processing the 18th record. run: 29350 subRun: 1 event: 9474 at 27-Sep-2024 16:55:28 BST
Begin processing the 19th record. run: 29350 subRun: 1 event: 9476 at 27-Sep-2024 16:55:29 BST
Begin processing the 20th record. run: 29350 subRun: 1 event: 9478 at 27-Sep-2024 16:55:29 BST
Begin processing the 21st record. run: 29350 subRun: 1 event: 9480 at 27-Sep-2024 16:55:30 BST
Begin processing the 22nd record. run: 29350 subRun: 1 event: 9482 at 27-Sep-2024 16:55:30 BST
Begin processing the 23rd record. run: 29350 subRun: 1 event: 9484 at 27-Sep-2024 16:55:31 BST
Begin processing the 24th record. run: 29350 subRun: 1 event: 9486 at 27-Sep-2024 16:55:32 BST
Begin processing the 25th record. run: 29350 subRun: 1 event: 9488 at 27-Sep-2024 16:55:32 BST
Begin processing the 26th record. run: 29350 subRun: 1 event: 9490 at 27-Sep-2024 16:55:33 BST
Begin processing the 27th record. run: 29350 subRun: 1 event: 9492 at 27-Sep-2024 16:55:34 BST
Begin processing the 28th record. run: 29350 subRun: 1 event: 9494 at 27-Sep-2024 16:55:34 BST
Begin processing the 29th record. run: 29350 subRun: 1 event: 9496 at 27-Sep-2024 16:55:35 BST
Begin processing the 30th record. run: 29350 subRun: 1 event: 9498 at 27-Sep-2024 16:55:36 BST
Begin processing the 31st record. run: 29350 subRun: 1 event: 9500 at 27-Sep-2024 16:55:36 BST
Begin processing the 32nd record. run: 29350 subRun: 1 event: 9502 at 27-Sep-2024 16:55:37 BST
Begin processing the 33rd record. run: 29350 subRun: 1 event: 9504 at 27-Sep-2024 16:55:38 BST
Begin processing the 34th record. run: 29350 subRun: 1 event: 9506 at 27-Sep-2024 16:55:38 BST
Begin processing the 35th record. run: 29350 subRun: 1 event: 9508 at 27-Sep-2024 16:55:39 BST
Begin processing the 36th record. run: 29350 subRun: 1 event: 9510 at 27-Sep-2024 16:55:40 BST
Begin processing the 37th record. run: 29350 subRun: 1 event: 9512 at 27-Sep-2024 16:55:40 BST
Begin processing the 38th record. run: 29350 subRun: 1 event: 9514 at 27-Sep-2024 16:55:41 BST
Begin processing the 39th record. run: 29350 subRun: 1 event: 9516 at 27-Sep-2024 16:55:42 BST
27-Sep-2024 16:55:43 BST  Closed output file "np04hd_raw_run029350_0121_dataflow0_datawriter_0_20240927T141217_reco_stage1_reco_stage2_20240927T155543_keepup.root"
27-Sep-2024 16:55:43 BST  Closed input file "np04hd_raw_run029350_0121_dataflow0_datawriter_0_20240927T141217_reco_stage1.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.639183      0.647157      0.697903       0.64418      0.0105308       39     
-----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                           0.000192128   0.000227162   0.00057329    0.000213049   6.1307e-05       39     
produce:fembfilter:PDHDFEMBFilter                 0.637875      0.645556      0.690628      0.642664     0.00973132       39     
[art]:TriggerResults:TriggerResultInserter       3.6676e-05    4.1836e-05    0.000104828   3.7876e-05    1.18338e-05      39     
end_path:out1:RootOutput                          4.225e-06    5.44151e-06   2.4465e-05     4.455e-06    3.80913e-06      39     
end_path:michelremoving:michelremoving           1.4817e-05    2.21909e-05   0.000231194   1.5737e-05    3.40986e-05      39     
end_path:michelremovinggnocchi:michelremoving     6.242e-06    8.90977e-06   8.4526e-05     6.719e-06    1.22919e-05      39     
end_path:calibanagnocchi:CalibAnaTree             5.722e-06    8.82162e-06   8.1006e-05     6.128e-06    1.20742e-05      39     
end_path:out1:RootOutput(write)                  0.000570612   0.00084346    0.00535096    0.000607543   0.00077565       39     
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3640.79 MB
  Peak resident set size usage (VmHWM): 1051.84 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029350_0121_dataflow0_datawriter_0_20240927T141217_reco_stage1_reco_stage2_20240927T155543_keepup.root
\tHists: np04hd_raw_run029350_0121_dataflow0_datawriter_0_20240927T141217_reco_stage1_reco_stage2_20240927T155543_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029350_0121_dataflow0_datawriter_0_20240927T141217_reco_stage1_reco_stage2_20240927T155543_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029350_0121_dataflow0_datawriter_0_20240927T141217_reco_stage1_reco_stage2_20240927T155543_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727452476.0,
    "core.end_time": 1727452543.0,
    "core.events": [
      9440,
      9442,
      9444,
      9446,
      9448,
      9450,
      9452,
      9454,
      9456,
      9458,
      9460,
      9462,
      9464,
      9466,
      9468,
      9470,
      9472,
      9474,
      9476,
      9478,
      9480,
      9482,
      9484,
      9486,
      9488,
      9490,
      9492,
      9494,
      9496,
      9498,
      9500,
      9502,
      9504,
      9506,
      9508,
      9510,
      9512,
      9514,
      9516
    ],
    "core.event_count": 39,
    "core.first_event_number": 9440,
    "core.last_event_number": 9516,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29350
    ],
    "core.runs_subruns": [
      2935000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029350_0121_dataflow0_datawriter_0_20240927T141217.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029350_0121_dataflow0_datawriter_0_20240927T141217_reco_stage1_reco_stage2_20240927T155543_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727452476.0,
    "core.end_time": 1727452543.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29350
    ],
    "core.runs_subruns": [
      2935000001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029350_0121_dataflow0_datawriter_0_20240927T141217.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:39:10 UTC       justIN version: 01.01.08