justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 265693.9@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID265693.9@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3531
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-09-28 05:17:33
SiteES_PIC
EntryDUNE_T1_ES_PIC_ce13-multicore
Last heartbeat2024-09-28 05:50:14
From worker nodeHostnametds411.pic.es
cpuinfoAMD EPYC 7502 32-Core Processor
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit216000 (60 hours)
Inner Apptainer?True
Job statefinished
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-09-28 05:18:53
Input fileshd-protodune:np04hd_raw_run029382_0045_dataflow1_datawriter_0_20240928T041306.hdf5
JobscriptExit code0
Real time29m (1788s)
CPU time6m (368s = 20%)
Outputting started2024-09-28 05:48:42
Output fileshd-protodune-det-reco:np04hd_raw_run029382_0045_dataflow1_datawriter_0_20240928T041306_reco_stage1_reco_stage2_20240928T054820_keepup.root
hd-protodune-det-reco:np04hd_raw_run029382_0045_dataflow1_datawriter_0_20240928T041306_reco_stage1_reco_stage2_20240928T054820_keepup_hists.root
Finished2024-09-28 05:50:14
Saved logsjustin-logs:265693.9-justin-prod-sched01.dune.hep.ac.uk.logs.tgz
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Sep-2024 07:47:44 CEST
28-Sep-2024 07:47:45 CEST  Opened output file with pattern "%ifb_reco_stage2_%tc_keepup.root"
Begin processing the 2nd record. run: 29382 subRun: 1 event: 3513 at 28-Sep-2024 07:47:47 CEST
Begin processing the 3rd record. run: 29382 subRun: 1 event: 3515 at 28-Sep-2024 07:47:48 CEST
Begin processing the 4th record. run: 29382 subRun: 1 event: 3517 at 28-Sep-2024 07:47:49 CEST
Begin processing the 5th record. run: 29382 subRun: 1 event: 3519 at 28-Sep-2024 07:47:50 CEST
Begin processing the 6th record. run: 29382 subRun: 1 event: 3521 at 28-Sep-2024 07:47:50 CEST
Begin processing the 7th record. run: 29382 subRun: 1 event: 3523 at 28-Sep-2024 07:47:51 CEST
Begin processing the 8th record. run: 29382 subRun: 1 event: 3525 at 28-Sep-2024 07:47:52 CEST
Begin processing the 9th record. run: 29382 subRun: 1 event: 3527 at 28-Sep-2024 07:47:53 CEST
Begin processing the 10th record. run: 29382 subRun: 1 event: 3529 at 28-Sep-2024 07:47:54 CEST
Begin processing the 11th record. run: 29382 subRun: 1 event: 3531 at 28-Sep-2024 07:47:55 CEST
Begin processing the 12th record. run: 29382 subRun: 1 event: 3533 at 28-Sep-2024 07:47:55 CEST
Begin processing the 13th record. run: 29382 subRun: 1 event: 3535 at 28-Sep-2024 07:47:56 CEST
Begin processing the 14th record. run: 29382 subRun: 1 event: 3537 at 28-Sep-2024 07:47:57 CEST
Begin processing the 15th record. run: 29382 subRun: 1 event: 3539 at 28-Sep-2024 07:47:58 CEST
Begin processing the 16th record. run: 29382 subRun: 1 event: 3541 at 28-Sep-2024 07:47:59 CEST
Begin processing the 17th record. run: 29382 subRun: 1 event: 3543 at 28-Sep-2024 07:48:00 CEST
Begin processing the 18th record. run: 29382 subRun: 1 event: 3545 at 28-Sep-2024 07:48:01 CEST
Begin processing the 19th record. run: 29382 subRun: 1 event: 3547 at 28-Sep-2024 07:48:01 CEST
Begin processing the 20th record. run: 29382 subRun: 1 event: 3549 at 28-Sep-2024 07:48:02 CEST
Begin processing the 21st record. run: 29382 subRun: 1 event: 3551 at 28-Sep-2024 07:48:03 CEST
Begin processing the 22nd record. run: 29382 subRun: 1 event: 3553 at 28-Sep-2024 07:48:04 CEST
Begin processing the 23rd record. run: 29382 subRun: 1 event: 3555 at 28-Sep-2024 07:48:05 CEST
Begin processing the 24th record. run: 29382 subRun: 1 event: 3557 at 28-Sep-2024 07:48:06 CEST
Begin processing the 25th record. run: 29382 subRun: 1 event: 3559 at 28-Sep-2024 07:48:07 CEST
Begin processing the 26th record. run: 29382 subRun: 1 event: 3561 at 28-Sep-2024 07:48:07 CEST
Begin processing the 27th record. run: 29382 subRun: 1 event: 3563 at 28-Sep-2024 07:48:08 CEST
Begin processing the 28th record. run: 29382 subRun: 1 event: 3565 at 28-Sep-2024 07:48:09 CEST
Begin processing the 29th record. run: 29382 subRun: 1 event: 3567 at 28-Sep-2024 07:48:10 CEST
Begin processing the 30th record. run: 29382 subRun: 1 event: 3569 at 28-Sep-2024 07:48:11 CEST
Begin processing the 31st record. run: 29382 subRun: 1 event: 3571 at 28-Sep-2024 07:48:12 CEST
Begin processing the 32nd record. run: 29382 subRun: 1 event: 3573 at 28-Sep-2024 07:48:12 CEST
Begin processing the 33rd record. run: 29382 subRun: 1 event: 3575 at 28-Sep-2024 07:48:13 CEST
Begin processing the 34th record. run: 29382 subRun: 1 event: 3577 at 28-Sep-2024 07:48:14 CEST
Begin processing the 35th record. run: 29382 subRun: 1 event: 3579 at 28-Sep-2024 07:48:15 CEST
Begin processing the 36th record. run: 29382 subRun: 1 event: 3581 at 28-Sep-2024 07:48:16 CEST
Begin processing the 37th record. run: 29382 subRun: 1 event: 3583 at 28-Sep-2024 07:48:17 CEST
Begin processing the 38th record. run: 29382 subRun: 1 event: 3585 at 28-Sep-2024 07:48:17 CEST
Begin processing the 39th record. run: 29382 subRun: 1 event: 3587 at 28-Sep-2024 07:48:18 CEST
28-Sep-2024 07:48:20 CEST  Closed output file "np04hd_raw_run029382_0045_dataflow1_datawriter_0_20240928T041306_reco_stage1_reco_stage2_20240928T054820_keepup.root"
28-Sep-2024 07:48:20 CEST  Closed input file "np04hd_raw_run029382_0045_dataflow1_datawriter_0_20240928T041306_reco_stage1.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.806285      0.841991      0.900544      0.836958      0.0165798       39     
-----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                           0.000230413   0.000322486   0.00125039    0.000299094   0.000153866      39     
produce:fembfilter:PDHDFEMBFilter                 0.797321      0.840155      0.897429      0.835422      0.0168331       39     
[art]:TriggerResults:TriggerResultInserter       3.2741e-05    4.21552e-05   9.8602e-05     4.017e-05    1.18107e-05      39     
end_path:out1:RootOutput                          3.82e-06     4.94928e-06    1.708e-05     4.38e-06     2.19707e-06      39     
end_path:michelremoving:michelremoving            1.193e-05    2.10399e-05   0.000240143    1.381e-05    3.58391e-05      39     
end_path:michelremovinggnocchi:michelremoving     4.75e-06     7.76213e-06   8.0501e-05     5.05e-06     1.2594e-05       39     
end_path:calibanagnocchi:CalibAnaTree             4.36e-06     7.26523e-06   9.2142e-05      4.7e-06     1.38637e-05      39     
end_path:out1:RootOutput(write)                  0.000599908   0.000913309   0.00632268    0.00067788    0.000910484      39     
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3647.84 MB
  Peak resident set size usage (VmHWM): 1261.24 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run029382_0045_dataflow1_datawriter_0_20240928T041306_reco_stage1_reco_stage2_20240928T054820_keepup.root
\tHists: np04hd_raw_run029382_0045_dataflow1_datawriter_0_20240928T041306_reco_stage1_reco_stage2_20240928T054820_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run029382_0045_dataflow1_datawriter_0_20240928T041306_reco_stage1_reco_stage2_20240928T054820_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run029382_0045_dataflow1_datawriter_0_20240928T041306_reco_stage1_reco_stage2_20240928T054820_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727502395.0,
    "core.end_time": 1727502501.0,
    "core.events": [
      3511,
      3513,
      3515,
      3517,
      3519,
      3521,
      3523,
      3525,
      3527,
      3529,
      3531,
      3533,
      3535,
      3537,
      3539,
      3541,
      3543,
      3545,
      3547,
      3549,
      3551,
      3553,
      3555,
      3557,
      3559,
      3561,
      3563,
      3565,
      3567,
      3569,
      3571,
      3573,
      3575,
      3577,
      3579,
      3581,
      3583,
      3585,
      3587
    ],
    "core.event_count": 39,
    "core.first_event_number": 3511,
    "core.last_event_number": 3587,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29382
    ],
    "core.runs_subruns": [
      2938200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029382_0045_dataflow1_datawriter_0_20240928T041306.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run029382_0045_dataflow1_datawriter_0_20240928T041306_reco_stage1_reco_stage2_20240928T054820_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1727502395.0,
    "core.end_time": 1727502501.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      29382
    ],
    "core.runs_subruns": [
      2938200001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run029382_0045_dataflow1_datawriter_0_20240928T041306.hdf5"
    }
  ]
}
justIN time: 2024-09-29 09:37:11 UTC       justIN version: 01.01.08