justIN           Dashboard       Workflows       Jobs       AWT       Sites       Storages       Docs       Login

Jobsub ID 270055.126@justin-prod-sched01.dune.hep.ac.uk

Jobsub ID270055.126@justin-prod-sched01.dune.hep.ac.uk
Workflow ID3593
Stage ID1
User namecalcuttj@fnal.gov
HTCondor Groupgroup_dune.prod_mcsim
RequestedProcessors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit18000 (5 hours)
Submitted time2024-10-05 10:23:32
SiteUS_BNL
EntryDUNE_US_BNL_sp02
Last heartbeat2024-10-05 10:58:14
From worker nodeHostnamespool1571.sdcc.bnl.gov
cpuinfoIntel(R) Xeon(R) Gold 6336Y CPU @ 2.40GHz
OS releaseScientific Linux release 7.9 (Nitrogen)
Processors1
RSS bytes4193255424 (3999 MiB)
Wall seconds limit171000 (47 hours)
Inner Apptainer?False
Job stateaborted
Allocator namejustin-allocator-pro.dune.hep.ac.uk
Started2024-10-05 10:43:53
Input fileshd-protodune:np04hd_raw_run027927_0379_dataflow7_datawriter_0_20240709T152034.hdf5
Outputting started2024-10-05 10:56:34
Output files
Finished2024-10-05 10:58:14
List job events     Wrapper job log

Jobscript log (last 10,000 characters)

Oct-2024 10:56:04 UTC  Opened input file "np04hd_raw_run027927_0379_dataflow7_datawriter_0_20240709T152034_reco_stage1.root"
job begin...
job begin...
Scale HitLimit based on readout window size 5859
HitLimit = 19530
Begin processing the 1st record. run: 27927 subRun: 1 event: 96607 at 05-Oct-2024 10:56:04 UTC
05-Oct-2024 10:56:05 UTC  Opened output file with pattern "%ifb_reco_stage2_%tc_keepup.root"
Begin processing the 2nd record. run: 27927 subRun: 1 event: 96615 at 05-Oct-2024 10:56:06 UTC
Begin processing the 3rd record. run: 27927 subRun: 1 event: 96623 at 05-Oct-2024 10:56:06 UTC
Begin processing the 4th record. run: 27927 subRun: 1 event: 96631 at 05-Oct-2024 10:56:07 UTC
Begin processing the 5th record. run: 27927 subRun: 1 event: 96639 at 05-Oct-2024 10:56:07 UTC
Begin processing the 6th record. run: 27927 subRun: 1 event: 96647 at 05-Oct-2024 10:56:08 UTC
Begin processing the 7th record. run: 27927 subRun: 1 event: 96655 at 05-Oct-2024 10:56:08 UTC
Begin processing the 8th record. run: 27927 subRun: 1 event: 96663 at 05-Oct-2024 10:56:09 UTC
Begin processing the 9th record. run: 27927 subRun: 1 event: 96671 at 05-Oct-2024 10:56:10 UTC
Begin processing the 10th record. run: 27927 subRun: 1 event: 96679 at 05-Oct-2024 10:56:10 UTC
Begin processing the 11th record. run: 27927 subRun: 1 event: 96687 at 05-Oct-2024 10:56:11 UTC
Begin processing the 12th record. run: 27927 subRun: 1 event: 96695 at 05-Oct-2024 10:56:11 UTC
Begin processing the 13th record. run: 27927 subRun: 1 event: 96703 at 05-Oct-2024 10:56:12 UTC
Begin processing the 14th record. run: 27927 subRun: 1 event: 96711 at 05-Oct-2024 10:56:12 UTC
Begin processing the 15th record. run: 27927 subRun: 1 event: 96719 at 05-Oct-2024 10:56:13 UTC
Begin processing the 16th record. run: 27927 subRun: 1 event: 96727 at 05-Oct-2024 10:56:13 UTC
Begin processing the 17th record. run: 27927 subRun: 1 event: 96735 at 05-Oct-2024 10:56:14 UTC
Begin processing the 18th record. run: 27927 subRun: 1 event: 96743 at 05-Oct-2024 10:56:15 UTC
Begin processing the 19th record. run: 27927 subRun: 1 event: 96751 at 05-Oct-2024 10:56:15 UTC
Begin processing the 20th record. run: 27927 subRun: 1 event: 96759 at 05-Oct-2024 10:56:16 UTC
Begin processing the 21st record. run: 27927 subRun: 1 event: 96767 at 05-Oct-2024 10:56:16 UTC
Begin processing the 22nd record. run: 27927 subRun: 1 event: 96775 at 05-Oct-2024 10:56:17 UTC
Begin processing the 23rd record. run: 27927 subRun: 1 event: 96783 at 05-Oct-2024 10:56:17 UTC
Begin processing the 24th record. run: 27927 subRun: 1 event: 96791 at 05-Oct-2024 10:56:18 UTC
Begin processing the 25th record. run: 27927 subRun: 1 event: 96799 at 05-Oct-2024 10:56:18 UTC
Begin processing the 26th record. run: 27927 subRun: 1 event: 96807 at 05-Oct-2024 10:56:19 UTC
Begin processing the 27th record. run: 27927 subRun: 1 event: 96815 at 05-Oct-2024 10:56:19 UTC
Begin processing the 28th record. run: 27927 subRun: 1 event: 96823 at 05-Oct-2024 10:56:20 UTC
Begin processing the 29th record. run: 27927 subRun: 1 event: 96831 at 05-Oct-2024 10:56:20 UTC
Begin processing the 30th record. run: 27927 subRun: 1 event: 96839 at 05-Oct-2024 10:56:21 UTC
Begin processing the 31st record. run: 27927 subRun: 1 event: 96847 at 05-Oct-2024 10:56:21 UTC
Begin processing the 32nd record. run: 27927 subRun: 1 event: 96855 at 05-Oct-2024 10:56:22 UTC
Begin processing the 33rd record. run: 27927 subRun: 1 event: 96863 at 05-Oct-2024 10:56:22 UTC
Begin processing the 34th record. run: 27927 subRun: 1 event: 96871 at 05-Oct-2024 10:56:23 UTC
Begin processing the 35th record. run: 27927 subRun: 1 event: 96879 at 05-Oct-2024 10:56:23 UTC
Begin processing the 36th record. run: 27927 subRun: 1 event: 96887 at 05-Oct-2024 10:56:24 UTC
05-Oct-2024 10:56:25 UTC  Closed output file "np04hd_raw_run027927_0379_dataflow7_datawriter_0_20240709T152034_reco_stage1_reco_stage2_20241005T105625_keepup.root"
05-Oct-2024 10:56:25 UTC  Closed input file "np04hd_raw_run027927_0379_dataflow7_datawriter_0_20240709T152034_reco_stage1.root"

===================================================================================================================================
TimeTracker printout (sec)                           Min           Avg           Max         Median          RMS         nEvts   
===================================================================================================================================
Full event                                        0.472541      0.533979      0.692013      0.525417      0.0429087       36     
-----------------------------------------------------------------------------------------------------------------------------------
source:RootInput(read)                           0.000178972   0.00022323    0.000951205   0.000197935   0.000123928      36     
produce:fembfilter:PDHDFEMBFilter                 0.471426      0.532704      0.690847      0.524328      0.0428558       36     
[art]:TriggerResults:TriggerResultInserter       3.4845e-05    4.10393e-05    8.314e-05    3.84295e-05   8.52226e-06      36     
end_path:out1:RootOutput                          2.808e-06    3.54936e-06   1.2544e-05     3.173e-06    1.57083e-06      36     
end_path:michelremoving:michelremoving           1.2401e-05    1.90144e-05   0.000181297   1.3692e-05    2.75456e-05      36     
end_path:michelremovinggnocchi:michelremoving     2.889e-06    4.76153e-06   5.1622e-05    3.2305e-06    8.01802e-06      36     
end_path:calibanagnocchi:CalibAnaTree             2.347e-06    3.88697e-06   4.7892e-05    2.6155e-06    7.44135e-06      36     
end_path:out1:RootOutput(write)                  0.000475013   0.000677157   0.00380238    0.000540148   0.000545947      36     
===================================================================================================================================

====================================================================================================
MemoryTracker summary (base-10 MB units used)

  Peak virtual memory usage (VmPeak)  : 3712.56 MB
  Peak resident set size usage (VmHWM): 1109.62 MB
  Details saved in: 'mem.db'
====================================================================================================
Art has completed and will exit with status 0.
Output files:
\tReco: np04hd_raw_run027927_0379_dataflow7_datawriter_0_20240709T152034_reco_stage1_reco_stage2_20241005T105625_keepup.root
\tHists: np04hd_raw_run027927_0379_dataflow7_datawriter_0_20240709T152034_reco_stage1_reco_stage2_20241005T105625_keepup_hists.root
Forming reco metadata
Successfully opened file np04hd_raw_run027927_0379_dataflow7_datawriter_0_20240709T152034_reco_stage1_reco_stage2_20241005T105625_keepup.root
Ran successfully
{
  "name": "np04hd_raw_run027927_0379_dataflow7_datawriter_0_20240709T152034_reco_stage1_reco_stage2_20241005T105625_keepup.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "artroot",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "full-reconstructed",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728125735.0,
    "core.end_time": 1728125785.0,
    "core.events": [
      96607,
      96615,
      96623,
      96631,
      96639,
      96647,
      96655,
      96663,
      96671,
      96679,
      96687,
      96695,
      96703,
      96711,
      96719,
      96727,
      96735,
      96743,
      96751,
      96759,
      96767,
      96775,
      96783,
      96791,
      96799,
      96807,
      96815,
      96823,
      96831,
      96839,
      96847,
      96855,
      96863,
      96871,
      96879,
      96887
    ],
    "core.event_count": 36,
    "core.first_event_number": 96607,
    "core.last_event_number": 96887,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27927
    ],
    "core.runs_subruns": [
      2792700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027927_0379_dataflow7_datawriter_0_20240709T152034.hdf5"
    }
  ]
}Forming hist metadata
formed
{
  "name": "np04hd_raw_run027927_0379_dataflow7_datawriter_0_20240709T152034_reco_stage1_reco_stage2_20241005T105625_keepup_hists.root",
  "namespace": "hd-protodune-det-reco",
  "metadata": {
    "core.file_format": "root",
    "core.application.name": "reco",
    "core.application.family": "dunesw",
    "core.application.version": "v09_91_02d01",
    "core.data_tier": "root-tuple-virtual",
    "dune.config_file": "standard_reco_stage2_calibration_protodunehd_keepup.fcl",
    "dune.campaign": "hd-protodune-reco-keepup-v0",
    "core.start_time": 1728125735.0,
    "core.end_time": 1728125785.0,
    "core.data_stream": "cosmics",
    "core.file_content_status": "good",
    "core.file_type": "detector",
    "core.run_type": "hd-protodune",
    "core.runs": [
      27927
    ],
    "core.runs_subruns": [
      2792700001
    ],
    "dune.daq_test": false,
    "retention.status": "active",
    "retention.class": "physics",
    "origin.applications.config_files": {
      "reco1": "standard_reco_stage1_protodunehd_keepup.fcl"
    },
    "origin.applications.versions": {
      "reco1": "v09_91_02d01"
    },
    "origin.applications.names": [
      "reco1"
    ]
  },
  "parents": [
    {
      "did": "hd-protodune:np04hd_raw_run027927_0379_dataflow7_datawriter_0_20240709T152034.hdf5"
    }
  ]
}
justIN time: 2024-11-21 19:54:40 UTC       justIN version: 01.01.09