Create a resource group

In this lesson, you create a new resource group from the cluster management console to ensure that your consumers have the appropriate group of compute hosts available to them.

About this task

Resource groups provide a simple way of organizing and grouping resources (hosts). Instead of creating policies for individual resources, you can create and apply them to an entire group. A cluster administrator can define multiple resource groups, assign them to consumers, and configure a distinct resource plan for each group.

By default, EGO is configured with three resource groups:
  • ComputeHosts: executes workload and can be kept, modified, or deleted if required.
  • InternalResourceGroup: runs important EGO components and services.
  • ManagementHosts: runs important EGO components and services.
Resource group host lists are defined by a static list or are dynamic. A static list is where you specifically choose which hosts to use. Dynamically is where you specify either all hosts or a resource requirement so that when new hosts join, they are automatically added to the resource group. In this lesson, you are creating a new resource group dynamically by specifying a resource requirement.
Tip: You can use the egoconfig addresourceattr command to add a custom resource attribute tag to a host and then specify that tag when you create a resource group. See egoconfig.
This lesson uses the following concepts:
Concept Description
cluster management console Web interface to IBM® Spectrum Conductor. This interface provides a single point of access to manage and monitor your instance groups.
dynamic resource requirements The host members in the resource group vary according to the hosts that meet that requirement. The requirement itself is static. Some commonly used requirements to create a dynamic resource group include operating system, the number of CPUs, and maximum memory.
enterprise grid orchestrator (EGO) The resource manager in IBM Spectrum Conductor.
hosts Hosts can be divided into two groups: management hosts and compute hosts. Management hosts provide specialized services to the cluster, while compute hosts run user workload and provide computing resources to consumers.
resource Physical and logical entities that are used by instance groups to run. A CPU slot is the most important resource.
resource group A logical group of hosts, which can be specified by explicitly listing host names or by specifying resource requirements in terms of OS, memory, swap space, CPU factor, and so on.

To create the Sample_LOB resource group:

Procedure

  1. Log in to the cluster management console.
  2. Select Resources > Resource Planning (Slot) > Resource Groups.
  3. Click Global Actions > Create a Resource Group.
  4. Enter the following information:
    • Resource group name: Sample_LOB
    • Description: Sample resource group for your line of business
    • Number of slots per host is equal to: Number of CPUs * 7
      Note: You can enter a value of 7 or greater for the number of CPUs. To run the sample SparkPi application, you need at least 7 CPUs for the following:
      • Batch Spark master
      • Notebook Spark master
      • Shuffle service
      • A notebook service
      • 1 driver
      • 1 executor (minimum)
  5. Keep the default selections for the following settings:
    • Number of slots per host
    • Resource Selection Method
    • Hosts to Show in List

    When you create a dynamic resource group, new hosts added to the cluster that meet the static resource requirement you specify are automatically added to the resource group. The maximum number of slots per host is 9999.

  6. Click Create.

Results

You have created the Sample_LOB resource group.

Summary

In this lesson, you learned how to create a resource group.

In the next lesson, you create the consumers.