Choosing compute resources for running tools in projects

You use compute resources in projects when you run jobs and most tools. Depending on the tool, you might have a choice of compute resources for the runtime for the tool.

Environments

You run assets and create jobs in a runtime. The runtime details are specified by an environment template.

Environment templates specify the hardware and software configuration of the runtimes:

  • The hardware configuration specifies the amount of processing power and available RAM.
  • The software configuration specifies the programming languages, a set of preinstalled libraries, and optional libraries or packages that you can specify.

Included environment templates

You can use the included environment templates to quickly get started, without having to create your own environment templates. The included environment templates are listed on the project's Environments page.

Getting started

The following table lists the environment templates by asset type.

Environment templates listed by operational asset type
Asset Programming language Tool Environment template type Available environment templates/compute resources
Data Refinery flow R Data Refinery Spark Data Refinery environments
DataStage flow Drag-and-drop/bash DataStage PX S/M/L DataStage environments

Changing the environment runtime for a tool

For tools that support multiple runtime environments, you can select a larger environment runtime if you notice that processing is slow.

To change an environment runtime:

  1. Save any data from your current session before switching to another environment.
  2. Stop the active runtime under Tool runtimes on the Environments page on the Manage tab of your project.
  3. Restart the tool and select another environment with the compute power and memory capacity that better meets your requirements.

Learn more