Setting up an AWS data export

Turbonomic uses a data export stored in an S3 bucket to visualize historical cloud expenses, and discover discounts and billing family relationships.

Guidelines

  • Turbonomic supports only the following data exports:

    • Standard data export (CUR 2.0)

    • Legacy CUR export

    All other data exports available in AWS are not supported.

  • The IAM user or role that you set up for Turbonomic requires access to the S3 bucket that contains your data export. Billing access is not required.

  • Turbonomic supports a data export created at the management account, but not member accounts.

  • AWS publishes the daily data export twice a day, but it may take up to 24 hours for AWS to deliver the data export to the S3 bucket. Charts in Turbonomic, such as the Workload Cost Breakdown chart, will start to show data 1 to 2 hours after data export delivery.

Setting up a standard data export (CUR 2.0)

  1. Sign in to the Billing and Cost Management console.

    https://console.aws.amazon.com/billing

  2. In the page banner, find the dropdown menu of regions and then select the region for the S3 bucket.

  3. In the navigation pane, find the Cost Analysis section and choose Data Exports.

  4. Choose Create.

  5. Choose Standard data export and configure the following settings.

    • Export name

      Setting Instructions
      Export name Specify your preferred name.

    • Data table content settings

      Setting Instructions
      Additional export content Select Include resource IDs.
      Time granularity Choose Daily.

    • Column selection

      By default, all columns are selected. To include only the columns that Turbonomic currently requires, select the following items:

      • bill_payer_account_id

      • identity_line_item_id

      • line_item_currency_code

      • line_item_line_item_type

      • line_item_normalization_factor

      • line_item_normalized_usage_amount

      • line_item_operation

      • line_item_product_code

      • line_item_resource_id

      • line_item_unblended_cost

      • line_item_usage_account_id

      • line_item_usage_amount

      • line_item_usage_end_date

      • line_item_usage_start_date

      • line_item_usage_type

      • pricing_public_on_demand_cost

      • pricing_term

      • pricing_unit

      • product

      • product_instance_type

      • product_product_family

      • product_sku

      • reservation_reservation_a_r_n

      • savings_plan_savings_plan_a_r_n

      • savings_plan_savings_plan_effective_cost

    • Data export delivery options

      Setting Instructions
      Compression type and file format Choose gzip - text/csv.
      File versioning Choose Create new data export file.

    • Data export storage settings

      Setting Instructions
      S3 bucket Click Configure and then select an existing bucket or create a new one. If you created a new one, the region that you selected in a previous step is automatically specified. Note that the AmazonS3FullAccess and Billing permissions are required to set up the bucket. For detailed setup instructions, see the AWS documentation. Be sure to verify the bucket policy that AWS applies.
      S3 path prefix Specify your preferred prefix, such as daily.

  6. Review your settings and record the following information. You will need this information later when you add the AWS Billing target in the Turbonomic user interface.

    • S3 bucket name, such as turbodataexport

    • S3 path prefix, such as daily

    • S3 bucket region, such as us-east-1

  7. Click Create.

    AWS can now deliver the data export to the S3 bucket. It could take up to 24 hours for AWS to deliver the first data export.

Setting up a Legacy CUR export

  1. Sign in to the Billing and Cost Management console.

    https://console.aws.amazon.com/billing

  2. In the page banner, find the dropdown menu of regions and then select the region for the S3 bucket.

  3. In the navigation pane, find the Cost Analysis section and choose Data Exports.

  4. Choose Create.

  5. Choose Legacy CUR export and configure the following settings.

    • Export name

      Setting Instructions
      Export name Specify your preferred name.

    • Export content

      Setting Instructions
      Additional export content Select Include resource IDs.

    • Data export delivery options

      Setting Instructions
      Report data time granularity Choose Daily.
      Report versioning Choose Create new report version.

    • Data export storage settings

      Setting Instructions
      S3 bucket Click Configure and then select an existing bucket or create a new one. If you created a new one, the region that you selected in a previous step is automatically specified. Note that the AmazonS3FullAccess and Billing permissions are required to set up the bucket. For detailed setup instructions, see the AWS documentation. Be sure to verify the bucket policy that AWS applies.
      S3 path prefix Specify your preferred prefix, such as daily.

  6. Review your settings and record the following information. You will need this information later when you add the AWS Billing target in the Turbonomic user interface.

    • S3 bucket name, such as turbodataexport

    • S3 path prefix, such as daily

    • S3 bucket region, such as us-east-1

  7. Click Create report.

    AWS can now deliver the data export to the S3 bucket. It could take up to 24 hours for AWS to deliver the first data export.

Next step

In the Turbonomic user interface, add an AWS Billing target using the data export settings and the IAM user or role that you set up. For details, see this topic.