Cloud Daily/Hourly Reports - Extending or Changing (12.5 and earlier)

Edit online

The Daily/Hourly reports are built on a data format that enables rapid and efficient storage and queries on very high-volume data sets (such as very granular cloud bills like the AWS Cost and Usage Report). As a result, extending the schema of the data sets involved and modifying reports built on those data sets requires some configuration

Applies to: Cloud on Costing Standard on TBM Studio 12.3.3 and later; Cloud Business Management on TBM Studio 12.5.x and earlier

The Daily/Hourly data is stored in a different format, separately from other Apptio data. The object on which reports are built is called dbr_daily, which can be found in the tables section of TBM Studio, but, because of the extremely high volume of data and the new data format, certain actions cannot be performed:

  • You will not be able to see the data in TBM Studio.
  • You cannot add items to the transform pipeline (with the exception explained in the "Adding new, custom attributes" section, below).
  • You cannot add transforms to the data set.

Extending the Daily/Hourly Schema

Edit online

To use out-of-the-box attributes (the quickest way to see your organization’s specific data):

Procedure

  1. Map from the columns in the provider bills, such as Accounts or Tags, to the out-of-the-box CBM attributes.
    For example, if you have a tag user called Owner, map that tag to the existing System Owner attribute.
  2. For more information, see Map AWS tags to Apptio Schema or Tag values in Azure to Apptio Schema.

Add custom attributes

Edit online

To start adding custom attributes:

Procedure

  1. In the DataLink connector for the Daily/Hourly data, add a new entry in Column Mapping section for both the current and prior month Daily/Hourly connectors.
  2. Run your Daily/Hourly connectors.
  3. In TBM Studio, go to the dbr_daily object and add a new column to the formula step, ensuring that the column name matches the name you entered in the Destination field in Datalink (Classic).
  4. Save the changes. The new column is now available for reporting.

Modify report components (aka pivots, slicers, charts and tables)

Edit online
You can modify existing Daily/Hourly report components in a similar manner as normal reports, with some specific constraints and nuances.

Procedure

  • To add a non-numeric attribute to a pivot, chart, or other component:
    1. Select the component in question.
    2. Navigate to the Daily/Hourly perspective.
    3. Find the attribute you want to add to the component and drag it to the appropriate field.

      In this example, Environment was added to the Pivot on the Daily Transparency report

    4. Save the report.

    NOTICE

    Because of the granular time-series nature of numeric fields in the Daily/Hourly reports, the following steps are required. To be used in reporting, numeric fields must already exist either in the Daily/Hourly perspective or in the dbr_daily object.

  • To add or modify numeric fields in a chart or table:
    1. Find the numeric field you want to use.

      This example uses Usage Qty on the dbr_daily object.

    2. Drag the numeric field into the Valuescolumn
    3. Remove any unnecessary numeric fields from the Valuescolumn and update the chart formatting as necessary.
    4. Ensure the proper time granularity column is in place.In many cases, the report components will need to know what time grain is to be displayed.
      For example, a column chart could be configured to show cost daily or hourly. The Granularity_DD and Granularity_HH columns are used for this granularity control. In general, only use Granularity_HH in charts that you want to include hourly details. For all others, include Granularity_DD in the Axis field (where days are an attribute to be displayed) or in the Filter field (where days are not an attribute to be displayed).
    5. Save your changes.
    6. Cost is now replaced with Usage Qty in the Daily Invoice Cost chart. Repeat steps 1-5 for the following numeric fields.
      • dbr_daily object
        Cost
        The cost associated with the cloud service consumed. (This is currently the unblended cost in the Detailed Billing Report.)
        Rate
        – The unit rate for the cloud service consumed. This field is calculated by dividing Cost by the Usage Qty. Note that because of the high number of unit rates in the cloud bill, this field will give unusual results when a chart or table is not filtered to a single unit rate.
        Usage Qty
        The quantity of units consumed for the cloud service. For example, for EC2 compute services, this field will include the number of instance hours consumed.
      • Daily/Hourly perspective
        Cloud Invoice Cost MTD
        The total cost for the month being analyzed
        Cloud Invoice Cost Today
        The total cost for the last full day. Currently, Daily/Hourly reports don't report on partial days.
        Cloud Invoice Cost Yesterday
        The total cost for the day prior to the last full day.
        Current Month Cloud Invoice Forecast
        The projected end of month spend for the month being analyzed. This is calculated through a linear projection of costs incurred in the month to-date. For prior months this will be equal to the actual costs incurred for that month.
        Daily Cloud Invoice Cost
        This is equivalent to the Cost field on dbr_daily.
        Prev Month Invoice Cost
        The total cost of for the prior month.
        Prev Month Invoice Cost MTD
        The total cost for the prior month up to the same day as is measured for the current month.
    7. Save your changes.