Monitoring Amazon DocumentDB

Instana monitors your Amazon DocumentDB and provides visibility into your environment by using the Amazon DocumentDB sensor. After you install the Instana agent, the Amazon DocumentDB sensor is automatically deployed and installed. You can view metrics that are related to Amazon DocumentDB in the Instana UI.

Amazon DocumentDB supports instance-based clusters and elastic clusters. The Amazon DocumentDB sensor monitors both types of clusters and instances of instance-based clusters.

For instance-based clusters, the Amazon DocumentDB sensor supports the following engine versions:

  • 5.0.0 (default)
  • 4.0.0
  • 3.6.0

For more information about the other supported AWS services, see the AWS documentation.

Required permissions

The Amazon DocumentDB sensor requires the following AWS Identity and Access Management (IAM) permission for collecting metrics from Amazon DocumentDB:

  • docdb-elastic:ListClusters
  • docdb-elastic:GetCluster
  • docdb-elastic:ListTagsForResource
  • rds:DescribeDBClusters
  • rds:DescribeDBInstances
  • rds:ListTagsForResource

Configuring the Amazon DocumentDB sensor

After you install the Instana host agent, Instana is configured automatically to monitor Amazon DocumentDB clusters and instances by default.

Metrics for Amazon DocumentDB are collected every minute, which you can change by using the following configuration in the Instana agent configuration file <agent_install_dir>/etc/instana/configuration.yaml:

com.instana.plugin.aws.documentdb:
  cloudwatch_period: 300

Disabling the sensor

To disable monitoring of DocumentDB clusters and instances, use the following configuration:

com.instana.plugin.aws.documentdb:
  enabled: false

Enabling proxy configuration

To enable the Amazon DocumentDB sensor to use the proxy configuration, add the following agent configuration settings:

com.instana.plugin.aws.documentdb:
  proxy_host: 'example.com' # proxy host name or ip address
  proxy_port: 3128 # proxy port
  proxy_protocol: 'HTTP' # proxy protocol: HTTP or HTTPS
  proxy_username: 'username' # OPTIONAL: proxy username
  proxy_password: 'password' # OPTIONAL: proxy password

Monitoring multiple AWS accounts

To set up monitoring of multiple AWS accounts with one AWS agent in the same region, you can use two approaches. For more information, see Monitoring multiple AWS accounts.

AWS named profiles approach

In the AWS named profiles approach, you can define the profile. To override the profiles that are used to monitor DocumentDB, use the following configuration in the agent configuration file:

com.instana.plugin.aws.documentdb:
  profile_names:
    - 'profile2'
    - 'profile3'

If you define profiles on service level, then these profiles override the configuration of the global AWS profiles.

AWS Security Token Service (STS) approach

To override the IAM roles that are used to monitor Amazon DocumentDB, use the following configuration in the agent configuration file:

com.instana.plugin.aws.documentdb:
  role_arns:
    - 'arn:aws:iam::<account_1_id>:role/<role_1_name>'
    - 'arn:aws:iam::<account_2_id>:role/<role_2_name>'

If you define IAM roles on service level, then these roles override the configuration of global AWS IAM roles.

Filtering services by tags

Instana monitors all Amazon DocumentDB services by default. You can set which services you want to monitor by defining multiple tags, separated by a comma. You must provide tags as a key-value pair that is separated by a colon (:) in the configuration.yaml file. To configure the Amazon DocumentDB sensor easily, you can define the tags that you want to include in discovery or exclude from discovery. If tags are defined in both the lists (include and exclude), the exclude list has higher priority. If service level filtering is not needed, then you don't need to define the configuration for DocumentDB as the configuration is done at the AWS configuration level.

You can specify the interval of the sensor (default 60 seconds) to poll the AWS tagged resources by using the configuration property tagged-services-poll-rate.

Tags are only available with the AWS Agent.

To define the interval of the sensors to poll the AWS tagged resources, use the following configuration:

com.instana.plugin.aws:
  tagged-services-poll-rate: 60 #default 60

To include services by tags into discovery, update the following configuration:

com.instana.plugin.aws.documentdb:
  include_tags: # Comma separated list of tags in key:value format (e.g. env:prod,env:staging)

To exclude the services by tags from discovery, update the following configuration:

com.instana.plugin.aws.documentdb:
  exclude_tags: # Comma separated list of tags in key:value format (e.g. env:dev,env:test)

AWS services without tags are monitored by default but you can exclude it by setting the include_untagged field to false as shown in the following example:

com.instana.plugin.aws.documentdb:
  include_untagged: false # True value by default

Instana agent tags

Instana agent tags are available only with the AWS Agent. For more information about using the agent tags, see Monitoring infrastructure.

Viewing metrics

To view the metrics, complete the following steps:

  1. From the navigation menu in the Instana UI, select Infrastructure.
  2. Click a specific monitored Amazon DocumentDB instance. You can see the Amazon DocumentDB instance dashboard with all the collected metrics.
  3. From the breadcrumb on the top left of the dashboard, select the cluster associated with instance. You can see the metrics of the cluster.

DocumentDB Instance based cluster

The following sections show the configuration data and metrics collected for the DocumentDB instance-based clusters.

Configuration data

The following table outlines the configuration data collected for the Amazon DocumentDB instance-based cluster:

DocumentDB cluster details Description
ARN The Amazon Resource Name (ARN) of the DocumentDB instance-based cluster.
Cluster Type The type of the cluster (instance-based or elastic).
Cluster Creation Time The time when the cluster is created.
Name The name of the cluster.
Engine Version The engine version of the cluster. The value is 5.0.0 (default), 4.0.0, or 3.6.0.

Metrics

The following table outlines the metrics details for the Amazon DocumentDB instance-based cluster:

Cluster metrics Description
CPU Utilization The percentage of CPU usage. For clusters, this metric represents an aggregation of CPU usage values of all instances.
DatabaseConnections The number of connections that are open on a cluster, which are collected at a one-minute frequency.
Volume ReadIOPs The average number of billed read I/O operations from a cluster volume, that are reported at 5-minute intervals.
Volume WriteIOPs The average number of billed write I/O operations from a cluster volume, that are reported at 5-minute intervals.
Documents Deleted The number of documents that are deleted in one-minute period.
Documents Inserted The number of documents that are inserted in one-minute period.
Documents Updated The number of documents that are updated in one-minute period.
Documents Returned The number of documents that are returned in one-minute period.
Read Throughput The average number of bytes that are read from disk per second.
Write Throughput The average number of bytes that are written to disk per second.
Transactions Open The number of transactions that are open in a cluster in one minute.
Transactions Open Max The maximum number of transactions that are open on a cluster in one minute.
Transactions Open Used Transactions Open ÷ Transactions Open Max * 100.
Read Latency The average amount of time that is taken for disk read I/O operations.
Write Latency The average amount of time (in milliseconds) that is taken per disk I/O operation.
DBCluster ReplicaLag Maximum The maximum amount of lag (in milliseconds), between the primary instance and each Amazon DocumentDB instance in the cluster.
DBCluster ReplicaLag Minimum The minimum amount of lag (in milliseconds), between the primary instance and each replica instance in the cluster.
Transactions Started The number of transactions that are started in one minute.
Transactions Aborted The number of transactions that are aborted in one minute.
Transactions Committed The number of transactions that are committed in one minute.

DocumentDB instance

The Amazon DocumentDB sensor collects the following data from the Amazon DocumentDB instance:

Configuration data

DocumentDB instance details Description
Instance ARN The Amazon Resource Name (ARN) of the DocumentDB instance.
Cluster ARN The ARN of the DocumentDB cluster that contains the instance.
Instance Creation Time The time when the instance is created and added to the cluster.
Name The name of the DocumentDB instance.
Promotion Tier The role that an instance plays within the cluster at the time of failover and high availability. The instance with the lowest promotion tier value (typically 1) has the highest priority to become the new primary.

Metrics

The following table outlines the metrics details for the Amazon DocumentDB instance:

Node metrics Description
CPU Utilization The percentage of CPU usage.
Database Connections The number of connections that are open on an instance, which are collected at a one minute frequency.
Database Connections Max The maximum number of database connections that are open on an instance in a one minute.
Database Connections Used Database Connections ÷ Database Connections Max * 100.
ReadIOPs The average number of disk read operations per second.
WriteIOPs The average number of disk write operations per second.
Documents Deleted The number of documents that are deleted in one minute.
Documents Inserted The number of documents that are inserted in one minute.
Documents Updated The number of documents that are updated in one minute.
Documents Returned The number of documents that are returned in one minute.
Read Throughput The average number of bytes that are read from disk per second.
Write Throughput The average number of bytes that are written to disk per second.
Transactions Open The number of transactions that are open in an instance in a one minute.
Transactions Open Max The maximum number of transactions that are open on an instance in a one minute.
Transactions Open Used Transactions Open ÷ Transactions Open Max * 100.
Read Latency The average amount of time that is taken for disk read I/O operations.
Write Latency The average amount of time (in milliseconds) that is taken per disk I/O operation.
DBInstance ReplicaLag The amount of lag when the updates are replicated from the primary instance to a replica instance.
Transactions Started The number of transactions that are started in a one minute.
Transactions Aborted The number of transactions that are aborted in a one minute.
Transactions Committed The number of transactions that are committed in a one minute.

DocumentDB elastic cluster

The Amazon DocumentDB sensor collects the following data from the Amazon DocumentDB elastic cluster:

Configuration data

DocumentDB elastic cluster details Description
ARN The Amazon Resource Name (ARN) of the DocumentDB elastic cluster.
Cluster Type The type of the cluster (instance based or elastic).
Cluster Creation Time The time when the cluster is created.
Name The name of the cluster.

Metrics

Cluster metrics Description
CPU Utilization The percentage of CPU usage of the primary instance.
DatabaseConnections The number of connections that are open on a cluster, which are collected at a one-minute frequency.
Volume ReadIOPs The average number of billed read I/O operations from a cluster volume that are reported at 5-minute intervals.
Volume WriteIOPs The average number of billed write I/O operations from a cluster volume that are reported at 5-minute intervals.
Documents Deleted The number of documents that are deleted in one minute.
Documents Inserted The number of documents that are inserted in one minute.
Documents Updated The number of documents that are updated in one minute.
Documents Returned The number of documents that are returned in one minute.
Read Throughput The average number of bytes that are read from disk per second.
Write Throughput The average number of bytes that are written to disk per second.