Operations
Access Logs corresponding to the COS S3 SELECT requests will have select information blob
corresponding to the request. Select blob will have metrics corresponding to the bytes of object
content that are scanned, processed, and returned to the end user. Logs will also include metrics
corresponding to amount of time spent filtering the object contents before the first record which
matches the SQL query is returned to the user. The SQL expression used for the S3 SELECT request can
also be logged in the access log and is controlled via an advanced configuration:
service.http.access.log_query_expression .
Accesser device level metrics reported also include the number of successful and failure COS S3 SELECT requests processed and metrics corresponding to the bytes scanned, processed, and returned by the accesser.
| Metric | Type | Metrics API Key |
| S3 Select Request Successes (2xx response codes) | Counter | dsnet.accesser.http.select.successes |
| S3 Select Request Failures (4xx and 5xx response codes) | Counter | dsnet.accesser.http.select.errors |
| S3 Select Request Bytes Scanned by the Accesser | Counter | dsnet.accesser.http.select.bytes_scanned |
| S3 Select Request Bytes Processed by the Accesser | Counter | dsnet.accesser.http.select.bytes_processed |
| S3 Select Request Bytes Returned to the Client | Counter | dsnet.accesser.http.select.bytes_returned |
| Input JSON Records Processed as part of S3 Select Requests | Counter | dsnet.select.input.json.records_processed |
| Input CSV Records Processed as part of S3 Select Requests | Counter | dsnet.select.input.csv.records_processed |
| Input PARQUET Records Processed as part of S3 Select Requests | Counter | dsnet.select.input.parquet.records_processed |
| Output JSON Records Streamed as part of S3 Select Response | Counter | dsnet.select.output.json.records_processed |
| Input CSV Records Streamed as part of S3 Select Response | Counter | dsnet.select.output.csv.records_processed |