COS S3 SELECT Support for Structured Objects

Edit online

Overview
New capabilities
Benefits of COS S3 Select
Terms or components
This feature introduces several new concepts. The meanings of these new concepts and terms are defined here. Other existing terms are also defined for clarity.
Workflow
Use cases
COS S3 Select feature is typically used in various data science and analytics use cases, where the user needs to retrieve only a subset of the object contents by using the simple SQL-like expressions. Feature helps the users to reduce the bandwidth usage and in turn to lower the bill.
Feature impact and remediation
Deployment
This feature is automatically enabled once all the devices in the DSNET are upgraded to the corresponding ClevOS release. All the Accessers® will support the COS S3 Select requests to enable users to filter and retrieve subset of object content using simple SQL-like queries.
Operations
Access Logs corresponding to the COS S3 SELECT requests will have select information blob corresponding to the request. Select blob will have metrics corresponding to the bytes of object content that are scanned, processed, and returned to the end user. Logs will also include metrics corresponding to amount of time spent filtering the object contents before the first record which matches the SQL query is returned to the user. The SQL expression used for the S3 SELECT request can also be logged in the access log and is controlled via an advanced configuration: service.http.access.log_query_expression .
Additional information

Parent topic: Concepts