Custom

You can now use the Custom data source to create data source connections that are not provided by the built-in data sources. Custom data source can be used for connectors that are supported by Presto as in the Presto documentation but not listed in IBM® watsonx.data supported connectors. This feature is applicable for Presto (Java) and Presto (C++) engines. For Presto (C++) engine, only Hive, Apache Iceberg, Arrow Flight service, and Custom data sources can be associated.

watsonx.data on IBM Software Hub

watsonx.data Developer edition

To add a Custom data source, complete the following steps:
  1. Log in to watsonx.data console.
  2. From the navigation menu, select Infrastructure manager.
  3. To define and connect a data source, click Add component.
  4. In the Data sources section, select Custom.
  5. Configure the following details:
    Note: Use of this feature may crash your engine if configured incorrectly. IBM does not provide support for use of this feature.
    Note: Two databases with the same name cannot be added. Custom databases do not support SSL configuration properties.
    Field Description
    Display name Enter the data source name to be displayed on the screen.
    Property Enter the properties and their values to be configured for the database. Enter the property name:value pair as specified in Presto documentation. You can add multiple properties.
    connector.name= Enter the name of the database connector that you want to add as specified in Presto documentation.
    Encryption Encrypting values of the keys are stored.

    Console UI

    Associate catalog

    Console UI

    Select the checkbox to associate a catalog to the data source. This catalog is automatically associated with your data source and serves as your query interface with the data stored within.
    Catalog name / Name

    • Console UI

      Catalog name: Enter the name of the catalog.

    • Platform UI

      Name: Enter the name of the database associated with your data source. The database serves as your query interface with the data stored within.
    Create Click Create to create the datasource.

You can use the Custom data source for the following connectors in IBM watsonx.data for Presto (Java) engine:

  • Local File connector: The Local File connector is used to display the http request logs of a worker. Use the custom data source option with the following properties. For more information, see Local File connector.
    • connector.name=localfile
    • presto-logs.http-request-log.location=var/log
    • presto-logs.http-request-log.pattern=http-request.log*
  • Black Hole connector: The Black Hole connector is designed for high-performance testing of other components. Use the custom data source option with the following property. For more information, see Black Hole connector.
    • connector.name=blackhole