Arrow Flight service

You can directly connect to the data sources in IBM® watsonx.data through the Arrow Flight service in the same IBM Software Hub cluster. However, for IBM Cloud and IBM Developer edition, Arrow Flight service that is deployed on IBM Cloud is used where you need to enter the details that are related to API key and Flight service URL. This feature is applicable for both Presto (Java) and Presto (C++) engines.

watsonx.data on IBM Software Hub

watsonx.data Developer edition

About this task

Prerequisites:
  • The Arrow Flight connector supports only the IBM Arrow Flight service, either on the same IBM Software Hub cluster that has IBM watsonx.data or on an IBM Flight service in the cloud.
  • In IBM Software Hub, Arrow Flight service should be installed in the same IBM Software Hub cluster for the data sources to work.
  • You need to install Watson Studio in the IBM Software Hub to get an instance of the Arrow Flight service.
  • The Arrow Flight service should be running for databases to work with.
Features and capabilities:
  • The databases that are supported through Arrow Flight service have better performance as compared to JDBC databases.
  • Basic query pushdown is available for queries across the tables from the same database and across the tables from different flight databases.
  • The Arrow Flight service databases support only SELECT and DESCRIBE queries.

Procedure

  1. Log in to IBM watsonx.data console.
  2. From the navigation menu, select Infrastructure manager.
  3. To define and connect a data source, click Add component.
  4. In the Add component window, select a data source from the Data source section.
  5. The list includes the following data source types: