Arrow Flight service

You can connect to data sources in IBM® watsonx.data through the Arrow Flight service. Connect directly to the Arrow Flight service in the same IBM Software Hub cluster. Connect to the Arrow Flight service deployed on IBM Developer edition. You need the following credentials:

  • API key
  • Flight service URL

Both Presto (Java) and Presto (C++) engines support Arrow Flight connections.

Features and capabilities:
  • The databases that are supported through Arrow Flight service have better performance as compared to JDBC databases.
  • Basic query pushdown is available for queries across the tables from the same database and across the tables from different flight databases.
  • The Arrow Flight service databases support only SELECT and DESCRIBE queries.

watsonx.data on IBM Software Hub

watsonx.data Developer edition

Before you begin

Before you begin, ensure that the following requirements are met:
  • The Arrow Flight connector supports only the IBM Arrow Flight service, either on the same IBM Software Hub cluster that has IBM watsonx.data or on an IBM Flight service in the cloud.
  • In IBM Software Hub, Arrow Flight service should be installed in the same IBM Software Hub cluster for the data sources to work.
  • You need to install Watson Studio in the IBM Software Hub to get an instance of the Arrow Flight service. For more information, see Installing Watson Studio.
  • The Arrow Flight service should be running for databases listed below to work with.

About this task

To add an Arrow Flight data source-catalog pair, complete the following steps:

Procedure

  1. Log in to IBM watsonx.data admin console.
  2. From the navigation menu, select Infrastructure manager.
  3. To define and connect a data source, click Add component.
  4. In the Add component window, select a data source from the Data source section.
  5. The list includes the following data source types: