GET_DATALAKE_CONFIG table function

The SYSHADOOP.GET_DATALAKE_CONFIG table function is used to get a list of Datalake table configuration values. The table function lists property keys and values from the property files.

Authorization

EXECUTE is granted to the DASHDB_ENTERPRISE_ADMIN role.

Syntax

Description

cfg_file_type

A VARCHAR(16) value that can be BIGSQL, CORE, HIVE, or NULL. The cfg_file_type lists all of the property keys and values for that file.

The function returns one row per property key for all of the data files. Each row contains the following columns and information:

Table 1. Column names and returned information
Column name	Data type	Description
CFG_FILE_TYPE	VARCHAR(16)	A VARCHAR(16) value that can be BIGSQL, CORE, HIVE, or NULL to indicate which configuration file should be enumerated. Passing NULL for this value will lists property keys and values for all DATALAKE configuration files.
PROPERTY_NAME	VARCHAR(512)	The name of the property
PROPERTY_VALUE	VARCHAR(2048)	The property value

Examples

To get information about the configuration in your core-site.xml file, run the following SELECT statement:

SELECT * FROM TABLE(SYSHADOOP.GET_DATALAKE_CONFIG('CORE'));

resulting in the following return:


CFG_FILE_TYPE    PROPERTY_NAME                               PROPERT_VALUE
---------------- ------------------------------------------- -------------------------------------------------------------------------------------------------------------------------------------
CORE             fs.s3a.multipart.size                       67108864
CORE             fs.s3a.threads.core                         250
CORE             fs.s3a.impl                                 com.ibm.biginsights.bigsql.fs.s3a.RetryableS3AFileSystem
CORE             fs.s3a.connection.timeout                   3600123
CORE             fs.s3a.fast.upload.buffer                   disk
CORE             fs.azure.account.auth.type                  OAuth
CORE             fs.azure.account.oauth.provider.type        org.apache.hadoop.fs.azurebfs.oauth2.ClientCredsTokenProvider
CORE             fs.s3a.fast.upload                          true
CORE             hadoop.security.credential.provider.path    jceks://file/var/ibm/bigsql/security/bigsql-credential-provider.jceks,jceks://file/usr/ibmpacks/current/bigsql/bigsql/conf/s3aallkeys 
CORE             fs.s3a.threads.max                          256
CORE             fs.s3a.aws.credentials.provider             com.ibm.biginsights.bigsql.security.Db2CredentialsProvider
CORE             fs.s3a.connection.maximum                   256
CORE             fs.s3a.list.version                         1
CORE             fs.s3a.paging.maximum                       5000


  14 record(s) selected.