Hadoop Distributed File System (HDFS)

Hadoop Distributed File System (HDFS) is a file system that manages large data sets that can run on commodity hardware.

If you select Hadoop Distributed File System (HDFS) from the Storage section, configure the following details:

Note: If you encounter errors during HDFS storage configuration, see Troubleshooting HDFS catalog errors.

Field	Description
Display name	Enter the name to be displayed.
Thrift URI	Enter the Thrift URI.
Thrift port	Enter Thrift port.
Kerberos authentication	Use the toggle switch to enable or disable Kerberos authentication. If enabled, enter the following information: HDFS principal Hive client principal Hive server principal Upload the following files: Core site file (.xml) HDFS site (.xml) Kerberos config file (.config) HDFS keytab file (.keytab) Hive keytab file (.keytab)
Upload core site file (.xml)	Upload core site file (.xml).
Upload HDFS site file (.xml)	Upload HDFS site file (.xml).
Connection status	Click the Test connection link to test the storage connection. If the storage connection is successful, a success message appears.
Console UI Associate catalog	Console UI Select the checkbox to associate a catalog to the data source. This catalog is automatically associated with your data source and serves as your query interface with the data stored within.
Catalog type / Type	Console UI Catalog type: Select the catalog type from the list. The recommended catalog is Apache Iceberg. The other option for catalog is Apache Hive. Platform UI Type: Select the database type from the list. The recommended database is Apache Iceberg. The other option for database is Apache Hive.
Catalog name / Name	Console UI Catalog name: Enter the name of the catalog. Platform UI Name: Enter the name of the database associated with your data source. The database serves as your query interface with the data stored within.
Associate	Click Associate to create the storage.

Note: