Configuring normal lookup operations
You configure the Hive connector to perform a normal lookup on an Hive database.
- To specify the format of the data records that the Hive connector reads from an Hive database, set up column definitions on a link.
- Configure the Hive connector as a source for the reference data.
In a normal lookup, the connector runs the specified SELECT statement only one time; therefore, the SELECT statement cannot include any input parameters. The Lookup stage searches the result set data that is provided by the connector and looks for matches for the parameter sets that arrive in the form of records on the input link to the Lookup stage. A normal lookup is also known as an in-memory lookup because the lookup is performed on the cached data in memory.Typically you use a normal lookup when the target table is small enough that all of the rows in the table can fit in memory.
Typically you use a normal lookup when the target table is small enough that all of the rows in the table can fit in memory.