Databricks
Databricks SQL is a compute resource that lets you query and explore data on Databricks.
Overview
The Databricks SQL component lets you work with Databricks data in Semarchy xDI.
You can reverse-engineer the database structure and store it in xDI metadata like other SQL databases. Use this metadata to design mappings and processes, and adapt your business rules according to your requirements.
Install the Databricks SQL component
If you did not install it yet, install the Databricks SQL component in Designer by following the component installation process.
The Databricks SQL component comes with the required JDBC driver.
Supported features
|
On June 24, 2024, Databricks announced that Databricks-managed passwords will reach end of life on July 10, 2024. Databricks recommend using OAuth authentication to authenticate to Databricks APIs. See the Databricks announcement for more details. |
Common features
| Feature | Description |
|---|---|
Reverse |
This technology can be reverse-engineered to xDI Metadata. |
DDL/DML Operations |
Supports DML/DDL operations, such as Insert, Update, Select, Delete, Create or Drop. |
Integration Methods |
|
Load Methods |
|
Sub-metadata support
The Databricks SQL component lets you create Sub-Metadata on Databricks schema and query folder Metadata nodes.
To learn more about Sub-Metadata, see Work with Sub-metadata.