Databricks

Overview

With the Databricks component, you can produce fully customized Databricks data flows in Semarchy xDI.

The database structure can be fully reverse-engineered and stored in xDI Metadata. You can then use it when designing mappings and processes to adapt your business rules according to your requirements.

Install the Databricks Component

If you did not install it yet, install the Databricks component in Designer by following the component installation process.

Supported features

Common features

Feature Description

Reverse

This technology can be reverse-engineered to xDI Metadata.

DDL/DML Operations

Supports DML/DDL operations, such as Insert, Update, Select, Delete, Create or Drop.

Integration Methods

  • Append

  • Incremental Update

Load Methods

  • Generic Load

Sub-metadata support

The Databricks component lets you create Sub-Metadata on Databricks schema and query folder Metadata nodes.

To learn more about Sub-Metadata, see Work with Sub-metadata.