Snowflake Component

Overview

Semarchy xDI allows to work with Snowflake to produce fully customized Data Flows.

The database structure can be entirely reversed in Metadata and then used in Mappings and Processes to design and adapt the business rules to meet the user’s requirements.

Install the Snowflake Component

The Snowflake Component is installed from Semarchy xDI Designer using the component installation feature.

Supported Features

Common Features

Feature Description

Reverse

Metadata can be reverse engineered.

DDL/DML Operations

DML/DDL operations can be performed on the database, such as: Insert, Update, Select, Delete, Create or Drop.

Integration Methods

  • Append

  • Incremental Update

Load Methods

  • Generic Load

  • Snowflake COPY Statement

Staging Methods

This technology can be used as a staging to make data transformation, mutualization, and more.

The following methods are supported:

  • Staging as Sub-Query

  • Staging as View

  • Staging as Table

Rejects

Reject rules can be defined to filter or detect data that does not fulfill the rules during integrations.

Replication

Data can be replicated from or to this technology using Replicators.

Slowly Changing Dimension (SCD)

Slowly Changing Dimension (SCD) feature can be used optionnaly when integrating data in this technology.

Sub-Metadata support

The Snowflake component lets you create Sub-Metadata on Snowflake schema and query folder Metadata nodes.

To learn more about Sub-Metadata, see Work with Sub-Metadata.

Continuous loading

Snowflake supports continuous data loading pipelines to bypass interim staging tables, optimize data loads, and avoid launching a Virtual Warehouse. The Snowflake connector supports Snowpipe and Snowpipe Streaming pipelines.

External stages

The Snowflake connector can store temporary files in other online locations for optimized performance. The following storage is supported:

  • Snowflake internal stages

  • Amazon S3

  • Google Cloud Storage

  • Microsoft Azure