Snowflake component

Overview

With the Snowflake component, you can produce fully customized Snowflake data flows in Semarchy xDI.

The database structure can be fully reverse-engineered and stored in xDI Metadata. You can then use it when designing mappings and processes to adapt your business rules according to your requirements.

Install the Snowflake Component

If you did not install it yet, install the Snowflake component in Designer by following the component installation process.

Supported features

Common features

Feature Description

Reverse

This technology can be reverse-engineered to xDI Metadata.

DDL/DML Operations

Supports DML/DDL operations, such as Insert, Update, Select, Delete, Create or Drop.

Integration Methods

  • Append

  • Incremental Update

Load Methods

  • Generic Load

  • Snowflake COPY Statement

Staging Methods

Can be used as a stage for data transformation, mutualization, and more. The following methods are supported:

  • Staging as Sub-Query

  • Staging as View

  • Staging as Table

Rejects

Supports defining Reject rules to detect or filter out specific data during integrations.

Replication

Supports replicating data to or from this technology using Replicators.

Slowly Changing Dimension (SCD)

Supports the Slowly Changing Dimension (SCD) feature when integrating data in this technology.

Sub-metadata support

The Snowflake component lets you create Sub-Metadata on Snowflake schema and query folder Metadata nodes.

To learn more about Sub-Metadata, see Work with Sub-metadata.

Continuous loading

Snowflake supports continuous data loading pipelines to bypass interim staging tables, optimize data loads, and avoid launching a Virtual Warehouse. The Snowflake connector supports Snowpipe and Snowpipe Streaming pipelines.

External stages

The Snowflake connector can store temporary files in other online locations for optimized performance. The following storage is supported:

  • Snowflake internal stages

  • Amazon S3

  • Google Cloud Storage

  • Microsoft Azure