Snowflake Component Release Notes

This page lists the main features added to the Snowflake Component.

Feature Highlights

Version 2.1.3

Minor improvements and fixed issues

This version contains some minor improvements and fixed issues, which can be found in the complete changelog.

Version 2.1.2

Support additional timestamp types

Snowflake Component supports timestamp_ltz and timestamp_tz types.

Version 2.1.1

Work tables as transients

To reduce the cost of storage, addition of the keyword 'transient' (transient tables) to the creation of temporary tables.

The use of temporary tables do not need to have safe-back.

A transient table in Snowflake exists until it is explicitly destroyed and is visible to any user with the appropriate privileges.

Version 2.1.0

External Storage Attribute

Snowflake Component already supports storing temporary files inside external locations such as Microsoft Azure Storage or Amazon S3.

The Snowflake Metadata has been improved on this point, to automatically provide the list of storage nodes available in the workspace which can be used as external storage.

This allows to have a quick list without having to search them on your workspace.

snowflake release notes storage link list

Version 2.0.3

Minor improvements and fixed issues

This version contains some minor improvements and fixed issues, which can be found in the complete changelog.

Version 2.0.2

Tool Warehouse Operation

Snowflake allows to start / suspend the warehouse containing data, which allows to optimize costs and start it only when needed.

A new Process Tool has been added to allow starting / stopping Snowflake warehouses in your Processes.

You can use this to, as an example, start your warehouse at the beginning of you Process, then perform all your operations and, finally, suspend it at the end.

snowflake release notes tool warehouse operation

A Snowflake Metadata Link must be defined on the tool.

Then, specify the name of the Warehouse and the operation such as RESUME or SUSPEND.

Change Data Capture (CDC)

Multiple improvements have been performed to homogenize the usage of Change Data Capture (CDC) in the various Components.

Parameters have been homogenized, so that all Templates should now have the same CDC Parameters, with the same support of features.

Multiple fixes have also been performed to correct CDC issues. Refer to the changelog for the exact list of changes.

Version 2.0.1

Sample Project

The component example project can now be imported directly in the "New" menu of the Project Explorer.

Change Log

Version 2023.1.5

Bug Fix

  • DI-8113: Load Rdbms to Snowflake: incorrect file path generated when using s3 as external storage

  • DI-8286: Third-Party library upgrade.

Version 2023.1.3

New Features

  • DI-7766: Snowflake JDBC driver Third-Party library upgrade.

Version 2023.1.2

New Feature

  • DI-6683: The Positional File Processing property has been added to the Load file to Snowflake template to support positional files.

Version 2023.1.1

Bug Fix

  • DI-6578: In the Load Rdbms to Snowflake template, when the String Delimiter option is enabled, the mapping fails to compile.

Version 2023.1.0

New Features

  • DI-1093: The Load External Storage File to Snowflake template is now available for loading files already present in an external storage into a target Snowflake table.

  • DI-5015: Designing and reading JSON data contained in a VARIANT column is now supported.

  • DI-6197: Snowflake JDBC driver upgraded to version 3.13.22.

  • DI-6224: The Replicator Rdbms to Snowflake tool is now available. This tool can be used to replicate data to Snwoflake using Snowpipe.

  • DI-6235: Google Cloud is now supported as an external storage location.

  • DI-6301: The Storage Access Method parameter has been added to the metadata. It allows defining the method to use to access the external storage: using credentials or using storage integration defined in Snowflake.

  • DI-6341: The Snowpipe finger tab has been added to the metadata. Snowpipe allows ingesting data files from Snowflake stages directly into Snowflake tables without having to launch the warehouse.

Bug Fix

  • DI-5029: Some error messages returned by the Load Wsdl to Rdbms template may not be relevant in finding the cause of the error.

Version 5.3.8 (Component Pack)

New Features

  • DI-6262: The technology definition has been updated to mention that indexes are not supported. Thus, the generic templates do not try to create indexes on this database.

Version 5.3.7 (Component Pack)

New Features

  • DI-5015: Support designing and reading JSON data contained in a VARIANT column.

Bug Fixes

  • DI-5029: When being used with Snowflake as a target, error messages returned by "Load Wsdl to Rdbms Template" might not be relevant to find the real cause of the error.

  • DI-6197: Update the Snowflake JDBC driver third-party library to version 3.13.22.

Version 3.0.0 (Component Pack)

New Features

  • DI-4508: Update Components and Designer to take into account dedicated license permissions

  • DI-4731: Rebranding: Template messages

  • DI-4962: Improved component dependencies and requirements management

  • DI-5014: Support QUALIFY clause in Snowflake

Version 2.1.3 (Snowflake Component)

New Features

  • DI-4855: Support "Technical Columns Prefix" on Reject and Integration Templates

Version 2.1.2 (Snowflake Component)

New Features

  • DI-4849: Snowflake - add support for additional timestamp types

Version 2.1.1 (Snowflake Component)

New Features

  • DI-4404: Snowflake - all work tables are now created as transient

Version 2.1.0 (Snowflake Component)

New Features

  • DI-2854: Microsoft Azure Storage and Amazon S3 Bucket nodes available in the workspace are now proposed automatically in Snowflake Metadata in External Storage attribute

Version 2.0.3 (Snowflake Component)

Bug Fixes

  • DI-2696: Snowflake - full outer joins were not working

  • DI-2741: Template - LOAD Rdbms to Snowflake - generated temporary file names may unexpectedly contain object delimiters

Version 2.0.2 (Snowflake Component)

New Features

  • DI-1056: Addition of a new Process Tool which allows to perform operations on a Snowflake Warehouse, such as starting or suspending a warehouse

  • DI-1910: Templates updated - New parameter 'Cdc Subscriber' on Templates on which it was not handled yet

  • DI-1909: Templates updated - New Parameters 'Unlock Cdc Table' and 'Lock Cdc Table' to configure the behaviour of CDC tables locking

Bug Fixes

  • DI-1554: Load Rdbms to Snowflake Template - an exception was displayed when loading data through S3 storage, because the Module specification on S3 step was missing, avoiding the step to properly find the required dependencies

  • DI-1908: Templates updated - The 'Cdc Subscriber' parameter was ignored in some Templates on Lock / Unlock CDC steps

  • DI-1907: Templates updated - The 'Cdc Subscriber' parameter was ignored in some Templates when querying the source data