Hadoop Component Release Notes
This page lists the main features added to the Hadoop Component.
Feature Highlights
Version 2.2.0
This version contains some minor improvements and fixed issues, which can be found in the complete changelog.
Version 2.0.3
New Template Load Salesforce to Hive
A new dedicated Template to Load data from Salesforce to Hive has been added.
It will provide a better support and optimization than the generic Templates, and handle Hive specificities when loading data from Salesforce.
HDFS File Connect Tool
When a connection issue happens on the "HDFS File Connect Tool", a session variable named "HDFS Error" is now published to provide a better error message.
Change Data Capture (CDC)
Multiple improvements have been performed to homogenize the usage of Change Data Capture (CDC) in the various Components.
Parameters have been homogenized, so that all Templates should now have the same CDC Parameters, with the same support of features.
Multiple fixes have also been performed to correct CDC issues. Refer to the changelog for the exact list of changes.
Change Log
Version 3.0.0 (Component Pack)
New Features
-
DI-4053: Query Editor menu renamed to "Launch Query Editor"
-
DI-4508: Update Components and Designer to take into account dedicated license permissions
-
DI-4727: Rebranding: Templates and sample projects
-
DI-4731: Rebranding: Template messages
-
DI-4813: Rebranding: Drivers classes and URLs
-
DI-4962: Improved component dependencies and requirements management
Version 2.0.3 (Hadoop Component)
New Features
-
DI-1775: New template Load Salesforce to Hive
-
DI-1777: TOOL Hdfs File Connect - an "HDFS Error" session variable is now published when a connection fails, providing more detailed information about the error
-
DI-1910: Templates updated - New parameter 'Cdc Subscriber' on Templates on which it was not handled yet
-
DI-1909: Templates updated - New Parameters 'Unlock Cdc Table' and 'Lock Cdc Table' to configure the behaviour of CDC tables locking
Bug Fixes
-
DI-1729: HDFS File Get Process Tool - Module specification was missing when using WebHDFS mode, which was causing errors as the required dependencies could not be found
-
DI-1908: Templates updated - The 'Cdc Subscriber' parameter was ignored in some Templates on Lock / Unlock CDC steps
-
DI-1907: Templates updated - The 'Cdc Subscriber' parameter was ignored in some Templates when querying the source data