Hive

Overview

Semarchy xDM Data Integration allows to work with Hive to produce fully customized Data Flows.

The database structure can be entirely reversed in Metadata and then used in Mappings and Processes to design and adapt the business rules to meet the user’s requirements.

Supported Features

Common Features

Feature Description

Reverse

Metadata can be reverse engineered.

DDL/DML Operations

DML/DDL operations can be performed on the database, such as: Insert, Update, Select, Delete, Create or Drop.

Integration Methods

  • Append

  • Incremental Update

Load Methods

  • Load through HDFS

  • Load through Sqoop

Staging Methods

This technology can be used as a staging to make data transformation, mutualization, and more.

The following methods are supported:

  • Staging as Sub-Query

  • Staging as View

  • Staging as Table

Rejects

Reject rules can be defined to filter or detect data that does not fulfill the rules during integrations.

Replication

Data can be replicated from or to this technology using Replicators.

Additional Features

Feature Description

Kerberos

The Kerberos authentication method is supported