HBase

Overview

Semarchy xDI allows to work with HBase to produce fully customized Data Flows.

The database structure can be entirely reversed in Metadata and then used in Mappings and Processes to design and adapt the business rules to meet the user’s requirements.

Supported Features

Common Features

Feature Description

Reverse

Metadata can be reverse engineered.

Additional Features

Feature Description

Kerberos

The Kerberos authentication method is supported

Data Consultation

HBase data can be consulted from the Query Editor like traditional databases

HBase server operations

The Component allows to:

  • create and drop namespaces

  • create, drop, enable, disable or truncate tables

  • create, restore and delete snapshots

HBase data operations

The Component allows to:

  • insert data

  • update data

  • delete data

Transactions

A transaction mechanism has been implemented to allow the user to optionally treat batch of data without being affected by rows newly created in parallel. This offers the possibility to fix a timestamp and treat only data inserted before this time.

Joins / Lookup

The connector allows to join two HBase tables based on their Row Key. This allows to retrieve only the rows from which the Row Key exists in the joined table. It therefore gives the possibility to perform 'lookups' on HBase tables.