Getting Started with Apache Parquet
This article explains how to reverse-engineer Apache Parquet files in Semarchy xDI and use them in mappings to send and receive data. Apache Parquet files are open-source files used for storing data in columnar format.
To create an Apache Parquet metadata:
Right-click a folder in your project and then select New > Metadata.
In the New Metadata wizard, select Parquet and then click Next.
Name the metadata and click Next.
Select the installed module and click Finish.
The metadata is created with a root Schemas node. This node will contain the Apache Parquet files you will reverse-engineer.
To reverse-engineer an Apache Parquet file:
Right-click the Schemas node and select New > Schema.
Select the newly created Schema node. Set the File Path property to the path of the Apache Parquet file.
Right-click the Schema node and select Action > Reverse.
The Apache Parquet file is reverse-engineered as a schema node and is ready to use into mappings.
Drag and drop the Apache Parquet files (the schema nodes) defined in your metadata into mappings to integrate data from and to these Apache Parquet files.
The following example shows how to integrate data from an Apache Parquet file to a database table.