Semarchy 2024.2 in brief
Announcing the release of Semarchy Data Intelligence!
Semarchy 2024.2 is a Mainstream Support release introducing the brand new Data Intelligence Module, as well as some exciting new features to our Data Integration and Data Management modules. More details on these features are available in the documentation.
Data Integration (xDI) 2024.2 Feature Highlights
Data Management (xDM) 2024.2 Feature Highlights
- Generative AI enrichers
- Run enrichers on button click
- Start workflow from completed batch
- Deletion approval workflows
- Golden errors recycling
- Record errors visible in collections
Semarchy 2024.2 in detail
Semarchy Data Intelligence
Historically, Semarchy has focused on enterprise data needs. Our journey began together with Master Data Management (xDM), was further developed with the introduction of Data Integration (xDI), and is now more complete with the introduction of Data Intelligence, which includes tools for data cataloging, data governance, and data quality monitoring.
Data Intelligence overview and objectives
Semarchy Data Intelligence empowers you to start at scale or scale-up your enterprise data strategy, providing users with tools to raise metadata visibility above the technical or operational layers, unlike conventional catalogs which are limited to the technical layer. Using specific Data Products related to the business and governance, called initiatives, Data Intelligence provides users with tools to implement their specific data organization to their data assets.
Data Intelligence brings together features related to data quality monitoring, data catalogs, and data governance. Semarchy Data Intelligence is not “yet another” catalog or inventory of assets. By providing an intuitive interface, Data Intelligence provides users across the organization’s complexity with access to pertinent metadata. Semarchy Data Intelligence ensures access and adoption, which augments the probability of a successful data initiative. For more information about specific features and capabilities of Semarchy Data Intelligence, please visit our website.
Semarchy Data Integration (xDI)
Runtime monitoring improvements
Additional metrics are now available in Runtime monitoring, allowing more visibility to health checks and for the retrieval of scheduler metrics. This update provides administrators with more detailed information, allowing them to ensure the proper functioning of the Semarchy Data Integration system, reduce outages, and furnish more efficient data flows.
Updated Snowflake connector
In 2023, Semarchy Data Integration was certified as Snowflake Ready. We have continued to improve our capacity to work with Snowflake by providing Snowpipe Streaming support in the Snowflake replicator template. Using Snowpipe Streaming in the Snowflake replicator allows users to better optimize their loads into Snowflake, potentially reducing costs.
Updated Azure Cosmos DB connector
The Azure Cosmos DB connector now provides support for Table Storage and Cassandra flavors. These technologies appear as lists of metadata available for creation in the Designer.
Updated Azure Service Bus connector
An additional feature has been added to the Azure Service Bus connector, which now supports using local credentials to authenticate wit Microsoft Entra ID. Using Microsoft Entra ID brings token authentication to Azure users, increasing ease of use and security.
XML as RDBMS String serializer
In continuing our efforts to improve efficiency while working with structured data, we have introduced an “XML as RDBMS String” serializer. This serializer helps the user process structured XML data from within a database, taking advantage of RDBMS tools and workflows.
Semarchy Data Management (xDM)
Generative AI enrichers
In this release, we introduce the native capability for architects to leverage GenAI for data enrichment directly in their applications. End users can simply click on a button in the stepper to generate text using GenAI. Prompts can be enhanced with SemQL, making it possible to not only generate text de novo, but also to summarize existing texts or more complex interactions such as extracting information from fields. In parallel, we are also conscious of the need to ensure security, and provide architects with tools to control what information gets shared, when, and with whom. Currently, OpenAI is supported, and additional models and providers, such as Azure OpenAI, Google Gemini, Amazon Bedrock, and Mistral may be available soon.
Start workflow from completed batch
Since the introduction of the Workflow Builder in 2023.1, we have continued to provide tools to increase efficiency in data flowing through the organization. Additional automation is now possible, as Start events can now be triggered on golden or error records resulting from a data load. The ability to automatically start a workflow from a completed batch streamlines the processing of golden or erroneous data in the data management process.
Deletion approval workflows
An additional upgrade to workflows is the Delete Data automation. This feature provides architects with the ability to create workflows specifically designed to review and approve record deletion requests. Furthermore, the Delete Data automation supports use cases involving the deletion of specific elements of a dataset. By facilitating structured deletion processes, the Delete Data automation enhances data management practices. Providing control over when, which, and how records are deleted strengthens data governance efforts.
Golden errors recycling
Error handling is a key component of Master Data Management and is enhanced in this version with the introduction of the ability to recycle post-consolidation errors automatically. Semarchy users have already been able to “reinject” pre-consolidation errors in the SE and AE tables. This is useful, for example, in referential integrity. An error can arise when one record references another record which is missing. If the missing record subsequently becomes available, the error will no longer be produced. By automatically recycling records in loads, these errors can be resolved directly in the validation process. We have now expanded this feature to include post-consolidation errors. This provides designers control on handling errors across the full scope of pre- and post-consolidation.
Record errors visible in collections
In 2024.1, displaying details of errors on error views was introduced. In this release, we have expanded this feature to provide details of errors directly on collections. A new column will display a concatenated list of errors on these records. This provides users with quick and simple access to any errors which may exist in their data.
About Semarchy’s Unified Data Platform
Semarchy, a leader in the master data management and data integration market, enables organizations to rapidly generate business value from their data in as little as 12 weeks. Its unified data platform (xDM + xDI) enables organizations of any size to discover, integrate, enrich, manage, govern, and report critical information scattered across siloed systems.
Semarchy is available on-prem and natively deployable on popular cloud marketplaces such as Microsoft Azure, Amazon Web Services (AWS), and Google Cloud Platform (GCP) or managed as a service supported by a rich ecosystem of software-as-a-service (SaaS) and professional service partners.
We’re Evolving How We Innovate
As a (proven) customer-obsessed company, we’re excited about our regular, quarterly platform release updates for both xDM and xDI. Our clients are data leaders, this commitment will continuously support their strategy. Read more about our xDI and platform release & maintenance cadence updates.