Semarchy xDI 2024.1 release notes

This document provides the latest information about Semarchy xDI version 2024.1, including new features and bug fixes.

Support information

Semarchy xDI version 2024.1 is a long-term support (LTS) release.

LTS product versions are released annually, and include all changes introduced since the last LTS release. They are maintained and supported for an extended period with patches and fixes.

Alternatively, mainstream support (MS) versions offer the latest improvements and features, and are released more frequently.

For more details about our releases and support policies, see our Support and maintenance terms.

Feature highlights

Semarchy xDI 2024.1 consolidates features and fixes from prior Mainstream Support versions, and adds new features and bug fixes as well. For more information about updates in versions from this past year, refer to these release notes:

Read on for features and changes specific to version 2024.1.

Serializers

xDI 2024.1 introduces serializers, which aid users to transform and integrate complex hierarchical data structures into single text columns. Like with deserializers, users will find an intuitive drag-and-drop interface to add serializers to mappings, and fluid prompts to configure how the serializer functions.

Version 2024.1.0 comes with the JSON as RDBMS Strings serializer, with more to come soon.

New deserializer templates

Semarchy xDI expands on deserializers with dedicated templates to deserialize XML data contained in Greenplum and PostgreSQL database columns.

Runtime metrics, monitoring, and health check

xDI Runtime adds the ability to monitor the Runtime with metrics and health information. This feature gives administrators an overview of the xDI infrastructure health, letting them detect bottlenecks and potential issues.

Expressions with target data

xDI Designer now allows you to use columns from target datastores in mapping expressions when their execution location is set to Target. This feature allows for data manipulation and processing after data has reached its target, removing some previous processing limitations.

New connectors

Azure Service Bus

Semarchy xDI brings initial support for Azure Service Bus, a cloud messaging system for connecting apps and devices across public and private clouds.

Microsoft Azure Cosmos DB

Semarchy xDI adds support for Azure Cosmos DB, allowing you to integrate Microsoft’s multimodel database service with any other supported source or target technology.

This new connector supports the MongoDB and PostgreSQL data models.

Updated connectors

Snowflake - Snowpipe Streaming API

The Snowflake connector has been updated with support for the Snowpipe Streaming API, making it possible to continuously stream rows of data into Snowflake tables.

Elasticsearch version 8

Elasticsearch version 8 is now supported.

Other notable changes

System requirements

Semarchy xDI 2024.1 adds official support for the latest Long Term Support version of Java, Java 21 LTS. Java 17 LTS remains supported.

Support has been added for the following Runtime and Analytics backend databases:

  • Oracle Database 21c

  • PostgreSQL version 15

  • PostgreSQL version 16

  • Microsoft SQL Server 2022.

The following versions are no longer supported as Runtime and Analytics backend databases:

  • Oracle Database 18c and below

  • PostgreSQL versions 11 and below

  • Microsoft SQL Server 2017.

Review Semarchy xDI system requirements here.

Improved sub-metadata support

Sub-metadata support has been expanded in connectors. The Couchbase connector now supports sub-metadata at the cluster and scope level, and the HTTP Rest connector supports it for root and path nodes.

Runtime IPv6

The xDI Runtime now supports IPv6 connections out-of-the-box. This change also applies to access restriction configurations, which now accept IPv6 in single address or CIDR format.

Java JMX now on by default

Java Management Extensions (JMX) are now re-enabled by default. See Java options.

OAuth2 improvements

OAuth2 code has undergone a refactoring to speed up its implementation in other connectors.

Deprecated features

  • This release deprecates some environment variables from older xDI versions. They should be replaced with their current XDI-prefixed equivalents. See Deprecated environment variables.

  • The option to disable certificate checking in Amazon S3 tools has been deprecated, as it is no longer exposed in the latest Amazon SDK.

Removed features

Support for AUTONOMOUS SQL transactions has been removed due to unreliable SQL behavior. In older projects that are still configured to use this transaction type, xDI will interpret those transactions as AUTOCOMMIT instead.

Changelog

2024.1.5

Semarchy xDI Designer

Bug fixes

  • DI-8789: Fixed an issue preventing the Show Used Metadata setting from working.

  • DI-9457: Fixed an issue which made metadata link selector buttons open a process list instead.

  • DI-9488: Fixed an issue which cleared reference nodes when doing a reverse engineer operation on existing metadata.

  • DI-9545: Fixed an issue with mappings where stages with multiple sets did not generate the necessary SQL clauses.

  • DI-9648: Fixed an issue that corrupted processes when merging them with the EMF Compare tool.

Semarchy xDI Runtime

Bug fixes

  • DI-6426: Fixed an issue with looping SQL actions which made statistics cumulative instead of having separate statistics per step.

  • DI-8904: Updated amqp-client third-party libraries.

  • DI-9519: Updated Apache Commons Compress third-party library.

  • DI-9549: Fixed an issue that prevented the buildDelivery script from working when the name of the configuration file contains spaces.

  • DI-9652: Fixed an issue with filters not recognizing SQL syntax errors.

  • DI-9660: Fixed an issue that prevented BLOB fields from loading properly in processes.

  • DI-9666: Updated Spring third-party libraries.

2024.1.4

Semarchy xDI Designer

Bug fixes

  • DI-7854: Fixed an issue which prevented HTTP REST or WSDL authentication with some SSL configurations such as Mutual SSL authentication.

  • DI-9417: Template INTEGRATION File: Fixed an issue which prevented Designer from creating new files when the Truncate Target File option was enabled.

  • DI-9554: Fixed an issue which slowed down prepare or build operations when extracting metadata from Semarchy xDG.

Semarchy xDI Runtime

Bug fixes

  • DI-7854: Fixed an issue which prevented HTTP REST or WSDL authentication with some SSL configurations such as Mutual SSL authentication.

  • DI-9507: Fixed an issue which prevented integration flows from writing files when the file name or path contains ampersand (&) characters.

  • DI-9537: Action Execute SSH commands: fixed an issue which made the action succeed when the SSH login information was incorrect.

  • DI-9548: Updated Spring Web third-party libraries.

License server

Bug fixes

  • DI-9547: Updated Spring Web third-party libraries.

2024.1.3

Semarchy xDI Runtime

Bug fixes

  • DI-9546: Fixed a performance regression on the SQLFileExport process action.

2024.1.2

Semarchy xDI Designer

Bug fixes

  • DI-9272: Fixed an issue that made jobs fail when publishing multiple deliveries at the same time.

  • DI-9274: Fixed an issue preventing XPath expressions from working in a process with a repeated query.

  • DI-9308: Fixed an issue which showed an error when creating an OAuth2 entry for login.microsoftonline.com.

  • DI-9385: Added the ability to disable hostname verification with later Java versions when communicating with the license server.

  • DI-9423: Fixed an issue which prevented multiple deliveries from being built with the CLI when they require multiple user-defined functions.

  • DI-9445: Fixed the error Linked workspace operation failed when renaming Mappings.

  • DI-9476: Fixed an issue which prevented processes from referencing temporary objects.

Semarchy xDI Runtime

Features and improvements

  • DI-9347: Added the ability to escape additional characters in string data, allowing you to process strings with characters such as commas or newlines.

Bug fixes

  • DI-8922: Template Load XML to Hive: fixed an error when string data contains special characters.

  • DI-8932: Removed sensitive technical Java information from the API error response.

  • DI-9422: When access over HTTP is enabled, fixed an issue which blocked connections to the runtime when one allowed host was unreachable.

  • DI-9459: Fixed an issue which added a header to an exported SQL file when a header was not requested.

  • DI-9475: Updated Spring Framework third-party libraries.

Semarchy xDI Production Analytics

Bug fixes

  • DI-9451: When running Analytics in Docker, fixed a java.io.FileNotFoundException error when opening the schedule editor.

License server

Features and improvements

  • DI-9514: Added the ability to stop Java from checking certificate SNI hosts. You can use the disableSNIHostCheck parameter to control this behavior.

Bug fixes

  • DI-9464: Fixed an issue preventing license validation when running multiple instances of xDI Designer on a single machine.

  • DI-9472: Updated Spring Framework third-party libraries.

2024.1.1

xDI Designer

Bug fixes

  • DI-9273: Fix execution errors when installing to a path that contains spaces.

  • DI-9276: Fix java.lang.ClassNotFoundException: com.indy.engine.uberbuilder.executor.UberRunner$Executor error when executing an uber jar file.

  • DI-9278: Fix CLI builds of multiple deliveries at once with multiple user-defined functions.

  • DI-9309: Fix issue with OAuth2 redirect URL when generating a token.

  • DI-9327: Fix CLI package extraction and error logging.

xDI Runtime

Bug fixes

  • DI-8318: Fix loading rows with the RDBMS Replicator when the source is a multi-record file.

  • DI-9242: Stop reporting irrelevant session errors.

  • DI-9251: Support PPK v3 private key files in SSH server metadata.

  • DI-9262: Fix string delimeters for empty values in the SQL FILE EXPORT process action.

  • DI-9276: Fix java.lang.ClassNotFoundException: com.indy.engine.uberbuilder.executor.UberRunner$Executor error when executing an uber jar file.

  • DI-9335: Fix 403 error when calling a delivery with the /nonwsi SOAP endpoint.

2024.1.0

xDI Analytics

Features and improvements

  • DI-8203: Suppress overly verbose information from Tomcat startup logs.

  • DI-8426: Certify PostgreSQL versions 15.x and 16.x for use as Semarchy xDI backend databases.

  • DI-8600: Upgrade Eclipse target platform.

  • DI-8711: Add support for Java 21 LTS.

  • DI-8767: Certify Microsoft SQL Server 2022 for use as a Semarchy xDI backend database.

  • DI-8963: Certify Oracle version 21c for use as a Semarchy xDI backend database.

Bug fixes

  • DI-8831: Upgrade JSON third-party libraries.

  • DI-9036: Fix page access over OpenAPI 3 URL.

xDI Designer

Features and improvements

  • DI-3419: Add support for field expressions that reference target columns when the execution location is set to Target.

  • DI-5353: Add support for Elasticsearch 8.

  • DI-7621: Implement serializer functionality in Designer. Use the serializer in mappings to parse structured data from a source and flatten it to string data.

  • DI-8601: Upgrade eclipse target platform.

  • DI-8710: Add support for Java 21 LTS.

Bug fixes

  • DI-4858: Fix which icons are displayed when a connector technology inherits properties from another one.

  • DI-5757: Fix dragging and dropping inside a metadata reference field on Linux and macOS.

  • DI-7328: Fix inability to create a stage or deserializer when dragging and dropping a schema into a mapping, on Linux instances of Designer.

  • DI-7973: Fix the Metadata Process Palette so the Process Reference parameter selector displays processes instead of metadata only.

  • DI-8441: Refactor HTTP proxy handling; fixes various HTTP errors.

  • DI-8522: Fix removing or replacing output structure in a deserializer.

  • DI-8544: Correctly display only available metadata when opening the metadata creation wizard.

  • DI-8730: Fix error logged when selecting a Deserializer field.

  • DI-8737: xDI Designer freezes when moving items in the project explorer.

  • DI-8783: Handle special characters correctly when using the "WKS:/" prefix to select files in CLI mode.

  • DI-8816: Fix invalid query generated for a mapping when a datastore or stage alias is a reserved word.

  • DI-8872: Executing an Uber runtime does not generate a mapping execution log.

  • DI-8916: Handle directory paths correctly when they contain escape characters such as \t.

  • DI-8966: Missing element IDs may cause errors when copying a mapping.

  • DI-9029: Show an error when a datasource staging area is defined in a mapping, but the component is not installed.

  • DI-9184: Fields and descriptors are deleted when unmapping an expression on a stage.

xDI Runtime

Features and improvements

  • DI-7889: Allow parameters in the scheduler configuration file to properly use environment variables.

  • DI-7945: Add new connector for Azure Service Bus, a cloud messaging as a service platform.

  • DI-8107: Enable IPv6 support in the Runtime by default.

  • DI-8426: Certify PostgreSQL versions 15.x and 16.x for use as Semarchy xDI backend databases.

  • DI-8478: Update Rhino third-party library.

  • DI-8713: Add support for Java 21 LTS.

  • DI-8738: Generate correct URL to access Runtime Swagger/OpenAPI definitions behind a load balancer.

  • DI-8767: Certify Microsoft SQL Server 2022 for use as a Semarchy xDI backend database.

  • DI-8963: Certify Oracle version 21c for use as a Semarchy xDI backend database.

  • DI-8964: Add health and status monitoring capabilities to xDI Runtime.

Bug fixes

  • DI-7370: Remove AUTONOMOUS SQL transaction type, as it has no effect.

  • DI-8451: Remove unused metadata parameter from the file driver JDBC URL.

  • DI-8524: Failed processes do not always close their database connections properly.

  • DI-8681: Delivery cannot be deleted if the internal scheduler is not started.

  • DI-8702: Update Spring third-party library.

  • DI-8703: Fix unclosed statement in exception block.

  • DI-8733: When a runtime is configured to use synchFirstLog mode with log level 0, Java session threads cannot close.

  • DI-8741: Executing a command with the operating system command action takes longer than executing the same command externally.

  • DI-8791: Fix connection pooling error due to SQL To Parameters action failure.

  • DI-8806: Fix runtime connection leak when using autocommit connections.

  • DI-8817: Re-enable JMX by default on the xDI Runtime. This allows xDI Runtime monitoring in environments such as Docker.

  • DI-8835: Correctly parse configuration files with multi-line properties when generating a delivery.

  • DI-8908: JDBC connection properties are cached beyond their expected expiration period.

  • DI-9030: Fix mapping build failure when using a WSDL metadata as target.

  • DI-9053: Update Spring Boot third-party libraries.

  • DI-9054: Update Spring Framework third-party libraries.

License Server

Features and improvements

  • DI-8712: Add support for Java 21 LTS.

Bug fixes

  • DI-8687: Update Jetty third-party library.

  • DI-8865: Update Spring Boot third-party libraries.

  • DI-9049: Update Spring Framework third-party libraries.