Kafka component release notes

This page lists the main features added to the Kafka component.

Changelog

Version 2024.1.1

Bug fixes

  • DI-8824: Update Apache ZooKeeper third-party libraries.

Version 2024.1.0

Features

  • DI-6169: Support External Value Resolver in Kafka raw and Kafka structured.

  • DI-8589: Update Kafka backend to the latest version.

Bug fixes

  • DI-8759: Update Apache Avro third-party libraries.

  • DI-8830: Update JSON third-party libraries.

  • DI-8861: Temporary tables are not cleaned up correctly at the end of a process.

Version 2023.4.0

Features

  • DI-8190: Third-party library upgrade.

Version 2023.2.0

Bug fixes

  • DI-6324: When using Kafka structured as source, the Load Kafka Structure to RDBMS template does not create the Load_Temporal table and an insert error occurs at the integration step.

Version 2023.1.13

New Features

  • DI-9620: Added Semarchy Data Intelligence harvesting features.

Version 2023.1.9

Bug Fixes

  • DI-8824: Update Apache ZooKeeper third-party libraries.

Version 2023.1.8

Bug fixes

  • DI-8759: Update Apache Avro third-party libraries.

  • DI-8830: Update JSON third-party libraries.

  • DI-8861: Temporary tables are not cleaned up correctly at the end of a process.

Version 2023.1.5 (component pack)

Bug fixes

  • DI-8220: Third-party library upgrade.

  • DI-7989: Third-party library upgrade.

  • DI-7908: Third-party library upgrade.

Version 2023.1.2 (component pack)

Bug fixes

  • DI-6324: When using Kafka structured as source, the Load Kafka Structure to RDBMS template does not create the Load_Temporal table and an insert error occurs at the integration step.

Version 2023.1.0 (component pack)

Features

  • DI-4661: The Create indexes on Target Table parameter has been added to the INTEGRATION Kafka to Rdbms template.

  • DI-6300: The Kafka 3.2 is now supported.

Bug fixes

  • DI-6298: Multiple third-party libraries upgrade.

  • DI-6316: SnakeYAML - Third-party library upgrade.

  • DI-6520: Jackson - Third-party library upgrade.

Version 5.3.8 (component pack)

Bug fixes

  • DI-6304: When using Kafka structured as source and an RDBMS table as stage target, the load template fails to load data into the stage as well as into the temporary load tables.

Version 3.0.0 (component pack)

Features

  • DI-3701: Allow Components to contribute to Designer monitored statistics

  • DI-4053: Query Editor menu renamed to "Launch Query Editor"

  • DI-4508: Update Components and Designer to take into account dedicated license permissions

  • DI-4813: Rebranding: Drivers classes and URLs

  • DI-4962: Improved component dependencies and requirements management

Version 2.0.2 (Kafka component)

Features

  • DI-1298: INTEGRATION Kafka to File Template - Addition of the "Batch Size" parameter to define how many messages must be read from the topic before writing to the file

  • DI-1940: Support synchronous mode when sending messages (new attribute and parameter in Metadata and Templates are available to define the write mode)

  • DI-1909: Templates updated - New Parameters 'Unlock Cdc Table' and 'Lock Cdc Table' to configure the behaviour of CDC tables locking

Bug fixes

  • DI-1913: An error was thrown when trying to connect to a secure Kafka server, such as "KafkaException: javax.security.auth.login.LoginException: unable to find LoginModule class: org.apache.kafka.common.security.plain.PlainLoginModule"

  • DI-2162: The Component was not working on Topics having a dot in the name

  • DI-2658: Kafka Metadata - 'connect to database' context menu was not working

  • DI-1908: Templates updated - The 'Cdc Subscriber' parameter was ignored in some Templates on Lock / Unlock CDC steps

  • DI-1907: Templates updated - The 'Cdc Subscriber' parameter was ignored in some Templates when querying the source data

Version 2.1.0 (Kafka component)

Features

  • DI-3713: Internal change on how some libraries are built to ease maintenance