- bump kafka client to 2.8.1 #115
- Feat: added connections_max_idle_ms setting for output #118
- Refactor: mixins to follow shared mixin module naming
- Update CHANGELOG.md #114
- Added config setting to enable 'zstd' compression in the Kafka output #112
- Refactor: leverage codec when using schema registry #106
Previously using
schema_registry_url
parsed the payload as JSON even ifcodec => 'plain'
was set, this is no longer the case.
- [DOC] Updates description of
enable_auto_commit=false
to clarify that the commit happens after data is fetched AND written to the queue #90 - Fix: update to Gradle 7 #104
- [DOC] Clarify Kafka client does not support proxy #103
- [DOC] Removed a setting recommendation that is no longer applicable for Kafka 2.0+ #99
- Added config setting to enable schema registry validation to be skipped when an authentication scheme unsupported by the validator is used #97
- Fix: Correct the settings to allow basic auth to work properly, either by setting
schema_registry_key/secret
or embedding username/password in the url #94
- Test: specify development dependency version #91
- Improved error handling in the input plugin to avoid errors 'escaping' from the plugin, and crashing the logstash process #87
- Docs: make sure Kafka clients version is updated in docs #83 Since 10.6.0 Kafka client was updated to 2.5.1
- Changed
decorate_events
to add also Kafka headers #78
- Update Jersey dependency to version 2.33 #75
- Fix: dropped usage of SHUTDOWN event deprecated since Logstash 5.0 #71
- Switched use from Faraday to Manticore as HTTP client library to access Schema Registry service to fix issue #63
- Added functionality to Kafka input to use Avro deserializer in retrieving data from Kafka. The schema is retrieved from an instance of Confluent's Schema Registry service #51
- Fix: set (optional) truststore when endpoint id check disabled #60.
Since 10.1.0 disabling server host-name verification (
ssl_endpoint_identification_algorithm => ""
) did not allow the (output) plugin to setssl_truststore_location => "..."
.
- Docs: explain group_id in case of multiple inputs #59
- [DOC]Replaced plugin_header file with plugin_header-integration file. #46
- [DOC]Update kafka client version across kafka integration docs #47
- [DOC]Replace hard-coded kafka client and doc path version numbers with attributes to simplify doc maintenance #48
- Changed: retry sending messages only for retriable exceptions #27
- [DOC] Fixed formatting issues and made minor content edits #43
- added the input
isolation_level
to allow fine control of whether to return transactional messages #44
- added the input and output
client_dns_lookup
parameter to allow control of how DNS requests are made #28
- Changed: config defaults to be aligned with Kafka client defaults #30
- updated kafka client (and its dependencies) to version 2.4.1 (#16)
- added the input
client_rack
parameter to enable support for follower fetching - added the output
partitioner
parameter for tuning partitioning strategy - Refactor: normalized error logging a bit - make sure exception type is logged
- Fix: properly handle empty ssl_endpoint_identification_algorithm #8
- Refactor : made
partition_assignment_strategy
option easier to configure by accepting simple values from an enumerated set instead of requiring lengthy class paths (#25)
- Fix links in changelog pointing to stand-alone plugin changelogs.
- Refactor: scope java_import to plugin class
- Initial release of the Kafka Integration Plugin, which combines previously-separate Kafka plugins and shared dependencies into a single codebase; independent changelogs for previous versions can be found: