Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Issues with the Kafka broker connections #349

Open
RajKumarManala opened this issue Nov 2, 2022 · 0 comments
Open

Issues with the Kafka broker connections #349

RajKumarManala opened this issue Nov 2, 2022 · 0 comments

Comments

@RajKumarManala
Copy link

RajKumarManala commented Nov 2, 2022

When kafka_exporter do a RefreshMetadata request to get a list of brokers, it get 16 brokers in response that differ in CamelCase addresses

[we-eventhub-.servicebus.windows.net:9093]
[We-eventhub-
.servicebus.windows.net:9093
[WE-eventhub-.servicebus.windows.net:9093
[WE-Eventub-
.servicebus.windows.net:9093]
[WE-EVenthub-.servicebus.windows.net:9093]
[WE-EVEnthub-
.servicebus.windows.net:9093]
[WE-EVENthub-.servicebus.windows.net:9093]
[WE-EVENThub-
.servicebus.windows.net:9093]
[WE-EVENTHub-.servicebus.windows.net:9093]
[WE-EVENTHUb-
.servicebus.windows.net:9093]
[WE-EVENTHUB-.servicebus.windows.net:9093]
[WE-EVENTHUB-
.servicebus.windows.net:9093]
[WE-EVENTHUB-.servicebus.windows.net:9093]
[WE-EVENTHUB-
.servicebus.windows.net:9093]
[WE-EVENTHUB-.servicebus.windows.net:9093]
[WE-EVENTHUB-
.Servicebus.windows.net:9093]

For every time it is increasing the upper case.

The line of code where the request happens:

err := b.sendAndReceive(request, response)

Next, kafka_exporter, in order to collect consumergroup metrics, makes a ListGroupsRequest request for each broker

groups, err := broker.ListGroups(&sarama.ListGroupsRequest{})

For a self-hosted kafka cluster, only part of the list of groups is returned for each broker, and there is no duplication.

At azure event hub, for each request, the full list of groups is returned, as a result, the metrics for Prometheus are duplicated.

An error has occurred while serving metrics:

6030 error(s) occurred:

  • collected metric "kafka_consumergroup_members" { label:<name:"consumergroup" value:"delivery-*" > gauge:<value:2 > } was collected before with the same name and label values
  • collected metric "kafka_consumergroup_members" { label:<name:"consumergroup" value:"cashier-*" > gauge:<value:2 > } was collected before with the same name and label values
  • collected metric "kafka_consumergroup_members" { label:<name:"consumergroup" value:"delivery-*" > gauge:<value:2 > } was collected before with the same name and label values

Related to the same issue already the issue is going on and it was reported in git hub

#306

Concern is this a bug? or normal behavior? Will it be fixed?

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant