Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

AttributeError: 'KafkaClient' object has no attribute 'schedule' #12

Closed
akamalov opened this issue Apr 3, 2018 · 3 comments
Closed

AttributeError: 'KafkaClient' object has no attribute 'schedule' #12

akamalov opened this issue Apr 3, 2018 · 3 comments
Assignees
@braedon
Labels
bug
Milestone
release-0.4

Comments

@akamalov
Copy link

akamalov commented Apr 3, 2018

Thanks for the awesome repository. Getting a problem running it.

Environment

OS: RHEL 7.3
Python: 3.5.5

Here is the debug information:

[root@node32p1v ~]# /usr/bin/prometheus-kafka-consumer-group-exporter --bootstrap-brokers server-prod-k1,server-prod-k2,server-prod-k3 --consumer-config ./consumer.properties -p 9208 --from-start -vvv

[2018-04-03 12:54:57,616] kafka.metrics.metrics.DEBUG MainThread Added sensor with name connections-closed
[2018-04-03 12:54:57,616] kafka.metrics.metrics.DEBUG MainThread Added sensor with name connections-created
[2018-04-03 12:54:57,616] kafka.metrics.metrics.DEBUG MainThread Added sensor with name select-time
[2018-04-03 12:54:57,616] kafka.metrics.metrics.DEBUG MainThread Added sensor with name io-time
[2018-04-03 12:54:57,617] kafka.client.INFO MainThread Bootstrapping cluster metadata from [('server-prod-k2', 9092, <AddressFamily.AF_UNSPEC: 0>), ('server-prod-k3', 9092, <AddressFamily.AF_UNSPEC: 0>), ('server-prod-k1', 9092, <AddressFamily.AF_UNSPEC: 0>)]
[2018-04-03 12:54:57,617] kafka.client.DEBUG MainThread Attempting to bootstrap via node at server-prod-k2:9092
[2018-04-03 12:54:57,617] kafka.metrics.metrics.DEBUG MainThread Added sensor with name bytes-sent-received
[2018-04-03 12:54:57,617] kafka.metrics.metrics.DEBUG MainThread Added sensor with name bytes-sent
[2018-04-03 12:54:57,617] kafka.metrics.metrics.DEBUG MainThread Added sensor with name bytes-received
[2018-04-03 12:54:57,618] kafka.metrics.metrics.DEBUG MainThread Added sensor with name request-latency
[2018-04-03 12:54:57,618] kafka.metrics.metrics.DEBUG MainThread Added sensor with name node-bootstrap.bytes-sent
[2018-04-03 12:54:57,618] kafka.metrics.metrics.DEBUG MainThread Added sensor with name node-bootstrap.bytes-received
[2018-04-03 12:54:57,618] kafka.metrics.metrics.DEBUG MainThread Added sensor with name node-bootstrap.latency
[2018-04-03 12:54:57,621] kafka.conn.DEBUG MainThread <BrokerConnection node_id=bootstrap host=server-prod-k2:9092 <disconnected> [unspecified None]>: creating new socket
[2018-04-03 12:54:57,621] kafka.conn.DEBUG MainThread <BrokerConnection node_id=bootstrap host=server-prod-k2:9092 <disconnected> [IPv4 ('192.168.1.27', 9092)]>: setting socket option (6, 1, 1)
[2018-04-03 12:54:57,621] kafka.conn.INFO MainThread <BrokerConnection node_id=bootstrap host=server-prod-k2:9092 <connecting> [IPv4 ('192.168.1.27', 9092)]>: connecting to server-prod-k2:9092 [('192.168.1.27', 9092) IPv4]
[2018-04-03 12:54:57,621] kafka.conn.DEBUG MainThread <BrokerConnection node_id=bootstrap host=server-prod-k2:9092 <connecting> [IPv4 ('192.168.1.27', 9092)]>: established TCP connection
[2018-04-03 12:54:57,621] kafka.conn.DEBUG MainThread <BrokerConnection node_id=bootstrap host=server-prod-k2:9092 <connecting> [IPv4 ('192.168.1.27', 9092)]>: initiating SASL authentication
[2018-04-03 12:54:57,622] kafka.protocol.parser.DEBUG MainThread Sending request SaslHandShakeRequest_v0(mechanism='PLAIN')
[2018-04-03 12:54:57,622] kafka.conn.DEBUG MainThread <BrokerConnection node_id=bootstrap host=server-prod-k2:9092 <authenticating> [IPv4 ('192.168.1.27', 9092)]> Request 1: SaslHandShakeRequest_v0(mechanism='PLAIN')
[2018-04-03 12:54:57,622] kafka.protocol.parser.DEBUG MainThread Received correlation id: 1
[2018-04-03 12:54:57,622] kafka.protocol.parser.DEBUG MainThread Processing response SaslHandShakeResponse_v0
[2018-04-03 12:54:57,623] kafka.conn.DEBUG MainThread <BrokerConnection node_id=bootstrap host=server-prod-k2:9092 <authenticating> [IPv4 ('192.168.1.27', 9092)]> Response 1 (0.6525516510009766 ms): SaslHandShakeResponse_v0(error_code=0, enabled_mechanisms=['PLAIN'])
[2018-04-03 12:54:57,623] kafka.conn.WARNING MainThread <BrokerConnection node_id=bootstrap host=server-prod-k2:9092 <authenticating> [IPv4 ('192.168.1.27', 9092)]>: Sending username and password in the clear
[2018-04-03 12:54:57,623] kafka.conn.INFO MainThread <BrokerConnection node_id=bootstrap host=server-prod-k2:9092 <authenticating> [IPv4 ('192.168.1.27', 9092)]>: Authenticated as admin via PLAIN
[2018-04-03 12:54:57,623] kafka.conn.INFO MainThread <BrokerConnection node_id=bootstrap host=server-prod-k2:9092 <authenticating> [IPv4 ('192.168.1.27', 9092)]>: Connection complete.
[2018-04-03 12:54:57,623] kafka.client.DEBUG MainThread Node bootstrap connected
[2018-04-03 12:54:57,623] kafka.protocol.parser.DEBUG MainThread Sending request MetadataRequest_v0(topics=[])
[2018-04-03 12:54:57,624] kafka.conn.DEBUG MainThread <BrokerConnection node_id=bootstrap host=server-prod-k2:9092 <connected> [IPv4 ('192.168.1.27', 9092)]> Request 2: MetadataRequest_v0(topics=[])
[2018-04-03 12:54:57,625] kafka.protocol.parser.DEBUG MainThread Received correlation id: 2
[2018-04-03 12:54:57,625] kafka.protocol.parser.DEBUG MainThread Processing response MetadataResponse_v0
[2018-04-03 12:54:57,629] kafka.conn.DEBUG MainThread <BrokerConnection node_id=bootstrap host=server-prod-k2:9092 <connected> [IPv4 ('192.168.1.27', 9092)]> Response 2 (5.729436874389648 ms): MetadataResponse_v0(brokers=[(node_id=17, host='node6spcv.localnet.net', port=9092), (node_id=8, host='node6sp3v.localnet.net', port=9092), (node_id=11, host='node6sp6v.localnet.net', port=9092), (node_id=2, host='node32p2v.localnet.net', port=9092), (node_id=5, host='node32p5v.localnet.net', port=9092), (node_id=14, host='node6sp9v.localnet.net', port=9092), (node_id=13, host='node6sp8v.localnet.net', port=9092), (node_id=4, host='node32p4v.localnet.net', port=9092), (node_id=7, host='node6sp2v.localnet.net', port=9092), (node_id=16, host='node6spbv.localnet.net', port=9092), (node_id=10, host='node6sp5v.localnet.net', port=9092), (node_id=1, host='node32p1v.localnet.net', port=9092), (node_id=9, host='node6sp4v.localnet.net', port=9092), (node_id=3, host='node32p3v.localnet.net', port=9092), (node_id=12, host='node6sp7v.localnet.net', port=9092), (node_id=6, host='node6sp1v.localnet.net', port=9092), (node_id=15, host='node6spav.localnet.net', port=9092)], topics=[(error_code=0, topic='REP_GDP_CET_EVENT_INPUT_REJECT_ES_CNJ', partitions=[(error_code=0, partition=8, leader=16, replicas=[16, 4, 5], isr=[16, 5, 4]), (error_code=0, partition=11, leader=2, replicas=[2, 7, 8], isr=[2, 7, 8]), (error_code=0, partition=2, leader=10, replicas=[10, 15, 16], isr=[10, 15, 16]), (error_code=0, partition=5, leader=13, replicas=[13, 1, 2], isr=[13, 2, 1]), (error_code=0, partition=14, leader=5, replicas=[5, 10, 11], isr=[10, 11, 5]), (error_code=0, partition=4, leader=12, replicas=[12, 17, 1], isr=[12, 17, 1]), (error_code=0, partition=13, leader=4, replicas=[4, 9, 10], isr=[10, 9, 4]), (error_code=0, partition=7, leader=15, replicas=[15, 3, 4], isr=[15, 3, 4]), (error_code=0, partition=10, leader=1, replicas=[1, 6, 7], isr=[6, 7, 1]), (error_code=0, partition=1, leader=9, replicas=[9, 14, 15], isr=[14, 15, 9]), (error_code=0, partition=9, leader=17, replicas=[17, 5, 6], isr=[17, 5, 6]), (error_code=0, partition=3, leader=11, replicas=[11, 16, 17], isr=[11, 16, 17]), (error_code=0, partition=12, leader=3, replicas=[3, 8, 9], isr=[3, 8, 9]), (error_code=0, partition=6, leader=14, replicas=[14, 2, 3], isr=[14, 2, 3]), (error_code=0, partition=0, leader=8, replicas=[8, 13, 14], isr=[13, 14, 8])]), (error_code=0, topic='REP_GDP_CET_EVENT_INPUT_REJECT_ES_TPC', partitions=[(error_code=0, partition=8, leader=16, replicas=[16, 8, 9], isr=[16, 8, 9]), (error_code=0, partition=11, leader=2, replicas=[2, 11, 12], isr=[11, 12, 2]), (error_code=0, partition=2, leader=10, replicas=[10, 2, 3], isr=[10, 2, 3]), (error_code=0, partition=5, leader=13, replicas=[13, 5, 6], isr=[13, 5, 6]), (error_code=0, partition=14, leader=5, replicas=[5, 14, 15], isr=[14, 15, 5]), (error_code=0, partition=4, leader=12, replicas=[12, 4, 5], isr=[12, 5, 4]), (error_code=0, partition=13, leader=4, replicas=[4, 13, 14], isr=[13, 14, 4]), (error_code=0, partition=7, leader=15, replicas=[15, 7, 8], isr=[15, 7, 8]), (error_code=0, partition=10, leader=1, replicas=[1, 10, 11], isr=[10, 11, 1]), (error_code=0, partition=1, leader=9, replicas=[9, 1, 2], isr=[2, 9, 1]), (error_code=0, partition=9, leader=17, replicas=[17, 9, 10], isr=[10, 17, 9]), (error_code=0, partition=3, leader=11, replicas=[11, 3, 4], isr=[11, 3, 4]), (error_code=0, partition=12, leader=3, replicas=[3, 12, 13], isr=[12, 13, 3]), (error_code=0, partition=6, leader=14, replicas=[14, 6, 7], isr=[14, 6, 7]), (error_code=0, partition=0, leader=8, replicas=[8, 17, 1], isr=[17, 8, 1])]), (error_code=0, topic='_connect_DP-cnj-prod-connect_configs', partitions=[(error_code=0, partition=0, leader=4, replicas=[4, 17, 11], isr=[4, 17, 11])]), (error_code=0, topic='_connect_DP-cnj-prod-connect_offsets', partitions=[(error_code=0, partition=23, leader=2, replicas=[2, 14, 13], isr=[2, 14, 13]), (error_code=0, partition=8, leader=14, replicas=[14, 13, 4], isr=[14, 13, 4]), (error_code=0, partition=17, leader=12, replicas=[12, 6, 17], isr=[12, 6, 17]), (error_code=0, partition=11, leader=16, replicas=[16, 7, 1], isr=[16, 7, 1]), (error_code=0, partition=2, leader=6, replicas=[6, 17, 8], isr=[6, 17, 8]), (error_code=0, partition=20, leader=17, replicas=[17, 11, 2], isr=[17, 11, 2]), (error_code=0, partition=5, leader=11, replicas=[11, 2, 5], isr=[11, 2, 5]), (error_code=0, partition=14, leader=10, replicas=[10, 9, 3], isr=[10, 9, 3]), (error_code=0, partition=4, leader=8, replicas=[8, 11, 2], isr=[8, 11, 2]), (error_code=0, partition=13, leader=1, replicas=[1, 10, 9], isr=[1, 10, 9]), (error_code=0, partition=22, leader=11, replicas=[11, 5, 14], isr=[11, 5, 14]), (error_code=0, partition=16, leader=3, replicas=[3, 12, 15], isr=[3, 12, 15]), (error_code=0, partition=7, leader=5, replicas=[5, 14, 13], isr=[5, 14, 13]), (error_code=0, partition=10, leader=4, replicas=[4, 16, 7], isr=[4, 16, 7]), (error_code=0, partition=1, leader=15, replicas=[15, 6, 17], isr=[15, 6, 17]), (error_code=0, partition=19, leader=6, replicas=[6, 8, 11], isr=[6, 8, 11]), (error_code=0, partition=18, leader=15, replicas=[15, 17, 8], isr=[15, 17, 8]), (error_code=0, partition=9, leader=13, replicas=[13, 4, 16], isr=[13, 4, 16]), (error_code=0, partition=12, leader=7, replicas=[7, 1, 10], isr=[7, 1, 10]), (error_code=0, partition=21, leader=8, replicas=[8, 2, 5], isr=[8, 2, 5]), (error_code=0, partition=3, leader=17, replicas=[17, 8, 11], isr=[17, 8, 11]), (error_code=0, partition=15, leader=9, replicas=[9, 3, 12], isr=[9, 3, 12]), (error_code=0, partition=6, leader=2, replicas=[2, 5, 14], isr=[2, 5, 14]), (error_code=0, partition=24, leader=5, replicas=[5, 13, 4], isr=[5, 13, 4]), (error_code=0, partition=0, leader=12, replicas=[12, 15, 6], isr=[12, 15, 6])]), (error_code=0, topic='__consumer_offsets', partitions=[(error_code=0, partition=23, leader=4, replicas=[4, 6, 7], isr=[6, 7, 4]), (error_code=0, partition=32, leader=13, replicas=[13, 15, 16], isr=[13, 15, 16]), (error_code=0, partition=41, leader=5, replicas=[5, 8, 9], isr=[5, 8, 9]), (error_code=0, partition=17, leader=15, replicas=[15, 17, 1], isr=[15, 17, 1]), (error_code=0, partition=8, leader=6, replicas=[6, 7, 8], isr=[6, 7, 8]), (error_code=0, partition=44, leader=8, replicas=[8, 11, 12], isr=[11, 12, 8]), (error_code=0, partition=35, leader=16, replicas=[16, 2, 3], isr=[16, 2, 3]), (error_code=0, partition=26, leader=7, replicas=[7, 9, 10], isr=[10, 7, 9]), (error_code=0, partition=11, leader=9, replicas=[9, 10, 11], isr=[10, 11, 9]), (error_code=0, partition=47, leader=11, replicas=[11, 14, 15], isr=[11, 14, 15]), (error_code=0, partition=38, leader=2, replicas=[2, 5, 6], isr=[2, 5, 6]), (error_code=0, partition=29, leader=10, replicas=[10, 12, 13], isr=[10, 12, 13]), (error_code=0, partition=20, leader=1, replicas=[1, 3, 4], isr=[3, 4, 1]), (error_code=0, partition=2, leader=17, replicas=[17, 1, 2], isr=[17, 2, 1]), (error_code=0, partition=5, leader=3, replicas=[3, 4, 5], isr=[3, 5, 4]), (error_code=0, partition=14, leader=12, replicas=[12, 13, 14], isr=[12, 13, 14]), (error_code=0, partition=46, leader=10, replicas=[10, 13, 14], isr=[10, 13, 14]), (error_code=0, partition=40, leader=4, replicas=[4, 7, 8], isr=[7, 8, 4]), (error_code=0, partition=49, leader=13, replicas=[13, 16, 17], isr=[13, 16, 17]), (error_code=0, partition=13, leader=11, replicas=[11, 12, 13], isr=[11, 12, 13]), (error_code=0, partition=4, leader=2, replicas=[2, 3, 4], isr=[2, 3, 4]), (error_code=0, partition=31, leader=12, replicas=[12, 14, 15], isr=[12, 14, 15]), (error_code=0, partition=22, leader=3, replicas=[3, 5, 6], isr=[3, 5, 6]), (error_code=0, partition=16, leader=14, replicas=[14, 15, 16], isr=[14, 15, 16]), (error_code=0, partition=7, leader=5, replicas=[5, 6, 7], isr=[5, 6, 7]), (error_code=0, partition=43, leader=7, replicas=[7, 10, 11], isr=[10, 11, 7]), (error_code=0, partition=25, leader=6, replicas=[6, 8, 9], isr=[6, 8, 9]), (error_code=0, partition=34, leader=15, replicas=[15, 1, 2], isr=[15, 2, 1]), (error_code=0, partition=10, leader=8, replicas=[8, 9, 10], isr=[10, 8, 9]), (error_code=0, partition=37, leader=1, replicas=[1, 4, 5], isr=[5, 4, 1]), (error_code=0, partition=1, leader=16, replicas=[16, 17, 1], isr=[16, 17, 1]), (error_code=0, partition=19, leader=17, replicas=[17, 2, 3], isr=[17, 2, 3]), (error_code=0, partition=28, leader=9, replicas=[9, 11, 12], isr=[11, 12, 9]), (error_code=0, partition=45, leader=9, replicas=[9, 12, 13], isr=[12, 13, 9]), (error_code=0, partition=36, leader=17, replicas=[17, 3, 4], isr=[17, 3, 4]), (error_code=0, partition=27, leader=8, replicas=[8, 10, 11], isr=[10, 11, 8]), (error_code=0, partition=9, leader=7, replicas=[7, 8, 9], isr=[7, 8, 9]), (error_code=0, partition=18, leader=16, replicas=[16, 1, 2], isr=[16, 2, 1]), (error_code=0, partition=48, leader=12, replicas=[12, 15, 16], isr=[12, 15, 16]), (error_code=0, partition=21, leader=2, replicas=[2, 4, 5], isr=[2, 5, 4]), (error_code=0, partition=12, leader=10, replicas=[10, 11, 12], isr=[10, 11, 12]), (error_code=0, partition=3, leader=1, replicas=[1, 2, 3], isr=[2, 3, 1]), (error_code=0, partition=30, leader=11, replicas=[11, 13, 14], isr=[11, 13, 14]), (error_code=0, partition=39, leader=3, replicas=[3, 6, 7], isr=[3, 6, 7]), (error_code=0, partition=15, leader=13, replicas=[13, 14, 15], isr=[13, 14, 15]), (error_code=0, partition=42, leader=6, replicas=[6, 9, 10], isr=[10, 6, 9]), (error_code=0, partition=6, leader=4, replicas=[4, 5, 6], isr=[5, 6, 4]), (error_code=0, partition=24, leader=5, replicas=[5, 7, 8], isr=[5, 7, 8]), (error_code=0, partition=33, leader=14, replicas=[14, 16, 17], isr=[14, 16, 17]), (error_code=0, partition=0, leader=15, replicas=[15, 16, 17], isr=[15, 16, 17])]), (error_code=0, topic='FROM_TPC_ALEX_00001', partitions=[(error_code=0, partition=2, leader=3, replicas=[3, 11, 12], isr=[3, 11, 12]), (error_code=0, partition=5, leader=6, replicas=[6, 14, 15], isr=[6, 14, 15]), (error_code=0, partition=4, leader=5, replicas=[5, 13, 14], isr=[5, 13, 14]), (error_code=0, partition=1, leader=2, replicas=[2, 10, 11], isr=[2, 10, 11]), (error_code=0, partition=3, leader=4, replicas=[4, 12, 13], isr=[4, 12, 13]), (error_code=0, partition=0, leader=1, replicas=[1, 9, 10], isr=[1, 9, 10])]), (error_code=0, topic='_connect_DP-cnj-prod-connect_status', partitions=[(error_code=0, partition=2, leader=9, replicas=[9, 16, 10], isr=[9, 16, 10]), (error_code=0, partition=4, leader=12, replicas=[12, 1, 9], isr=[12, 1, 9]), (error_code=0, partition=1, leader=1, replicas=[1, 7, 16], isr=[1, 7, 16]), (error_code=0, partition=3, leader=3, replicas=[3, 10, 1], isr=[3, 10, 1]), (error_code=0, partition=0, leader=10, replicas=[10, 13, 7], isr=[10, 13, 7])])])
[2018-04-03 12:54:57,632] kafka.cluster.DEBUG MainThread Updated cluster metadata to ClusterMetadata(brokers: 17, topics: 7, groups: 0)
[2018-04-03 12:54:57,632] kafka.client.INFO MainThread Bootstrap succeeded: found 17 brokers and 7 topics.
[2018-04-03 12:54:57,632] kafka.conn.INFO MainThread <BrokerConnection node_id=bootstrap host=server-prod-k2:9092 <connected> [IPv4 ('192.168.1.27', 9092)]>: Closing connection.
[2018-04-03 12:54:57,632] kafka.conn.DEBUG MainThread <BrokerConnection node_id=bootstrap host=server-prod-k2:9092 <disconnecting> [IPv4 ('192.168.1.27', 9092)]>: reconnect backoff 0.054724131293705944 after 1 failures
[2018-04-03 12:54:57,632] kafka.client.DEBUG MainThread Initiating connection to node 12 at node6sp7v.localnet.net:9092
[2018-04-03 12:54:57,633] kafka.metrics.metrics.DEBUG MainThread Added sensor with name node-12.bytes-sent
[2018-04-03 12:54:57,633] kafka.metrics.metrics.DEBUG MainThread Added sensor with name node-12.bytes-received
[2018-04-03 12:54:57,633] kafka.metrics.metrics.DEBUG MainThread Added sensor with name node-12.latency
[2018-04-03 12:54:57,634] kafka.conn.DEBUG MainThread <BrokerConnection node_id=12 host=node6sp7v.localnet.net:9092 <disconnected> [unspecified None]>: creating new socket
[2018-04-03 12:54:57,634] kafka.conn.DEBUG MainThread <BrokerConnection node_id=12 host=node6sp7v.localnet.net:9092 <disconnected> [IPv4 ('192.168.1.37', 9092)]>: setting socket option (6, 1, 1)
[2018-04-03 12:54:57,634] kafka.conn.INFO MainThread <BrokerConnection node_id=12 host=node6sp7v.localnet.net:9092 <connecting> [IPv4 ('192.168.1.37', 9092)]>: connecting to node6sp7v.localnet.net:9092 [('192.168.1.37', 9092) IPv4]
[2018-04-03 12:54:57,634] kafka.conn.INFO MainThread Probing node 12 broker version
[2018-04-03 12:54:57,635] kafka.conn.DEBUG MainThread <BrokerConnection node_id=12 host=node6sp7v.localnet.net:9092 <connecting> [IPv4 ('192.168.1.37', 9092)]>: established TCP connection
[2018-04-03 12:54:57,635] kafka.conn.DEBUG MainThread <BrokerConnection node_id=12 host=node6sp7v.localnet.net:9092 <connecting> [IPv4 ('192.168.1.37', 9092)]>: initiating SASL authentication
[2018-04-03 12:54:57,635] kafka.protocol.parser.DEBUG MainThread Sending request SaslHandShakeRequest_v0(mechanism='PLAIN')
[2018-04-03 12:54:57,635] kafka.conn.DEBUG MainThread <BrokerConnection node_id=12 host=node6sp7v.localnet.net:9092 <authenticating> [IPv4 ('192.168.1.37', 9092)]> Request 1: SaslHandShakeRequest_v0(mechanism='PLAIN')
[2018-04-03 12:54:57,635] kafka.protocol.parser.DEBUG MainThread Received correlation id: 1
[2018-04-03 12:54:57,635] kafka.protocol.parser.DEBUG MainThread Processing response SaslHandShakeResponse_v0
[2018-04-03 12:54:57,636] kafka.conn.DEBUG MainThread <BrokerConnection node_id=12 host=node6sp7v.localnet.net:9092 <authenticating> [IPv4 ('192.168.1.37', 9092)]> Response 1 (0.6749629974365234 ms): SaslHandShakeResponse_v0(error_code=0, enabled_mechanisms=['PLAIN'])
[2018-04-03 12:54:57,636] kafka.conn.WARNING MainThread <BrokerConnection node_id=12 host=node6sp7v.localnet.net:9092 <authenticating> [IPv4 ('192.168.1.37', 9092)]>: Sending username and password in the clear
[2018-04-03 12:54:57,636] kafka.conn.INFO MainThread <BrokerConnection node_id=12 host=node6sp7v.localnet.net:9092 <authenticating> [IPv4 ('192.168.1.37', 9092)]>: Authenticated as admin via PLAIN
[2018-04-03 12:54:57,636] kafka.conn.INFO MainThread <BrokerConnection node_id=12 host=node6sp7v.localnet.net:9092 <authenticating> [IPv4 ('192.168.1.37', 9092)]>: Connection complete.
[2018-04-03 12:54:57,636] kafka.client.DEBUG MainThread Node 12 connected
[2018-04-03 12:54:57,637] kafka.protocol.parser.DEBUG MainThread Sending request ApiVersionRequest_v0()
[2018-04-03 12:54:57,637] kafka.conn.DEBUG MainThread <BrokerConnection node_id=12 host=node6sp7v.localnet.net:9092 <connected> [IPv4 ('192.168.1.37', 9092)]> Request 2: ApiVersionRequest_v0()
[2018-04-03 12:54:57,738] kafka.protocol.parser.DEBUG MainThread Sending request MetadataRequest_v0(topics=[])
[2018-04-03 12:54:57,738] kafka.conn.DEBUG MainThread <BrokerConnection node_id=12 host=node6sp7v.localnet.net:9092 <connected> [IPv4 ('192.168.1.37', 9092)]> Request 3: MetadataRequest_v0(topics=[])
[2018-04-03 12:54:57,739] kafka.protocol.parser.DEBUG MainThread Received correlation id: 2
[2018-04-03 12:54:57,739] kafka.protocol.parser.DEBUG MainThread Processing response ApiVersionResponse_v0
[2018-04-03 12:54:57,739] kafka.conn.DEBUG MainThread <BrokerConnection node_id=12 host=node6sp7v.localnet.net:9092 <connected> [IPv4 ('192.168.1.37', 9092)]> Response 2 (102.11706161499023 ms): ApiVersionResponse_v0(error_code=0, api_versions=[(api_key=0, min_version=0, max_version=3), (api_key=1, min_version=0, max_version=5), (api_key=2, min_version=0, max_version=2), (api_key=3, min_version=0, max_version=4), (api_key=4, min_version=0, max_version=0), (api_key=5, min_version=0, max_version=0), (api_key=6, min_version=0, max_version=3), (api_key=7, min_version=1, max_version=1), (api_key=8, min_version=0, max_version=3), (api_key=9, min_version=0, max_version=3), (api_key=10, min_version=0, max_version=1), (api_key=11, min_version=0, max_version=2), (api_key=12, min_version=0, max_version=1), (api_key=13, min_version=0, max_version=1), (api_key=14, min_version=0, max_version=1), (api_key=15, min_version=0, max_version=1), (api_key=16, min_version=0, max_version=1), (api_key=17, min_version=0, max_version=0), (api_key=18, min_version=0, max_version=1), (api_key=19, min_version=0, max_version=2), (api_key=20, min_version=0, max_version=1), (api_key=21, min_version=0, max_version=0), (api_key=22, min_version=0, max_version=0), (api_key=23, min_version=0, max_version=0), (api_key=24, min_version=0, max_version=0), (api_key=25, min_version=0, max_version=0), (api_key=26, min_version=0, max_version=0), (api_key=27, min_version=0, max_version=0), (api_key=28, min_version=0, max_version=0), (api_key=29, min_version=0, max_version=0), (api_key=30, min_version=0, max_version=0), (api_key=31, min_version=0, max_version=0), (api_key=32, min_version=0, max_version=0), (api_key=33, min_version=0, max_version=0)])
[2018-04-03 12:54:57,740] kafka.protocol.parser.DEBUG MainThread Received correlation id: 3
[2018-04-03 12:54:57,740] kafka.protocol.parser.DEBUG MainThread Processing response MetadataResponse_v0
[2018-04-03 12:54:57,744] kafka.conn.DEBUG MainThread <BrokerConnection node_id=12 host=node6sp7v.localnet.net:9092 <connected> [IPv4 ('192.168.1.37', 9092)]> Response 3 (6.064891815185547 ms): MetadataResponse_v0(brokers=[(node_id=8, host='node6sp3v.localnet.net', port=9092), (node_id=17, host='node6spcv.localnet.net', port=9092), (node_id=11, host='node6sp6v.localnet.net', port=9092), (node_id=2, host='node32p2v.localnet.net', port=9092), (node_id=5, host='node32p5v.localnet.net', port=9092), (node_id=14, host='node6sp9v.localnet.net', port=9092), (node_id=4, host='node32p4v.localnet.net', port=9092), (node_id=13, host='node6sp8v.localnet.net', port=9092), (node_id=16, host='node6spbv.localnet.net', port=9092), (node_id=7, host='node6sp2v.localnet.net', port=9092), (node_id=1, host='node32p1v.localnet.net', port=9092), (node_id=10, host='node6sp5v.localnet.net', port=9092), (node_id=9, host='node6sp4v.localnet.net', port=9092), (node_id=3, host='node32p3v.localnet.net', port=9092), (node_id=12, host='node6sp7v.localnet.net', port=9092), (node_id=15, host='node6spav.localnet.net', port=9092), (node_id=6, host='node6sp1v.localnet.net', port=9092)], topics=[(error_code=0, topic='REP_GDP_CET_EVENT_INPUT_REJECT_ES_CNJ', partitions=[(error_code=0, partition=8, leader=16, replicas=[16, 4, 5], isr=[16, 5, 4]), (error_code=0, partition=11, leader=2, replicas=[2, 7, 8], isr=[2, 7, 8]), (error_code=0, partition=2, leader=10, replicas=[10, 15, 16], isr=[10, 15, 16]), (error_code=0, partition=5, leader=13, replicas=[13, 1, 2], isr=[13, 2, 1]), (error_code=0, partition=14, leader=5, replicas=[5, 10, 11], isr=[10, 11, 5]), (error_code=0, partition=4, leader=12, replicas=[12, 17, 1], isr=[12, 17, 1]), (error_code=0, partition=13, leader=4, replicas=[4, 9, 10], isr=[10, 9, 4]), (error_code=0, partition=7, leader=15, replicas=[15, 3, 4], isr=[15, 3, 4]), (error_code=0, partition=10, leader=1, replicas=[1, 6, 7], isr=[6, 7, 1]), (error_code=0, partition=1, leader=9, replicas=[9, 14, 15], isr=[14, 15, 9]), (error_code=0, partition=9, leader=17, replicas=[17, 5, 6], isr=[17, 5, 6]), (error_code=0, partition=3, leader=11, replicas=[11, 16, 17], isr=[11, 16, 17]), (error_code=0, partition=12, leader=3, replicas=[3, 8, 9], isr=[3, 8, 9]), (error_code=0, partition=6, leader=14, replicas=[14, 2, 3], isr=[14, 2, 3]), (error_code=0, partition=0, leader=8, replicas=[8, 13, 14], isr=[13, 14, 8])]), (error_code=0, topic='REP_GDP_CET_EVENT_INPUT_REJECT_ES_TPC', partitions=[(error_code=0, partition=8, leader=16, replicas=[16, 8, 9], isr=[16, 8, 9]), (error_code=0, partition=11, leader=2, replicas=[2, 11, 12], isr=[11, 12, 2]), (error_code=0, partition=2, leader=10, replicas=[10, 2, 3], isr=[10, 2, 3]), (error_code=0, partition=5, leader=13, replicas=[13, 5, 6], isr=[13, 5, 6]), (error_code=0, partition=14, leader=5, replicas=[5, 14, 15], isr=[14, 15, 5]), (error_code=0, partition=4, leader=12, replicas=[12, 4, 5], isr=[12, 5, 4]), (error_code=0, partition=13, leader=4, replicas=[4, 13, 14], isr=[13, 14, 4]), (error_code=0, partition=7, leader=15, replicas=[15, 7, 8], isr=[15, 7, 8]), (error_code=0, partition=10, leader=1, replicas=[1, 10, 11], isr=[10, 11, 1]), (error_code=0, partition=1, leader=9, replicas=[9, 1, 2], isr=[2, 9, 1]), (error_code=0, partition=9, leader=17, replicas=[17, 9, 10], isr=[10, 17, 9]), (error_code=0, partition=3, leader=11, replicas=[11, 3, 4], isr=[11, 3, 4]), (error_code=0, partition=12, leader=3, replicas=[3, 12, 13], isr=[12, 13, 3]), (error_code=0, partition=6, leader=14, replicas=[14, 6, 7], isr=[14, 6, 7]), (error_code=0, partition=0, leader=8, replicas=[8, 17, 1], isr=[17, 8, 1])]), (error_code=0, topic='_connect_DP-cnj-prod-connect_configs', partitions=[(error_code=0, partition=0, leader=4, replicas=[4, 17, 11], isr=[4, 17, 11])]), (error_code=0, topic='_connect_DP-cnj-prod-connect_offsets', partitions=[(error_code=0, partition=23, leader=2, replicas=[2, 14, 13], isr=[2, 14, 13]), (error_code=0, partition=8, leader=14, replicas=[14, 13, 4], isr=[14, 13, 4]), (error_code=0, partition=17, leader=12, replicas=[12, 6, 17], isr=[12, 6, 17]), (error_code=0, partition=11, leader=16, replicas=[16, 7, 1], isr=[16, 7, 1]), (error_code=0, partition=2, leader=6, replicas=[6, 17, 8], isr=[6, 17, 8]), (error_code=0, partition=20, leader=17, replicas=[17, 11, 2], isr=[17, 11, 2]), (error_code=0, partition=5, leader=11, replicas=[11, 2, 5], isr=[11, 2, 5]), (error_code=0, partition=14, leader=10, replicas=[10, 9, 3], isr=[10, 9, 3]), (error_code=0, partition=4, leader=8, replicas=[8, 11, 2], isr=[8, 11, 2]), (error_code=0, partition=13, leader=1, replicas=[1, 10, 9], isr=[1, 10, 9]), (error_code=0, partition=22, leader=11, replicas=[11, 5, 14], isr=[11, 5, 14]), (error_code=0, partition=16, leader=3, replicas=[3, 12, 15], isr=[3, 12, 15]), (error_code=0, partition=7, leader=5, replicas=[5, 14, 13], isr=[5, 14, 13]), (error_code=0, partition=10, leader=4, replicas=[4, 16, 7], isr=[4, 16, 7]), (error_code=0, partition=1, leader=15, replicas=[15, 6, 17], isr=[15, 6, 17]), (error_code=0, partition=19, leader=6, replicas=[6, 8, 11], isr=[6, 8, 11]), (error_code=0, partition=18, leader=15, replicas=[15, 17, 8], isr=[15, 17, 8]), (error_code=0, partition=9, leader=13, replicas=[13, 4, 16], isr=[13, 4, 16]), (error_code=0, partition=12, leader=7, replicas=[7, 1, 10], isr=[7, 1, 10]), (error_code=0, partition=21, leader=8, replicas=[8, 2, 5], isr=[8, 2, 5]), (error_code=0, partition=3, leader=17, replicas=[17, 8, 11], isr=[17, 8, 11]), (error_code=0, partition=15, leader=9, replicas=[9, 3, 12], isr=[9, 3, 12]), (error_code=0, partition=6, leader=2, replicas=[2, 5, 14], isr=[2, 5, 14]), (error_code=0, partition=24, leader=5, replicas=[5, 13, 4], isr=[5, 13, 4]), (error_code=0, partition=0, leader=12, replicas=[12, 15, 6], isr=[12, 15, 6])]), (error_code=0, topic='__consumer_offsets', partitions=[(error_code=0, partition=23, leader=4, replicas=[4, 6, 7], isr=[6, 7, 4]), (error_code=0, partition=32, leader=13, replicas=[13, 15, 16], isr=[13, 15, 16]), (error_code=0, partition=41, leader=5, replicas=[5, 8, 9], isr=[5, 8, 9]), (error_code=0, partition=17, leader=15, replicas=[15, 17, 1], isr=[15, 17, 1]), (error_code=0, partition=8, leader=6, replicas=[6, 7, 8], isr=[6, 7, 8]), (error_code=0, partition=44, leader=8, replicas=[8, 11, 12], isr=[11, 12, 8]), (error_code=0, partition=35, leader=16, replicas=[16, 2, 3], isr=[16, 2, 3]), (error_code=0, partition=26, leader=7, replicas=[7, 9, 10], isr=[10, 7, 9]), (error_code=0, partition=11, leader=9, replicas=[9, 10, 11], isr=[10, 11, 9]), (error_code=0, partition=47, leader=11, replicas=[11, 14, 15], isr=[11, 14, 15]), (error_code=0, partition=38, leader=2, replicas=[2, 5, 6], isr=[2, 5, 6]), (error_code=0, partition=29, leader=10, replicas=[10, 12, 13], isr=[10, 12, 13]), (error_code=0, partition=20, leader=1, replicas=[1, 3, 4], isr=[3, 4, 1]), (error_code=0, partition=2, leader=17, replicas=[17, 1, 2], isr=[17, 2, 1]), (error_code=0, partition=5, leader=3, replicas=[3, 4, 5], isr=[3, 5, 4]), (error_code=0, partition=14, leader=12, replicas=[12, 13, 14], isr=[12, 13, 14]), (error_code=0, partition=46, leader=10, replicas=[10, 13, 14], isr=[10, 13, 14]), (error_code=0, partition=40, leader=4, replicas=[4, 7, 8], isr=[7, 8, 4]), (error_code=0, partition=49, leader=13, replicas=[13, 16, 17], isr=[13, 16, 17]), (error_code=0, partition=13, leader=11, replicas=[11, 12, 13], isr=[11, 12, 13]), (error_code=0, partition=4, leader=2, replicas=[2, 3, 4], isr=[2, 3, 4]), (error_code=0, partition=31, leader=12, replicas=[12, 14, 15], isr=[12, 14, 15]), (error_code=0, partition=22, leader=3, replicas=[3, 5, 6], isr=[3, 5, 6]), (error_code=0, partition=16, leader=14, replicas=[14, 15, 16], isr=[14, 15, 16]), (error_code=0, partition=7, leader=5, replicas=[5, 6, 7], isr=[5, 6, 7]), (error_code=0, partition=43, leader=7, replicas=[7, 10, 11], isr=[10, 11, 7]), (error_code=0, partition=25, leader=6, replicas=[6, 8, 9], isr=[6, 8, 9]), (error_code=0, partition=34, leader=15, replicas=[15, 1, 2], isr=[15, 2, 1]), (error_code=0, partition=10, leader=8, replicas=[8, 9, 10], isr=[10, 8, 9]), (error_code=0, partition=37, leader=1, replicas=[1, 4, 5], isr=[5, 4, 1]), (error_code=0, partition=1, leader=16, replicas=[16, 17, 1], isr=[16, 17, 1]), (error_code=0, partition=19, leader=17, replicas=[17, 2, 3], isr=[17, 2, 3]), (error_code=0, partition=28, leader=9, replicas=[9, 11, 12], isr=[11, 12, 9]), (error_code=0, partition=45, leader=9, replicas=[9, 12, 13], isr=[12, 13, 9]), (error_code=0, partition=36, leader=17, replicas=[17, 3, 4], isr=[17, 3, 4]), (error_code=0, partition=27, leader=8, replicas=[8, 10, 11], isr=[10, 11, 8]), (error_code=0, partition=9, leader=7, replicas=[7, 8, 9], isr=[7, 8, 9]), (error_code=0, partition=18, leader=16, replicas=[16, 1, 2], isr=[16, 2, 1]), (error_code=0, partition=48, leader=12, replicas=[12, 15, 16], isr=[12, 15, 16]), (error_code=0, partition=21, leader=2, replicas=[2, 4, 5], isr=[2, 5, 4]), (error_code=0, partition=12, leader=10, replicas=[10, 11, 12], isr=[10, 11, 12]), (error_code=0, partition=3, leader=1, replicas=[1, 2, 3], isr=[2, 3, 1]), (error_code=0, partition=30, leader=11, replicas=[11, 13, 14], isr=[11, 13, 14]), (error_code=0, partition=39, leader=3, replicas=[3, 6, 7], isr=[3, 6, 7]), (error_code=0, partition=15, leader=13, replicas=[13, 14, 15], isr=[13, 14, 15]), (error_code=0, partition=42, leader=6, replicas=[6, 9, 10], isr=[10, 6, 9]), (error_code=0, partition=6, leader=4, replicas=[4, 5, 6], isr=[5, 6, 4]), (error_code=0, partition=24, leader=5, replicas=[5, 7, 8], isr=[5, 7, 8]), (error_code=0, partition=33, leader=14, replicas=[14, 16, 17], isr=[14, 16, 17]), (error_code=0, partition=0, leader=15, replicas=[15, 16, 17], isr=[15, 16, 17])]), (error_code=0, topic='FROM_TPC_ALEX_00001', partitions=[(error_code=0, partition=2, leader=3, replicas=[3, 11, 12], isr=[3, 11, 12]), (error_code=0, partition=5, leader=6, replicas=[6, 14, 15], isr=[6, 14, 15]), (error_code=0, partition=4, leader=5, replicas=[5, 13, 14], isr=[5, 13, 14]), (error_code=0, partition=1, leader=2, replicas=[2, 10, 11], isr=[2, 10, 11]), (error_code=0, partition=3, leader=4, replicas=[4, 12, 13], isr=[4, 12, 13]), (error_code=0, partition=0, leader=1, replicas=[1, 9, 10], isr=[1, 9, 10])]), (error_code=0, topic='_connect_DP-cnj-prod-connect_status', partitions=[(error_code=0, partition=2, leader=9, replicas=[9, 16, 10], isr=[9, 16, 10]), (error_code=0, partition=4, leader=12, replicas=[12, 1, 9], isr=[12, 1, 9]), (error_code=0, partition=1, leader=1, replicas=[1, 7, 16], isr=[1, 7, 16]), (error_code=0, partition=3, leader=3, replicas=[3, 10, 1], isr=[3, 10, 1]), (error_code=0, partition=0, leader=10, replicas=[10, 13, 7], isr=[10, 13, 7])])])
[2018-04-03 12:54:58,748] kafka.conn.INFO MainThread Broker version identifed as 0.11.0
[2018-04-03 12:54:58,748] kafka.conn.INFO MainThread Set configuration api_version=(0, 11, 0) to skip auto check_version requests on startup
[2018-04-03 12:54:58,749] kafka.metrics.metrics.DEBUG MainThread Added sensor with name bytes-fetched
[2018-04-03 12:54:58,750] kafka.metrics.metrics.DEBUG MainThread Added sensor with name records-fetched
[2018-04-03 12:54:58,750] kafka.metrics.metrics.DEBUG MainThread Added sensor with name fetch-latency
[2018-04-03 12:54:58,750] kafka.metrics.metrics.DEBUG MainThread Added sensor with name records-lag
[2018-04-03 12:54:58,750] kafka.metrics.metrics.DEBUG MainThread Added sensor with name fetch-throttle-time
[2018-04-03 12:54:58,751] kafka.metrics.metrics.DEBUG MainThread Added sensor with name heartbeat-latency
[2018-04-03 12:54:58,751] kafka.metrics.metrics.DEBUG MainThread Added sensor with name join-latency
[2018-04-03 12:54:58,752] kafka.metrics.metrics.DEBUG MainThread Added sensor with name sync-latency
[2018-04-03 12:54:58,752] kafka.coordinator.consumer.WARNING MainThread group_id is None: disabling auto-commit.
[2018-04-03 12:54:58,752] kafka.metrics.metrics.DEBUG MainThread Added sensor with name commit-latency
[2018-04-03 12:54:58,753] kafka.consumer.subscription_state.INFO MainThread Updating subscribed topics to: ('__consumer_offsets',)
[2018-04-03 12:54:58,753] root.INFO MainThread Starting server...
[2018-04-03 12:54:58,754] root.INFO MainThread Server started on port 9208
[2018-04-03 12:54:58,755] root.INFO MainThread Requesting topics and partition assignments
[2018-04-03 12:54:58,755] root.DEBUG MainThread Requesting topics and partition assignments from 12
[2018-04-03 12:54:58,755] kafka.protocol.parser.DEBUG MainThread Sending request MetadataRequest_v1(topics=NULL)
[2018-04-03 12:54:58,756] kafka.conn.DEBUG MainThread <BrokerConnection node_id=12 host=node6sp7v.localnet.net:9092 <connected> [IPv4 ('192.168.1.37', 9092)]> Request 4: MetadataRequest_v1(topics=NULL)
Traceback (most recent call last):
  File "/usr/bin/prometheus-kafka-consumer-group-exporter", line 11, in <module>
    sys.exit(main())
  File "/usr/lib/python3.5/site-packages/prometheus_kafka_consumer_group_exporter/__init__.py", line 614, in main
    fetch_topics(now_time)
  File "/usr/lib/python3.5/site-packages/prometheus_kafka_consumer_group_exporter/__init__.py", line 506, in fetch_topics
    client.schedule(partial(fetch_topics, next_time), next_time)
AttributeError: 'KafkaClient' object has no attribute 'schedule'
@braedon
Copy link
Owner

braedon commented Apr 4, 2018

Hi @akamalov,

It looks like the KafkaClient.schedule() method was removed in kafka-python 1.4.x. I'll need to look into replacing it. In the meantime, you can get it running by using a 1.3.x version of kafka-python.

Braedon

@braedon braedon added the bug label Apr 4, 2018
@braedon braedon self-assigned this Apr 4, 2018
@braedon
Copy link
Owner

braedon commented Jul 7, 2018 •
edited
Loading

(finally) Released version 0.3.1 to change kafka-python requirements to 1.3.x. Working on 0.4 with a replacement for KafkaClient.schedule().

@braedon braedon added this to the release-0.4 milestone Jul 26, 2018
@braedon
Copy link
Owner

braedon commented Jul 26, 2018

@akamalov the change to support kafka-python 1.4.x+ has been released in 0.4.0

@braedon braedon closed this as completed Jul 26, 2018
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees

@braedon braedon

Labels
bug
Projects
None yet
Milestone
release-0.4
Development

No branches or pull requests
2 participants
@braedon @akamalov