Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

feat: add Kafka topics from upstream projects (Sentry and Snuba) for version 24.9.0 #1647

Merged
merged 1 commit into from
Dec 23, 2024

Conversation

patsevanton
Copy link
Contributor

@patsevanton patsevanton commented Dec 23, 2024

This pull request introduces new Kafka topics and updates existing ones based on upstream commits from Sentry and Snuba version 24.9.0.

Topic from files:
https://github.com/getsentry/snuba/blob/24.9.0/snuba/utils/streams/topics.py
https://github.com/getsentry/sentry/blob/24.9.0/src/sentry/conf/server.py

The following changes have been made:

  • New Topics Added:
    • outcomes-dlq
    • outcomes-billing-dlq
    • scheduled-subscriptions-generic-metrics-gauges
    • snuba-generic-metrics-gauges-commit-log
    • ingest-attachments-dlq
    • ingest-feedback-events
    • ingest-feedback-events-dlq
    • ingest-generic-metrics-dlq
    • ingest-transactions-dlq
    • ingest-events-dlq
    • ingest-metrics-dlq
    • monitors-clock-tasks
    • monitors-clock-tick
    • snuba-profile-chunks
    • buffered-segments
    • buffered-segments-dlq
    • uptime-configs
    • uptime-results

Upstream Commits:

@patsevanton
Copy link
Contributor Author

patsevanton commented Dec 23, 2024

Check local install

k get pod -n test
NAME                                                              READY   STATUS    RESTARTS      AGE
sentry-billing-metrics-consumer-f6db4bc5c-4gxv6                   1/1     Running   0             3m20s
sentry-clickhouse-0                                               1/1     Running   0             21m
sentry-cron-5f5f668fb6-66v6f                                      1/1     Running   3 (18m ago)   21m
sentry-generic-metrics-consumer-58d967864f-224q4                  1/1     Running   0             3m20s
sentry-ingest-consumer-attachments-66bbdcc7d5-56bcs               1/1     Running   0             3m19s
sentry-ingest-consumer-events-846bd78898-kkxjz                    1/1     Running   0             3m18s
sentry-ingest-consumer-transactions-96bf4d646-nmzgw               1/1     Running   0             3m17s
sentry-ingest-monitors-97dc8d5cc-jsjr9                            1/1     Running   0             3m16s
sentry-ingest-occurrences-9cf7947bf-s8ghg                         1/1     Running   0             3m15s
sentry-ingest-replay-recordings-5489644645-klxc5                  1/1     Running   0             3m14s
sentry-issue-occurrence-consumer-7bdf7c4545-s4kqh                 1/1     Running   0             2m59s
sentry-kafka-controller-0                                         1/1     Running   0             21m
sentry-kafka-controller-1                                         1/1     Running   0             21m
sentry-kafka-controller-2                                         1/1     Running   0             21m
sentry-metrics-consumer-68d5cd6c6f-p52kw                          1/1     Running   0             3m14s
sentry-nginx-78665d4559-2hkwf                                     1/1     Running   0             21m
sentry-post-process-forward-errors-86cf66d8f4-gtwg7               1/1     Running   0             3m13s
sentry-post-process-forward-issue-platform-6f59bbb877-9w6vk       1/1     Running   0             3m12s
sentry-post-process-forward-transactions-7f64d9998f-sfgbh         1/1     Running   0             3m11s
sentry-rabbitmq-0                                                 1/1     Running   0             21m
sentry-relay-67b8c8fdd7-vlvbl                                     1/1     Running   0             2m53s
sentry-sentry-postgresql-0                                        1/1     Running   0             21m
sentry-sentry-redis-master-0                                      1/1     Running   0             21m
sentry-sentry-redis-replicas-0                                    1/1     Running   1 (18m ago)   21m
sentry-snuba-api-db46488d-mt75w                                   1/1     Running   0             21m
sentry-snuba-consumer-c9df7f879-7x8ks                             1/1     Running   0             3m10s
sentry-snuba-generic-metrics-counters-consumer-575f88dd49-cb8bv   1/1     Running   0             3m6s
sentry-snuba-generic-metrics-distributions-consumer-5496ff24wgd   1/1     Running   0             3m5s
sentry-snuba-generic-metrics-sets-consumer-8d994b9df-jvqfs        1/1     Running   0             3m5s
sentry-snuba-group-attributes-consumer-69d9f486d7-ktdfb           1/1     Running   0             3m4s
sentry-snuba-metrics-consumer-69c8f7d46d-bdmbf                    1/1     Running   0             3m3s
sentry-snuba-outcomes-billing-consumer-59d99c7cd6-59vd2           1/1     Running   0             3m2s
sentry-snuba-outcomes-consumer-5fbfb78c6d-psqmj                   1/1     Running   0             2m58s
sentry-snuba-replacer-948c45964-66zd9                             1/1     Running   0             2m57s
sentry-snuba-replays-consumer-779bbb945d-pvgxk                    1/1     Running   0             3m1s
sentry-snuba-spans-consumer-f94b8698c-shjbn                       1/1     Running   0             3m1s
sentry-snuba-subscription-consumer-events-679d684787-hl9hn        1/1     Running   0             2m56s
sentry-snuba-subscription-consumer-metrics-565bf88996-kgp89       1/1     Running   0             2m55s
sentry-snuba-subscription-consumer-transactions-7cc6574dc7kzd7n   1/1     Running   0             2m54s
sentry-snuba-transactions-consumer-69bd895d89-l4v4g               1/1     Running   0             3m
sentry-subscription-consumer-events-77bdb5b7d9-8pv5h              1/1     Running   0             3m9s
sentry-subscription-consumer-generic-metrics-78d9756698-wfkfw     1/1     Running   0             3m8s
sentry-subscription-consumer-metrics-764b9bb6cd-mzg49             1/1     Running   0             3m7s
sentry-subscription-consumer-transactions-85548bf7c7-wcd5m        1/1     Running   0             3m7s
sentry-web-66bb445cdb-hktxd                                       1/1     Running   4 (18m ago)   21m
sentry-worker-7f9c7d6d55-5dd9r                                    1/1     Running   4 (18m ago)   21m
sentry-zookeeper-clickhouse-0                                     1/1     Running   0             21m

@Mokto Mokto merged commit cac64cf into sentry-kubernetes:develop Dec 23, 2024
2 of 3 checks passed
@Mokto Mokto mentioned this pull request Dec 23, 2024
@patsevanton patsevanton deleted the new-topics branch December 25, 2024 01:20
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants