Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Bug: Non-Paged CQL Reads Gauge isn't working. #2295

Closed
danielhe4rt opened this issue May 21, 2024 · 2 comments · Fixed by #2298
Closed

Bug: Non-Paged CQL Reads Gauge isn't working. #2295

danielhe4rt opened this issue May 21, 2024 · 2 comments · Fixed by #2298
Assignees
Labels
bug Something isn't working right

Comments

@danielhe4rt
Copy link

Installation details
Dashboard Name: Scylla CQL
Scylla-Monitoring Version: 4.6, 4.7 (tested)
Scylla-Version: Any

Problem

Grafana Dashboard

I was testing the Optimization Tab and saw that the "Non-Paged CQL Reads" gauge isn't working. After a couple hours debugging, I found out that the query is crashing due a [[by]] inside the statement that isn't present in any other gauge.

To make sure I replicated it into other versions and also at Scylla Cloud and we still have the same problem. Maybe it is affecting other versions, but it would be really good to check it out.

Here's the current query:


100 * (
    (
        sum(rate(
            scylla_cql_unpaged_select_queries{
                instance=~"[[node]]",
                cluster="$cluster", 
                dc=~"$dc", 
                shard=~"[[shard]]"
            }[1m]
        )) 
        - 
        sum(rate(
            scylla_cql_unpaged_select_queries_per_ks{
                ks="system", 
                instance=~"[[node]]", 
                cluster="$cluster", 
                dc=~"$dc", 
                shard=~"[[shard]]"
            }[1m]
        )) by ([[by]])
    )
    /
    sum(rate(
        scylla_cql_reads{
            instance=~"[[node]]",
            cluster="$cluster", 
            dc=~"$dc", 
            shard=~"[[shard]]"
        }[1m]
    ))
) OR vector(0)

The new query with the fix:


100 * (
    (
        sum(rate(
            scylla_cql_unpaged_select_queries{
                instance=~"[[node]]",
                cluster="$cluster", 
                dc=~"$dc", 
                shard=~"[[shard]]"
            }[1m]
        )) 
        - 
        sum(rate(
            scylla_cql_unpaged_select_queries_per_ks{
                ks="system", 
                instance=~"[[node]]", 
                cluster="$cluster", 
                dc=~"$dc", 
                shard=~"[[shard]]"
            }[1m]
        )) // by removed
    )
    /
    sum(rate(
        scylla_cql_reads{
            instance=~"[[node]]",
            cluster="$cluster", 
            dc=~"$dc", 
            shard=~"[[shard]]"
        }[1m]
    ))
) OR vector(0)

Hope that it helps somehow.

@danielhe4rt danielhe4rt added the bug Something isn't working right label May 21, 2024
@amnonh amnonh added this to the Monitoring 4.8 milestone May 23, 2024
@danielhe4rt
Copy link
Author

Hey @amnonh! I'm running the LTS 4.7 and still having this issue. Can you verify if it was merged in the other versions?

non-paged-gauge

@mykaul
Copy link
Contributor

mykaul commented Jun 24, 2024

Hey @amnonh! I'm running the LTS 4.7 and still having this issue. Can you verify if it was merged in the other versions?

4.7 isn't LTS (AFAIK) and the bug is fixed in 4.8 (not released yet).

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
bug Something isn't working right
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants