Skip to content

DOC-13785 Product Change- PR #147169 - release-25.2: add log and metric for identifying clear access direction #19748

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

florence-crl
Copy link
Contributor

@florence-crl florence-crl commented Jun 10, 2025

Fixes DOC-13785 DOC-13379

In load-based-splitting.md, updated monitor section with popular key and clear direction metrics and logs.

Rendered preview

Monitor load-based splitting

Copy link

netlify bot commented Jun 10, 2025

Deploy Preview for cockroachdb-interactivetutorials-docs canceled.

Name Link
🔨 Latest commit ac7b5f2
🔍 Latest deploy log https://app.netlify.com/projects/cockroachdb-interactivetutorials-docs/deploys/68485395b0409200084dab42

Copy link

netlify bot commented Jun 10, 2025

Deploy Preview for cockroachdb-api-docs canceled.

Name Link
🔨 Latest commit ac7b5f2
🔍 Latest deploy log https://app.netlify.com/projects/cockroachdb-api-docs/deploys/68485395a5a66d0008fbe12a

Copy link

Copy link

netlify bot commented Jun 10, 2025

Netlify Preview

Name Link
🔨 Latest commit ac7b5f2
🔍 Latest deploy log https://app.netlify.com/projects/cockroachdb-docs/deploys/684853952e61320008427c20
😎 Deploy Preview https://deploy-preview-19748--cockroachdb-docs.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

Copy link

@kevin-v-ngo kevin-v-ngo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for putting this together. I'm a bit confused looking at the guidance and explanation of the logs.


This log message can usually be ignored. However, if it appears repeatedly, it may indicate a load imbalance in the cluster. A load imbalance might occur if a [hot range]({% link {{ page.version.version }}/understand-hotspots.md %}#hot-range) cannot be split because it is effectively a [hot key]({% link {{ page.version.version }}/understand-hotspots.md %}#row-hotspot). For more information about how to reduce hotspots (including hot ranges) on your cluster, refer to [Understand hotspots]({% link {{ page.version.version }}/understand-hotspots.md %}).

The log message ends with one of the following string combinations, indicating the observed load pattern:
Copy link

@kevin-v-ngo kevin-v-ngo Jun 16, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clear direction detected indicates that accesses within the range progress steadily in one direction, either increasing or decreasing key order.

Should we call out 'hot index'? (Relatedly to my question above, i'm assuming this error points to a hot index issue.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It does, do you think saying that it indicates a hot index would be useful here?

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clear direction detected indicates that accesses within the range progress steadily in one direction, either increasing or decreasing key order, generally indicating an index hotspot.

indicates that CockroachDB wants to [split the range]({% link {{ page.version.version }}/architecture/distribution-layer.md %}#range-splits) due to load, but couldn’t find a key to split at.
indicates that CockroachDB attempted to [split the range]({% link {{ page.version.version }}/architecture/distribution-layer.md %}#range-splits) due to load, but could not find a key to split at.

This log message can usually be ignored. However, if it appears repeatedly, it may indicate a load imbalance in the cluster. A load imbalance might occur if a [hot range]({% link {{ page.version.version }}/understand-hotspots.md %}#hot-range) cannot be split because it is effectively a [hot key]({% link {{ page.version.version }}/understand-hotspots.md %}#row-hotspot). For more information about how to reduce hotspots (including hot ranges) on your cluster, refer to [Understand hotspots]({% link {{ page.version.version }}/understand-hotspots.md %}).

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we make the following edits, because I think these sentences can be now genericised further?

A load imbalance might occur if a hot range... -> A load imbalance might occur if a range...

it is effectively a hot key... -> it is effectively a hotspot...


For more information about how to reduce hotspots (including hot ranges) on your cluster, refer to [Understand hotspots]({% link {{ page.version.version }}/understand-hotspots.md %}).
Metric | Description

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice!


This log message can usually be ignored. However, if it appears repeatedly, it may indicate a load imbalance in the cluster. A load imbalance might occur if a [hot range]({% link {{ page.version.version }}/understand-hotspots.md %}#hot-range) cannot be split because it is effectively a [hot key]({% link {{ page.version.version }}/understand-hotspots.md %}#row-hotspot). For more information about how to reduce hotspots (including hot ranges) on your cluster, refer to [Understand hotspots]({% link {{ page.version.version }}/understand-hotspots.md %}).

The log message ends with one of the following string combinations, indicating the observed load pattern:

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clear direction detected indicates that accesses within the range progress steadily in one direction, either increasing or decreasing key order, generally indicating an index hotspot.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants