Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Tiered-Storage: fine grained controls for consistency checks #14504

Closed
Lazin opened this issue Oct 30, 2023 · 0 comments · Fixed by #14501
Closed

Tiered-Storage: fine grained controls for consistency checks #14504

Lazin opened this issue Oct 30, 2023 · 0 comments · Fixed by #14501
Assignees
Labels
area/cloud-storage Shadow indexing subsystem kind/enhance New feature or request

Comments

@Lazin
Copy link
Contributor

Lazin commented Oct 30, 2023

Who is this for and what problem do they have today?

We have cloud_storage_disable_upload_consistency_checks parameter which disables both metadata checks in the STM and checks of uploads. In some cases we want to disable only STM checks. We may want to be able to replay old logs that may have inconsistencies in them. To be able to do this we need a way to control both STM and upload checks independently. Otherwise we will have to disable all checks/auditing which is problematic.

What are the success criteria?

New configuration option is added. The old option cloud_storage_disable_upload_consistency_checks only controls upload loop. The new option cloud_storage_disable_metadata_consistency_checks controls only metadata checks in the STM.

Why is solving this problem impactful?

This is an escape hatch to deal with incidents.

Additional notes

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
area/cloud-storage Shadow indexing subsystem kind/enhance New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant