Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

readers: Improve seekable performance #25

Merged
merged 4 commits into from
Feb 16, 2022
Merged

readers: Improve seekable performance #25

merged 4 commits into from
Feb 16, 2022

Conversation

Xuanwo
Copy link
Member

@Xuanwo Xuanwo commented Feb 16, 2022

Signed-off-by: Xuanwo github@xuanwo.io

I hereby agree to the terms of the CLA available at: https://databend.rs/dev/policies/cla/

Summary

This PR intends to improve the seekable reader's performance by introducing chunked read.

Signed-off-by: Xuanwo <github@xuanwo.io>
Signed-off-by: Xuanwo <github@xuanwo.io>
@Xuanwo
Copy link
Member Author

Xuanwo commented Feb 16, 2022

This fix will improve SeekableReader throughput from 2 KB/s to 294.12 MB/s, it's more like a bugfix instead of improvement 😭

Signed-off-by: Xuanwo <github@xuanwo.io>
Signed-off-by: Xuanwo <github@xuanwo.io>
@dantengsky
Copy link

/lgtm

Copy link

@dantengsky dantengsky left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Xuanwo Xuanwo merged commit 80310c0 into main Feb 16, 2022
@Xuanwo Xuanwo deleted the seekable_reader branch February 16, 2022 07:53
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants