Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

services/fs: Use separate dedicated thread pool instead #42

Merged
merged 3 commits into from
Feb 23, 2022

Conversation

Xuanwo
Copy link
Member

@Xuanwo Xuanwo commented Feb 23, 2022

Signed-off-by: Xuanwo github@xuanwo.io

I hereby agree to the terms of the CLA available at: https://databend.rs/dev/policies/cla/

Summary

This PR intends to replace the tokio::fs, see benchmark in #40.

In general, we will set up a separate thread pool to do blocking IO instead of relying on tokio's.

In the future, we will implement a real async fs backend support based on io_uring or aio, please keep tuned.


Current PR benchmark:

image

main branch:

image

Signed-off-by: Xuanwo <github@xuanwo.io>
Signed-off-by: Xuanwo <github@xuanwo.io>
Signed-off-by: Xuanwo <github@xuanwo.io>
@Xuanwo Xuanwo merged commit 6596476 into apache:main Feb 23, 2022
@Xuanwo Xuanwo deleted the blocking branch February 23, 2022 05:54
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant