Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

Leverage batch delete in vacuum for Azure Storage #408

Closed
Dandandan opened this issue Aug 22, 2021 · 6 comments
Closed

Leverage batch delete in vacuum for Azure Storage #408

Dandandan opened this issue Aug 22, 2021 · 6 comments
Labels
binding/rust Issues for the Rust crate enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed storage/azure Azure Blog storage related

Comments

@Dandandan
Copy link
Contributor

Dandandan commented Aug 22, 2021 •
edited
Loading

Description

Azure supports batching multiple delete operations in a single call. This can speed up vacuum.
We shuld add a new delete_objs implementation of StorageBackend for Azure.

Use Case

Related Issue(s)
#394
@Dandandan Dandandan added the enhancement New feature or request label Aug 22, 2021
@houqp houqp added binding/rust Issues for the Rust crate good first issue Good for newcomers help wanted Extra attention is needed storage/azure Azure Blog storage related labels Aug 22, 2021
@akbhuker
Copy link

hey, can I have this issue?
I'm quite new to this so I might need some guidance

@Dandandan
Copy link
Contributor Author

hey, can I have this issue?
I'm quite new to this so I might need some guidance

Would be great!
@houqp can you assing this to @akbhuker ?

I think you can have a look at the implementation for the S3 backend.
Let us know when you need the guidance.

@houqp
Copy link
Member

houqp commented Aug 28, 2021

Issue assigned, thanks @akbhuker for taking up on this!

@Bernolt
Copy link
Contributor

Bernolt commented Jun 19, 2022

Hello,
Any progress here?
if not, I am would be happy to jump in.

@wjones127
Copy link
Collaborator

Now that we use objectstore, we should implement this upstream: apache/arrow-rs#2615

@akbhuker akbhuker removed their assignment Sep 21, 2022
@roeap
Copy link
Collaborator

roeap commented Jan 28, 2024

closing this here, as this is now part of upstream object_store.

@roeap roeap closed this as completed Jan 28, 2024
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
binding/rust Issues for the Rust crate enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed storage/azure Azure Blog storage related
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
6 participants
@Dandandan @houqp @Bernolt @wjones127 @roeap @akbhuker