Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

delta reader version 2 #1412

Closed
dseynaev opened this issue May 30, 2023 · 5 comments
Closed

delta reader version 2 #1412

dseynaev opened this issue May 30, 2023 · 5 comments
Labels
enhancement New feature or request help wanted Extra attention is needed

Comments

@dseynaev
Copy link

Hi,

When attempting to test (through polars), I was immediately met with:

deltalake.table.DeltaTableProtocolError: The table's minimum reader version is 2but deltalake only supports up to version 1.

since this is not listed in the 2023 H1 roadmap I was wondering how far of this is (and/or what is blocking).

@dseynaev dseynaev added the enhancement New feature or request label May 30, 2023
@wjones127
Copy link
Collaborator

This will likely be on the roadmap for end of this year. We've mostly held off on it because it will require essentially a full rewrite of our Python scanner. But I'll be ready to start on that in a month or so.

@PurnaChandraPanda
Copy link

Hello @wjones127 , Do we have any update if there is plan to roll this out?

@jtanx
Copy link

jtanx commented May 17, 2024

Any update on this? Might be reading this wrong but seems like version 3 is marked as supported but not 2?

@roeap
Copy link
Collaborator

roeap commented May 18, 2024

version 3 introduces table features, which we are supporting one-by-one. previously to be compliant with a version all features for that version needed tobe supported.

@ion-elgreco ion-elgreco added the help wanted Extra attention is needed label Dec 7, 2024
@ion-elgreco
Copy link
Collaborator

I'll close this in favour of the column mapping issue, since that what is essentially required

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

6 participants