Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Redshift Loader // Narrowing from required to nullable would break loading #1142

Open
voropaevp opened this issue Nov 29, 2022 · 0 comments
Open

Comments

@voropaevp
Copy link
Contributor

If schema 1-0-0 had { ..."fieldX": {"type" : [ "string"] ...} and schema 1-0-1 had { ..."fieldX": "type" : [ "string", null]...}, then loader would not generate the ALTER table statement (and it would also be illegal for RedShift). Instead table comment would be updated to the new 1-0-1 version, while fieldX would remain required (not nullable).

Consequently, all batches where events have fieldX is NULL would fail to load.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant