Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

add retry logic for delta uniform iceberg conversion #3856

Merged

Conversation

lzlfred
Copy link
Contributor

@lzlfred lzlfred commented Nov 7, 2024

Which Delta project/connector is this regarding?

  • Spark
  • Standalone
  • Flink
  • Kernel
  • Other (fill in here)

Description

add retry logic for delta uniform iceberg conversion

How was this patch tested?

Does this PR introduce any user-facing changes?

val lastConvertedIcebergTable = loadIcebergTable(snapshotToConvert, catalogTable)
val lastDeltaVersionConverted = IcebergConverter
.getLastConvertedDeltaVersion(lastConvertedIcebergTable)
val getLastConvertedDeltaTimestamp = IcebergConverter
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
val getLastConvertedDeltaTimestamp = IcebergConverter
val lastConvertedDeltaTimestamp = IcebergConverter

@lzlfred lzlfred force-pushed the lzlfred/add-base-converted-version branch from bb8ef47 to 9cd846f Compare November 8, 2024 23:38
@scottsand-db scottsand-db merged commit e65d06e into delta-io:master Nov 9, 2024
16 of 19 checks passed
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants