Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[Feature Request]: Add Java API for using and upgrading Iceberg via the Managed transforms API #30892

Closed
1 of 16 tasks
chamikaramj opened this issue Apr 8, 2024 · 1 comment
Closed
1 of 16 tasks

Comments

@chamikaramj
Copy link
Contributor

chamikaramj commented Apr 8, 2024

What would you like to happen?

We recently added an API for Managed transforms: #30830

We are also working on adding an Iceberg source and sink.

We need to connect Iceberg to the Managed transforms API and add support for upgrading it.

Upgrading can be performed via the Transform Service [1] by adding Schema-aware transforms for Iceberg source and sink and implementing a PTransformPayloadTranslator [2].

[1] https://beam.apache.org/documentation/programming-guide/#transform-service-usage-upgrade
[2]

public interface TransformPayloadTranslator<T extends PTransform<?, ?>> {

Issue Priority

Priority: 2 (default / most feature requests should be filed as P2)

Issue Components

  • Component: Python SDK
  • Component: Java SDK
  • Component: Go SDK
  • Component: Typescript SDK
  • Component: IO connector
  • Component: Beam YAML
  • Component: Beam examples
  • Component: Beam playground
  • Component: Beam katas
  • Component: Website
  • Component: Spark Runner
  • Component: Flink Runner
  • Component: Samza Runner
  • Component: Twister2 Runner
  • Component: Hazelcast Jet Runner
  • Component: Google Cloud Dataflow Runner
@chamikaramj
Copy link
Contributor Author

Fixed by #30910

# for free to join this conversation on GitHub. Already have an account? # to comment
Projects
None yet
Development

No branches or pull requests

2 participants