Skip to content

Add an Apache Paimon CDC Ingestion using MSF Example #95

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Open
wants to merge 4 commits into
base: main
Choose a base branch
from

Conversation

Moonlight-CL
Copy link

Purpose of the change

*Add an Example of Apache Paimon CDC Ingestion using MSF *

Verifying this change

  1. Tested on Managed Service for Apache Flink

Significant changes

  • Completely new example
  • Updated an existing example to newer Flink version or dependencies versions
  • Improved an existing example
  • Modified the runtime configuration of an existing example (i.e. added/removed/modified any runtime properties)
  • Modified the expected input or output of an existing example (e.g. modified the source or sink, modified the record schema)

@nicusX
Copy link
Contributor

nicusX commented Apr 3, 2025

Does this work on Amazon Managed Service for Apache Flink?
I see the readme mention "copying hive-site.xml from your EMR cluster. Flink on EMR is a different service. This repo is exclusively about Managed Service for Apache Flink

@Moonlight-CL
Copy link
Author

Does this work on Amazon Managed Service for Apache Flink? I see the readme mention "copying hive-site.xml from your EMR cluster. Flink on EMR is a different service. This repo is exclusively about Managed Service for Apache Flink

Hi nicuX, Yes, this works on Amazon Managed Service for Apache Flink(MSF), if we want to sync Paimon meta data to Glue Data Catalog , we need copy hive-site.xml to project, Paimon Hive Catalog will read connection info from this xml file.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants