Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Support debezium records in CDC #101

Open
CyberROFL opened this issue Jul 22, 2022 · 0 comments
Open

Support debezium records in CDC #101

CyberROFL opened this issue Jul 22, 2022 · 0 comments
Labels
area/datashard Issues related to datashard tablets (relational table partitions) enhancement New feature or request

Comments

@CyberROFL
Copy link
Member

https://debezium.io/

According to debezium documetation there a currently two possible kinds of records:

  • with schema
    {
      "schema": {...},
      "payload": {
        "op": "u",
        "source": {
          ...
        },
        "ts_ms" : "...",
        "before" : {
          "field1" : "oldvalue1",
          "field2" : "oldvalue2"
        },
        "after" : {
          "field1" : "newvalue1",
          "field2" : "newvalue2"
        }
      }
    }
  • without schema
    {
      "op": "u",
      "source": {
        ...
      },
      "ts_ms" : "...",
      "before" : {
        "field1" : "oldvalue1",
        "field2" : "oldvalue2"
      },
      "after" : {
        "field1" : "newvalue1",
        "field2" : "newvalue2"
      }
    }

As you can see it looks very similar to the CDC records in the NEW_AND_OLD_IMAGES mode and JSON format.

  • Add new CDC format like DEBEZIUM.
  • Add schema to the CDC records (in mode with schema).
  • Add missing service fields (find out which fields are required and which are not).
  • Add (rename) some fields (oldImagebefore, newImageafter, etc).
@fomichev3000 fomichev3000 added enhancement New feature or request area/datashard Issues related to datashard tablets (relational table partitions) labels Jul 22, 2022
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
area/datashard Issues related to datashard tablets (relational table partitions) enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants