Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Allow mapping multiple topics to single container in sink connector #437

Open
3 tasks
benjaminrhope opened this issue Jan 21, 2022 · 1 comment
Open
3 tasks
Labels
feature-request New feature or request

Comments

@benjaminrhope
Copy link

## Problem Statement
I want to map multiple topics to one single cosmos db container like this:

"connect.cosmos.containers.topicmap": "topicA#container,topicB#container"

This is currenltly not supported since TopicContainerMap uses the BidiMap data structure, which only allows for a 1-1 relationships.

## Proposed Solution
Allow multiple topics to map to one single container by allowing many-to-one relationships in TopicContainerMap.

Next Steps

  • Team consensus to proceed
  • Schedule Design Session
  • Complete Design Review
@ryancrawcour ryancrawcour added feature-request New feature or request design-review Items needing team consensus on approach under-review and removed design-review Items needing team consensus on approach labels Jan 23, 2022
@ryancrawcour
Copy link
Contributor

This should be easy to implement. Take the provide a config for topicMap, and parse the string on topic#container.
Need to consider what to do if -
a) that config is not provided,
b) does this make another config redundant and therefore a breaking change
c) what to do if the string is supplied in the incorrect format.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
feature-request New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants