How to make Official Airbyte Platform implementation more modular and
efficient?
For example, Official Airbyte implementation has some complicated micro-orchestration of socat forwarding and TCP port
management from workers. Is a simpler implementation possible with same stability guarantee?
More importantly, How to make it standalone for simple use-cases?
Temporal is
the coolest
of the application development technologies? But can we make it optional for replications?
- Option A, Some previous attempts
- Option B, Implement core data-plane components of the Official Airbyte in a modular and pluggable way.
Chosen option: Option B, Independent and the Path of least resistance. 😃