Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

"Better Processors" #997

Closed
11 tasks done
neovintage opened this issue Apr 11, 2023 · 4 comments
Closed
11 tasks done

"Better Processors" #997

neovintage opened this issue Apr 11, 2023 · 4 comments
Assignees
@lovromazgon
Labels
feature New feature or request roadmap Planned for a future release
Milestone
0.9.0

Comments

@neovintage
Copy link
Contributor

neovintage commented Apr 11, 2023 •
edited by raulb
Loading

Feature description

Our plan is for the better processor work for 0.8.0 to include.

What we currently aren't planning on including in this first pass:

  • discovery of processor types (stretch goal)
  • open cdc unwrap
  • permanent storage
  • Splitting and combining records
  • Embedded processors
@neovintage neovintage added feature New feature or request triage Needs to be triaged labels Apr 11, 2023
@neovintage neovintage added this to the 0.7.0 milestone Apr 11, 2023
@neovintage neovintage moved this from Triage to Todo in Conduit Main Apr 11, 2023
@maha-hajja maha-hajja removed the triage Needs to be triaged label Apr 12, 2023
@lovromazgon lovromazgon mentioned this issue Jun 1, 2023
Closed
@simonl2002
Copy link
Member

This likely won't be in 0.7.0 but the goal is to start the work on this.

@nassor
Copy link
Contributor

nassor commented Jun 14, 2023 •
edited
Loading

Extra features descriptions:

  • Load Processor as plugins as we do with connectors.
  • Have the Processor interface method Close called when Conduit is turning off, so we can release external resources allocated by the Processor
  • Open Telemetry Support: send & return SpanContext to the processor (and connectors as well).
  • Simple Key/Value storage for processors.

@simonl2002 simonl2002 modified the milestones: 0.7.0, next Jul 18, 2023
@lovromazgon
Copy link
Member

Relevant discussion: #1141

@simonl2002 simonl2002 modified the milestones: 0.8.0, 0.9.0 Oct 30, 2023
@simonl2002 simonl2002 moved this from Todo to Triage in Conduit Main Oct 31, 2023
@lovromazgon lovromazgon moved this from Triage to In Progress in Conduit Main Nov 9, 2023
@lovromazgon lovromazgon self-assigned this Nov 13, 2023
@lovromazgon lovromazgon mentioned this issue Nov 17, 2023
Merged
@lovromazgon lovromazgon added the roadmap Planned for a future release label Dec 1, 2023
@raulb
Copy link
Member

raulb commented Mar 8, 2024

Documentation will be tackled in this other issue #1422.

Closing this issue since yesterday "better processors" was shipped as part of 0.9.0.

@raulb raulb closed this as completed Mar 8, 2024
@github-project-automation github-project-automation bot moved this from In Progress to Done in Conduit Main Mar 8, 2024
@lovromazgon lovromazgon mentioned this issue Oct 17, 2024
Closed
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees

@lovromazgon lovromazgon

Labels
feature New feature or request roadmap Planned for a future release
Projects
Conduit Main
Archived in project
Conduit Roadmap
Archived in project
Milestone
0.9.0
Development

No branches or pull requests
6 participants
@neovintage @nassor @simonl2002 @raulb @lovromazgon @maha-hajja