Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

perf: Improve performance of record message serialization #1196

Merged

Conversation

Jack-Burnett
Copy link
Contributor

@Jack-Burnett Jack-Burnett commented Nov 16, 2022

In my testing, taps spend about half of their time converting record messages to dicts. This basically reduces that to nothing, doubling the throughput of the average tap.

Closes #1194


📚 Documentation preview 📚: https://meltano-sdk--1196.org.readthedocs.build/en/1196/

@codecov
Copy link

codecov bot commented Nov 16, 2022

Codecov Report

Merging #1196 (316e83e) into main (bae24f1) will decrease coverage by 0.02%.
The diff coverage is 71.42%.

@@            Coverage Diff             @@
##             main    #1196      +/-   ##
==========================================
- Coverage   83.58%   83.56%   -0.03%     
==========================================
  Files          42       42              
  Lines        3874     3881       +7     
  Branches      657      659       +2     
==========================================
+ Hits         3238     3243       +5     
- Misses        473      474       +1     
- Partials      163      164       +1     
Impacted Files Coverage Δ
singer_sdk/_singerlib/messages.py 97.61% <71.42%> (-2.39%) ⬇️

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@edgarrmondragon edgarrmondragon changed the title fix: Add a to dict method to RecordMessage to improve performance perf: Improve performance of record message serialization Nov 16, 2022
Copy link
Collaborator

@edgarrmondragon edgarrmondragon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks @Jack-Burnett!

# for free to join this conversation on GitHub. Already have an account? # to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Bug]: Poor performance of taps
3 participants