Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

feat: use worker threads for CPU intensive message parsing #66

Merged
merged 2 commits into from
Jan 9, 2025

Conversation

zone117x
Copy link
Member

@zone117x zone117x commented Jan 9, 2025

Offload CPU intensive msg parsing onto worker thread to prevent blocking main thread

Copy link
Collaborator

@rafaelcr rafaelcr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome... we should add a tool like that to the API toolkit in the future, would be super useful to the metadata API for example

@zone117x zone117x marked this pull request as ready for review January 9, 2025 17:20
@zone117x zone117x merged commit 2419aa0 into feat/s-n-p Jan 9, 2025
2 of 4 checks passed
@zone117x zone117x deleted the feat/threaded-msg-parser branch January 9, 2025 17:20
zone117x added a commit that referenced this pull request Jan 9, 2025
* feat: ingest messages from redis

* chore: rename chainhook related files

* feat: ingest messages from redis

* chore: move sql read/write type queries into correct classes

* chore: disable postgres listen/notify usage for socket-io events

* feat: use worker threads for CPU intensive message parsing (#66)

* feat: use worker threads for CPU intensive message parsing

* chore: misc fixes

* fix: insert reward_sets for pre-naka blocks

* chore: bump nodejs to v22

* ci: add `redis-stream` pre-release deployment
blockstack-devops pushed a commit that referenced this pull request Jan 9, 2025
## [0.13.0-redis-stream.1](v0.12.2...v0.13.0-redis-stream.1) (2025-01-09)

### Features

* ingest messages from redis ([#65](#65)) ([26f8e62](26f8e62)), closes [#66](#66)
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants