Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Merging Kafka pipeline updates to production site from preview (#11) #12

Merged
merged 1 commit into from
Sep 24, 2024

Conversation

pranav-kural
Copy link
Owner

  • Added node-rdkafka to the project

  • Core functions for setting up Kafka producers and clients.

  • Data schema definitions for primary kafka topics

  • Added pino and pinoPretty for logging utility

  • Removed Pino and added custom logger using logform

  • Moved dependency on node-rdkafka to kafkajs for providing the Kafka client

  • Updated UIs to dispatch user events to Kafka topic

  • Added vercel analytics

  • Updated product tiles in order items to dispatch user click event

  • Updated core UI pages to publish page load events for users to user_events Kafka topic

  • Updated logger to accept input of multiple types for messages

  • recording user events for mutations to user addresses

  • record user events for mutations to user cart

  • record orders and checkout user events

* Added `node-rdkafka` to the project

* Core functions for setting up Kafka producers and clients.

* Data schema definitions for primary kafka topics

* Added pino and pinoPretty for logging utility

* Removed Pino and added custom logger using logform

* Moved dependency on node-rdkafka to kafkajs for providing the Kafka client

* Updated UIs to dispatch user events to Kafka topic

* Added vercel analytics

* Updated product tiles in order items to dispatch user click event

* Updated core UI pages to publish page load events for users to user_events Kafka topic

* Updated logger to accept input of multiple types for messages

* recording user events for mutations to user addresses

* record user events for mutations to user cart

* record orders and checkout user events
@pranav-kural pranav-kural added the enhancement New feature or request label Sep 24, 2024
@pranav-kural pranav-kural self-assigned this Sep 24, 2024
Copy link

vercel bot commented Sep 24, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
plamatio-frontend ✅ Ready (Inspect) Visit Preview 💬 Add feedback Sep 24, 2024 1:10am

Copy link

Dependency Review

✅ No vulnerabilities or license issues or OpenSSF Scorecard issues found.

OpenSSF Scorecard

PackageVersionScoreDetails
npm/kafkajs ^2.2.4 🟢 3.4
Details
CheckScoreReason
Code-Review🟢 6Found 6/10 approved changesets -- score normalized to 6
Maintained⚠️ 00 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0
CII-Best-Practices⚠️ 0no effort to earn an OpenSSF best practices badge detected
License🟢 10license file detected
Signed-Releases⚠️ -1no releases found
Branch-Protection⚠️ -1internal error: error during branchesHandler.setup: internal error: githubv4.Query: Resource not accessible by integration
Packaging⚠️ -1packaging workflow not detected
Dangerous-Workflow🟢 10no dangerous workflow patterns detected
Token-Permissions⚠️ 0detected GitHub workflow tokens with excessive permissions
Security-Policy⚠️ 0security policy file not detected
Binary-Artifacts🟢 10no binaries found in the repo
Pinned-Dependencies⚠️ 0dependency not pinned by hash detected -- score normalized to 0
Fuzzing⚠️ 0project is not fuzzed
SAST⚠️ 0SAST tool is not run on all commits -- score normalized to 0
Vulnerabilities⚠️ 054 existing vulnerabilities detected
npm/logform ^2.6.1 🟢 4.4
Details
CheckScoreReason
Code-Review⚠️ 2Found 3/14 approved changesets -- score normalized to 2
Maintained🟢 810 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 8
CII-Best-Practices⚠️ 0no effort to earn an OpenSSF best practices badge detected
License🟢 10license file detected
Dangerous-Workflow🟢 10no dangerous workflow patterns detected
Packaging⚠️ -1packaging workflow not detected
Token-Permissions⚠️ 0detected GitHub workflow tokens with excessive permissions
Binary-Artifacts🟢 10no binaries found in the repo
Signed-Releases⚠️ -1no releases found
Pinned-Dependencies⚠️ 0dependency not pinned by hash detected -- score normalized to 0
Branch-Protection⚠️ 0branch protection not enabled on development/release branches
Security-Policy⚠️ 0security policy file not detected
Fuzzing⚠️ 0project is not fuzzed
SAST⚠️ 0SAST tool is not run on all commits -- score normalized to 0
Vulnerabilities🟢 100 existing vulnerabilities detected
npm/node-rdkafka ^3.1.0 🟢 4.2
Details
CheckScoreReason
Code-Review🟢 5Found 14/26 approved changesets -- score normalized to 5
Maintained🟢 33 commit(s) and 1 issue activity found in the last 90 days -- score normalized to 3
CII-Best-Practices⚠️ 0no effort to earn an OpenSSF best practices badge detected
License🟢 10license file detected
Signed-Releases⚠️ -1no releases found
Dangerous-Workflow🟢 10no dangerous workflow patterns detected
Packaging⚠️ -1packaging workflow not detected
Binary-Artifacts🟢 10no binaries found in the repo
Token-Permissions⚠️ 0detected GitHub workflow tokens with excessive permissions
Pinned-Dependencies⚠️ 2dependency not pinned by hash detected -- score normalized to 2
Branch-Protection⚠️ 0branch protection not enabled on development/release branches
Security-Policy⚠️ 0security policy file not detected
Fuzzing⚠️ 0project is not fuzzed
SAST⚠️ 0SAST tool is not run on all commits -- score normalized to 0
Vulnerabilities🟢 91 existing vulnerabilities detected

Scanned Manifest Files

package.json
  • kafkajs@^2.2.4
  • logform@^2.6.1
  • node-rdkafka@^3.1.0

@pranav-kural pranav-kural merged commit a3610f1 into main Sep 24, 2024
4 checks passed
@pranav-kural pranav-kural deleted the preview branch September 24, 2024 01:41
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant