Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

feat: paligo plugin #78

Merged
merged 16 commits into from
Jun 5, 2023
Merged

feat: paligo plugin #78

merged 16 commits into from
Jun 5, 2023

Conversation

baruchiro
Copy link
Contributor

@baruchiro baruchiro commented May 30, 2023

  • get folders and components
  • handle only component and folder types
  • send content to items
  • avoid reaching the rate limit

Note we are handling only folders to find sub-folders or components, and reading only the component (document) content.

Rate Limit

The rate limit per minute described here. The core lib time/rate is limiting the rate per second. That's why I'm starting with open seats for all the requests-per-minute, in case there are fewer requests than the limit. After the first too-many-requests error, I'm reducing the available seats to 1, so the frequency of the requests will not reach the rate limit.

Close #75

@baruchiro baruchiro requested a review from jossef May 30, 2023 08:38
@github-actions
Copy link

github-actions bot commented May 30, 2023

kics-logo

KICS version: v1.7.0

Category Results
HIGH HIGH 0
MEDIUM MEDIUM 0
LOW LOW 1
INFO INFO 0
TRACE TRACE 0
TOTAL TOTAL 1
Metric Values
Files scanned placeholder 1
Files parsed placeholder 1
Files failed to scan placeholder 0
Total executed queries placeholder 49
Queries failed to execute placeholder 0
Execution time placeholder 2

lib/paligo-api.go Outdated Show resolved Hide resolved
@baruchiro baruchiro marked this pull request as draft May 31, 2023 12:06
@baruchiro baruchiro force-pushed the baruchiro/Implement-Paligo-plugin branch from b683623 to 016aa6d Compare June 1, 2023 08:51
@baruchiro baruchiro marked this pull request as ready for review June 4, 2023 09:26
@baruchiro baruchiro requested a review from jossef June 4, 2023 09:26
@baruchiro baruchiro changed the title feat: Paligo plugin feat: paligo plugin Jun 4, 2023
plugins/paligo.go Outdated Show resolved Hide resolved
@baruchiro baruchiro merged commit 29f007c into master Jun 5, 2023
@baruchiro baruchiro deleted the baruchiro/Implement-Paligo-plugin branch June 5, 2023 10:53
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Implement Paligo plugin
2 participants