Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: paligo plugin #78

Merged
merged 16 commits into from
Jun 5, 2023
Merged

feat: paligo plugin #78

merged 16 commits into from
Jun 5, 2023

Conversation

baruchiro
Copy link
Contributor

@baruchiro baruchiro commented May 30, 2023

  • get folders and components
  • handle only component and folder types
  • send content to items
  • avoid reaching the rate limit

Note we are handling only folders to find sub-folders or components, and reading only the component (document) content.

Rate Limit

The rate limit per minute described here. The core lib time/rate is limiting the rate per second. That's why I'm starting with open seats for all the requests-per-minute, in case there are fewer requests than the limit. After the first too-many-requests error, I'm reducing the available seats to 1, so the frequency of the requests will not reach the rate limit.

Close #75

@baruchiro baruchiro requested a review from jossef May 30, 2023 08:38
@github-actions
Copy link

github-actions bot commented May 30, 2023

kics-logo

KICS version: v1.7.0

Category Results
HIGH HIGH 0
MEDIUM MEDIUM 0
LOW LOW 1
INFO INFO 0
TRACE TRACE 0
TOTAL TOTAL 1
Metric Values
Files scanned placeholder 1
Files parsed placeholder 1
Files failed to scan placeholder 0
Total executed queries placeholder 49
Queries failed to execute placeholder 0
Execution time placeholder 2

lib/paligo-api.go Outdated Show resolved Hide resolved
@baruchiro baruchiro marked this pull request as draft May 31, 2023 12:06
@baruchiro baruchiro force-pushed the baruchiro/Implement-Paligo-plugin branch from b683623 to 016aa6d Compare June 1, 2023 08:51
@baruchiro baruchiro marked this pull request as ready for review June 4, 2023 09:26
@baruchiro baruchiro requested a review from jossef June 4, 2023 09:26
@baruchiro baruchiro changed the title feat: Paligo plugin feat: paligo plugin Jun 4, 2023
plugins/paligo.go Outdated Show resolved Hide resolved
@baruchiro baruchiro merged commit 29f007c into master Jun 5, 2023
@baruchiro baruchiro deleted the baruchiro/Implement-Paligo-plugin branch June 5, 2023 10:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Implement Paligo plugin
2 participants