Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Gitlab Integration #1040

Closed
wants to merge 80 commits into from
Closed

Gitlab Integration #1040

wants to merge 80 commits into from

Commits on Sep 13, 2024

  1. Initial Setup

    @shariff6
    shariff6 committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    d47b2f7 View commit details
    Browse the repository at this point in the history

  2. Adds blueprint for gitlabIssues, Projects, Merge Requests and Groups

    @shariff6
    shariff6 committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    39ff4b3 View commit details
    Browse the repository at this point in the history

  3. Adds gitlabProject, gitlabMergeRequests, gitlabIssues and gitlabGroup… 

    …s king to port config
    @shariff6
    shariff6 committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    31af127 View commit details
    Browse the repository at this point in the history

  4. Update lock file

    @shariff6
    shariff6 committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    31c7b6b View commit details
    Browse the repository at this point in the history

  5. Adds config.yaml file

    @shariff6
    shariff6 committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    b341e5c View commit details
    Browse the repository at this point in the history

  6. Adds kinds gitlabGroup, gitlProject , gitlabIssue and gitlabMergeRequest

    @shariff6
    shariff6 committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    cb1f6e1 View commit details
    Browse the repository at this point in the history

  7. corrects project identifier, reames to gitlabProject

    @shariff6
    shariff6 committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    2e107e0 View commit details
    Browse the repository at this point in the history

  8. Initialise client

    @shariff6
    shariff6 committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    7019701 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2024

  1. Client for gitlab api, get projects, issues, mr's and groups

    @shariff6
    shariff6 committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    6ae8c50 View commit details
    Browse the repository at this point in the history

  2. fethc, projects, groups, issues and mrs async with ocean

    @shariff6
    shariff6 committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    1468851 View commit details
    Browse the repository at this point in the history

  3. adds gitlab token to env

    @shariff6
    shariff6 committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    86ce514 View commit details
    Browse the repository at this point in the history

  4. Error Message Fix

    @shariff6
    shariff6 committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    b78b8f8 View commit details
    Browse the repository at this point in the history

  5. Uses AsyncGenerator class for fetching and processing

    @shariff6
    shariff6 committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    81e29e7 View commit details
    Browse the repository at this point in the history

  6. removes pagination for now. Reduces page size to 10

    @shariff6
    shariff6 committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    51e07b9 View commit details
    Browse the repository at this point in the history

  7. Updates main.py to work with Async Generator type, 

    removes await
    @shariff6
    shariff6 committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    d3ad53a View commit details
    Browse the repository at this point in the history

  8. Adds a fetch_items to fetch resources asynchronously. 

    Removes if else statements, wraps kinds in dictionary(resource_map)
    @shariff6
    shariff6 committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    c7d5cae View commit details
    Browse the repository at this point in the history

  9. Implements rate_limiting using asyncio, Semaphore.

    @shariff6
    shariff6 committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    868a767 View commit details
    Browse the repository at this point in the history

  10. Removes Record Limit, Stops fetching when completed

    @shariff6
    shariff6 committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    e48676a View commit details
    Browse the repository at this point in the history

  11. Refactor resync handling: Split single on_resync function into indivi… 

    …dual handlers for each resource type - Replaced the single 'on_resync' function with dedicated handlers for GitLab groups, projects, merge requests, and issues. - Each resource type now has its own on_resync function to manage synchronization. - Added fetch_resource helper function to collect and return items from the respective fetch methods.
    @shariff6
    shariff6 committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    e6c22a6 View commit details
    Browse the repository at this point in the history

  12. Adds a gitlab_rate_limiter class, that implements rate limiting based… 

    … on information in reponse from gitlab headers,
    @shariff6
    shariff6 committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    f49a27e View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2024

  1. Fixes bug with issues and mrs, fetches the authroised users mrs, proj… 

    …ects, groups and issues
    @shariff6
    shariff6 committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    37fa4b1 View commit details
    Browse the repository at this point in the history

  2. Simplifies gitlab handler, moves resource specific mapping to mapper … 

    …class.

Creates a mapper_factory helper class for easier adding of resource type and resource mappings
    @shariff6
    shariff6 committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    77e180d View commit details
    Browse the repository at this point in the history

  3. Moves rate limiting to helper class

    @shariff6
    shariff6 committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    d7fdeb4 View commit details
    Browse the repository at this point in the history

  4. Updates main to work with new mapper helper

    @shariff6
    shariff6 committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    c693736 View commit details
    Browse the repository at this point in the history

  5. Adds endpoint to communicate with Gitlab Webhooks API 

    Adds setting up webhooks once Gitlab Integrations has began

Create, List and Update Webhooks
    @shariff6
    shariff6 committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    34bf883 View commit details
    Browse the repository at this point in the history

  6. Adds Webhook Secret and Wehbook Url to port configs

    @shariff6
    shariff6 committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    c1f7bc5 View commit details
    Browse the repository at this point in the history

  7. Modifies params in resource fetching

    @shariff6
    shariff6 committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    231ac46 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. Removes lopp in fetch_paginated_resources. 

    Adjust setupwebhooks accross all projects
    @shariff6
    shariff6 committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    e6def0b View commit details
    Browse the repository at this point in the history

  2. Uses initials gitlab handler, yield response on resync.

    @shariff6
    shariff6 committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    4d9952a View commit details
    Browse the repository at this point in the history

  3. Adds a gitlab_config for configuring specific params, and loading add… 

    …itional resources

Moves fetch resources logic into get_paginated_resource function
    @shariff6
    shariff6 committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    c9bfb06 View commit details
    Browse the repository at this point in the history

  4. Removes redundant error checks

    @shariff6
    shariff6 committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    08848f0 View commit details
    Browse the repository at this point in the history

  5. Removes webhook logic from gitlab handler class, moves

    @shariff6
    shariff6 committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    d7b8f80 View commit details
    Browse the repository at this point in the history

  6. Adds an init client to initalise gitlab handler, 

    Separates webhook and gitlab logic for initialisation

Adds comments to better explain processes
    @shariff6
    shariff6 committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    ab1f204 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. Fixes bug ewhen additional data is not defined

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    2d472fc View commit details
    Browse the repository at this point in the history

  2. Cleans up file for bettter readability,

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    7499ffd View commit details
    Browse the repository at this point in the history

  3. Add semaphore to regulate concurrent requests

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    084f894 View commit details
    Browse the repository at this point in the history

  4. Updates propertires to match blueprint

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    e961c44 View commit details
    Browse the repository at this point in the history

  5. Adds logic for group webhooks

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    9ce86c9 View commit details
    Browse the repository at this point in the history

  6. Removes inline comments

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    e353543 View commit details
    Browse the repository at this point in the history

  7. Removes inline comments

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    316fa2c View commit details
    Browse the repository at this point in the history

  8. Specifies token as gitlab token

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    bed744b View commit details
    Browse the repository at this point in the history

  9. Maps identifiers to string type

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    5b353f7 View commit details
    Browse the repository at this point in the history

  10. Removes unused mapper factory

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    a8ac9a7 View commit details
    Browse the repository at this point in the history

  11. Updates gitlab params with those allowed by permission

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    10ee430 View commit details
    Browse the repository at this point in the history

  12. Merge branch 'main' of https://github.com/shariff6/ocean into gitlab_v1

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    eaf25c1 View commit details
    Browse the repository at this point in the history

  13. Merge pull request #3 from shariff6/gitlab_v1 

    Gitlab v1
    @shariff6
    shariff6 authored Sep 18, 2024
    Configuration menu
    Copy the full SHA
    8b3a4dc View commit details
    Browse the repository at this point in the history

  14. Adds support for multiple tokens

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    6aadbc9 View commit details
    Browse the repository at this point in the history

  15. Mutliple token support

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    3cb9e22 View commit details
    Browse the repository at this point in the history

  16. Merge pull request #4 from shariff6/gitlab_v1 

    Gitlab v1
    @shariff6
    shariff6 authored Sep 18, 2024
    Configuration menu
    Copy the full SHA
    39fc89d View commit details
    Browse the repository at this point in the history

  17. Merge branch 'main' into main

    @shariff6
    shariff6 authored Sep 18, 2024
    Configuration menu
    Copy the full SHA
    3c6109b View commit details
    Browse the repository at this point in the history

  18. Adds description and requires gitlabToken

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    7f3978e View commit details
    Browse the repository at this point in the history

  19. Removes check on webhook secret gor incoming post from gitlab

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    8e26bad View commit details
    Browse the repository at this point in the history

  20. Generates secret fif webhook secret is not provided

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    383900d View commit details
    Browse the repository at this point in the history

  21. Removes unused project webhook code

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    0c04db1 View commit details
    Browse the repository at this point in the history

  22. moves gitlab integration class to its own file cleaning up main file

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    1892e9b View commit details
    Browse the repository at this point in the history

  23. Adds events to be attached to webhook, configures events through yaml… 

    … file
    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    dd8b3de View commit details
    Browse the repository at this point in the history

  24. removes gitlab prefix from kinds

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    a119fec View commit details
    Browse the repository at this point in the history

  25. Update CHANGELOG.md

    @shariff6
    shariff6 authored Sep 18, 2024
    Configuration menu
    Copy the full SHA
    2069374 View commit details
    Browse the repository at this point in the history

  26. Removes configuration from launch.json

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    d8c87d1 View commit details
    Browse the repository at this point in the history

  27. Merge branch 'gitlab_v1' of https://github.com/shariff6/ocean into gi… 

    …tlab_v1
    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    381ee2b View commit details
    Browse the repository at this point in the history

  28. Update CONTRIBUTING.md

    @shariff6
    shariff6 authored Sep 18, 2024
    Configuration menu
    Copy the full SHA
    98d8afb View commit details
    Browse the repository at this point in the history

  29. Merge branch 'gitlab_v1' of https://github.com/shariff6/ocean into gi… 

    …tlab_v1
    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    298c6b8 View commit details
    Browse the repository at this point in the history

  30. Uncomments aws credentials check in pre-commit

    @shariff6
    shariff6 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    4d26340 View commit details
    Browse the repository at this point in the history

  31. Merge pull request #5 from shariff6/gitlab_v1 

    Gitlab v1
    @shariff6
    shariff6 authored Sep 18, 2024
    Configuration menu
    Copy the full SHA
    5e5273d View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. Merge branch 'port-labs:main' into main

    @shariff6
    shariff6 authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    d0ecd05 View commit details
    Browse the repository at this point in the history

  2. Adds support for all events to the setup group webhooks

    @shariff6
    shariff6 committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    b54bec1 View commit details
    Browse the repository at this point in the history

  3. Merge pull request #6 from shariff6/gitlab_v1 

    Adds support for all events to the setup group webhooks
    @shariff6
    shariff6 authored Sep 19, 2024
    Configuration menu
    Copy the full SHA
    2bbb3bd View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. Adds generic resync

    @shariff6
    shariff6 committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    c80f27a View commit details
    Browse the repository at this point in the history

  2. Merge pull request #7 from shariff6/gitlab_v1 

    Adds generic resync
    @shariff6
    shariff6 authored Sep 20, 2024
    Configuration menu
    Copy the full SHA
    d7de9e9 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'port-labs:main' into main

    @shariff6
    shariff6 authored Sep 20, 2024
    Configuration menu
    Copy the full SHA
    9603ee7 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. --no-verify 

    Changes config to use single gitlab token env
    @shariff6
    shariff6 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    395c837 View commit details
    Browse the repository at this point in the history

  2. uses token comma separated string instead of array

    @shariff6
    shariff6 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    ea590a0 View commit details
    Browse the repository at this point in the history

  3. Comments out unused additonal data for this task

    @shariff6
    shariff6 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    8372bb2 View commit details
    Browse the repository at this point in the history

  4. Cleans up code, combines webhook events for better handling

    @shariff6
    shariff6 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    b76b7c1 View commit details
    Browse the repository at this point in the history

  5. Merge pull request #8 from shariff6/gitlab_v1 

    Gitlab v1
    @shariff6
    shariff6 authored Sep 23, 2024
    Configuration menu
    Copy the full SHA
    a34df09 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'port-labs:main' into main

    @shariff6
    shariff6 authored Sep 23, 2024
    Configuration menu
    Copy the full SHA
    4998d7b View commit details
    Browse the repository at this point in the history

  7. Fixes pre-commit config

    @shariff6
    shariff6 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    34259f6 View commit details
    Browse the repository at this point in the history

  8. Updates env.example

    @shariff6
    shariff6 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    c9ff417 View commit details
    Browse the repository at this point in the history

  9. Updates ocean to latest version

    @shariff6
    shariff6 committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    a1876a0 View commit details
    Browse the repository at this point in the history

  10. Merge pull request #9 from shariff6/gitlab_v1 

    Fixes pre-commit config
    @shariff6
    shariff6 authored Sep 23, 2024
    Configuration menu
    Copy the full SHA
    e189035 View commit details
    Browse the repository at this point in the history