-
Notifications
You must be signed in to change notification settings - Fork 56
Gitlab CICD
(toc generated using https://ecotrust-canada.github.io/markdown-toc)
CI is based on Gitlab CI.
The project CICD can be seen at https://gitlab.com/vmware-analytics/versatile-data-kit/-/pipelines Request access to VMware Analytics Group to get access to the CICD
CICD deploys (automatically) on each change the latest version of Control Service and quickstart-vdk. This is used either for demo purposes or by automated release acceptance tests.
The following variables are used by the CICD. Those are injected as environment variables in Gitlab CI. Actual values can be seen in CICD -> Variables of the Gitlab project.
Edited using https://www.tablesgenerator.com/markdown_tables# (use File -> Paste table data ...)
Name | Description | (most likely) value |
---|---|---|
PIP_EXTRA_INDEX_URL | extra index used to download from pypi | https://pypi.org/simple |
PIP_REPO_UPLOAD_URL | PyPI URL where python packages are released/uploaded | https://upload.pypi.org/legacy/ |
PIP_REPO_UPLOAD_USER_NAME | Upload PyPI URL user | |
PIP_REPO_UPLOAD_USER_PASSWORD | Upload PyPI URL password | |
Name | Description | (most likely) Value |
---|---|---|
KUBECONFIG | contains kubeconfig to the kubernetes (in AWS EKS) used to deploy CICD gitlab runners and cicd demo deployment of Versatile Data Kit | |
AWS_DEFAULT_REGION | Default region where AWS EKS (kubernetes) | us-west-1 |
AWS_ACCESS_KEY_ID | Used to authenticate against AWS to get access to kubernetes | |
AWS_SECRET_ACCESS_KEY | Used to authenticate against AWS to get access to kubernetes | |
CICD_CONTAINER_REGISTRY_URI | Container registry used to house cicd/demo data job images | ghcr.io/tozka |
CICD_CONTAINER_REGISTRY_USER_NAME | User used to authenticate against cicd container registry | tozka |
CICD_CONTAINER_REGISTRY_USER_PASSWORD | User password used to authenticate against cicd container registry | |
CICD_GIT_URI | CICD Git uri used to house cicd/demo data jobs sources | https://github.com/tozka/cicd-data-jobs.git |
CICD_GIT_USER | User used to authenticate against CICD git | |
CICD_GIT_PASSWORD | User password used to authenticate against cicd git | |
VDK_API_TOKEN | OAuth2 (CSP) API token used to authenticate against Control Service API |
SDK - Develop Data Jobs
SDK Key Concepts
Control Service - Deploy Data Jobs
Control Service Key Concepts
- Scheduling a Data Job for automatic execution
- Deployment
- Execution
- Production
- Properties and Secrets
Operations UI
Community
Contacts