Skip to content

Commit

Permalink
Reorganize ci pipeline
Browse files Browse the repository at this point in the history
Reorganize ci pipeline


Reorganize ci pipeline


Reorganize ci pipeline


Reorganize ci pipeline


Cache pip


Reorganize ci pipeline


cleanup


cleanup


cleanup


cleanup


cleanup


All in one cicd


All in one cicd


All in on cicd


All in on cicd


aws-sit-create-infrastructure


Trigger workflow


Fix format


Trigger workflow


infra


infra


trigger


infra


trigger


trigger


trigger


trigger


infra


infra


trigger


patch


trigger


infra


trigger


patch


trigger


patch


trigger


executive-summary


executive-summary


trigger


executive summary


trigger


parameters


trigger


parameters


trigger


trigger actions


cicd


trigger


cicd


trigger


cicd


t


cicd


t


c


t


c


ta


c


t


c


t1


c


t3


c


tr3


c


T3


c


t3


t1


c


T1


c


tr


c


tr


c


c


c


t


c


t


c


c


p


t


c


t


c


t


c


t


c


t


c


t


c


t


c


t


c


t


c


c


c


t


c


t


c


t


c


t


c


t


action_server (to AWS ECR)


rasa_model (to S3)


c


train model


aws-eks-namespace-test


t


c


t


c


t


c


t


c


t


c


t


c


t


c


t


c


t


c


t


c


c


c


t


c


t


c


t


c


t


c


t


c


t


c


t


c


t


c


t


c


c


t


c


c


t


c


t


c


t


c


t


c


t


demo


Sharing session demo, up to deploy_TEST


Rasa Enterprise Deploy placeholders


Install rasa enterprise


With action server


Deploy


t


Deploy


t


Deploy


t


Deploy rasa model


t


Rasa Enterprise Health


t


Deploy model


try deploy model


deploy after wait for endpoint


Run smoketest


T


Fix workflow


t


Fix


fix spacy


Fix smoketest


t


Upgrade eksctl


tr


Increase initialProbeDelay for rasa livenesscheck


tr1


Fix smoketest


tr2


Add sleep after tagging production


tr3


tr4


tr5


Update README


Test full pipeline w. cluster in place
  • Loading branch information
ArjaanBuijk committed May 27, 2021
1 parent 149252a commit dacf207
Show file tree
Hide file tree
Showing 16 changed files with 1,651 additions and 157 deletions.
2 changes: 2 additions & 0 deletions .github/trigger.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
# A dummy file to trigger the workflow without making any actual change.
# Just change something arbitrary in this text, like a space .
94 changes: 0 additions & 94 deletions .github/workflows/build_and_deploy.yml

This file was deleted.

98 changes: 98 additions & 0 deletions .github/workflows/cicd-cleanup.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,98 @@
name: financial-demo cicd cleanup

# Trigger `delete` works only once workflow is pushed to default branch
on: [delete]

env:
AWS_REGION: us-west-2
AWS_ECR_URI: 024629701212.dkr.ecr.us-west-2.amazonaws.com
AWS_ECR_REPOSITORY: financial-demo
AWS_S3_BUCKET_NAME: rasa-financial-demo

jobs:
params:
name: params
runs-on: ubuntu-latest
# Map step outputs to job outputs, for use by downstream jobs
outputs:
docker_registry: ${{ steps.action_server.outputs.docker_registry }}

aws_region: ${{ steps.aws.outputs.aws_region }}
aws_s3: ${{ steps.aws.outputs.aws_s3 }}

steps:
- name: checkout
uses: actions/checkout@v2

- name: action_server
id: action_server
run: |
echo "::set-output name=docker_registry::${{ env.AWS_ECR_URI }}"
# deleted branch name
- name: rasa_model
id: rasa_model
run: |
# deleted branch name
- name: aws
id: aws
run: |
echo "::set-output name=aws_region::${{ env.AWS_REGION }}"
echo "::set-output name=aws_s3::${{ env.AWS_S3_BUCKET_NAME }}"
params_summary:
name: params_summary
runs-on: ubuntu-latest
needs: [params]
steps:
- name: params_summary
run: |
echo docker_registry : ${{ needs.params.outputs.docker_registry }}
echo do_training: ${{ needs.params.outputs.do_training }}
echo aws_region: ${{ needs.params.outputs.aws_region }}
echo aws_s3: ${{ needs.params.outputs.aws_s3 }}
#
# - name: Dump GitHub context
# env:
# GITHUB_CONTEXT: ${{ toJSON(github) }}
# run: |
# echo "$GITHUB_CONTEXT"
# exit 1

aws-cleanup:
name: aws-cleanup
runs-on: ubuntu-latest
needs: [params]
if: github.event.ref_type == 'branch'
steps:
- name: checkout
uses: actions/checkout@v2

- name: Configure AWS Credentials
if: ${{ needs.params.outputs.aws_eks_create == 'true' }}
uses: aws-actions/configure-aws-credentials@v1
with:
aws-access-key-id: ${{ secrets.AWS_ACCESS_KEY_ID }}
aws-secret-access-key: ${{ secrets.AWS_SECRET_ACCESS_KEY }}
aws-region: ${{ needs.params.outputs.aws_region }}

- name: aws-eks-delete-test-cluster
run: |
echo "TO BE IMPLEMENTED"
exit 1
make aws-eks-delete ....
- name: aws-ecr-delete-test-images
run: |
echo "TO BE IMPLEMENTED"
exit 1
make aws-ecr-delete-images ....
- name: aws-s3-delete-test-models
run: |
echo "TO BE IMPLEMENTED"
exit 1
make aws-s3-delete-files ....
Loading

0 comments on commit dacf207

Please sign in to comment.