VReplication: add vector support to workflows (#5472)

* Add support for vectors in vreplication workflows. unit and e2e tests. Update cnf file to add loose_with_ps_vectors Signed-off-by: Rohit Nayak <[email protected]> * Self review fixes. Add e2e TestVector to CI Signed-off-by: Rohit Nayak <[email protected]> * Simplify unit test CI workflow to debug failure Signed-off-by: Rohit Nayak <[email protected]> * Skip test on errors on setting with_ps_vectors Signed-off-by: Rohit Nayak <[email protected]> * Revert debug mods to unit_race.yml Signed-off-by: Rohit Nayak <[email protected]> * Unit test race is again failing with no logs. So modify CI workflow temporarily to get full detail to debug random failures apparently unrelated to this PR Signed-off-by: Rohit Nayak <[email protected]> * Setup templating for vectors vreplication build Signed-off-by: Dirkjan Bussink <[email protected]> * Add vcopier unit test. Insert additional rows in e2e test after copy phase to test replication phase Signed-off-by: Rohit Nayak <[email protected]> * Switch shard for vector test to correct one Signed-off-by: Rohit Nayak <[email protected]> * Use vectors build for unit tests Signed-off-by: Dirkjan Bussink <[email protected]> * Refactor tests: move vector unit tests to separate files Signed-off-by: Rohit Nayak <[email protected]> * recognize ERVectorDimensionsMismatch = ErrorCode(4501) as unrecoverable Signed-off-by: Shlomi Noach <[email protected]> * Unit race still failing without details:-(. Commenting out the summary code which seems to be redacting the details Signed-off-by: Rohit Nayak <[email protected]> * Make tests non-skippable Signed-off-by: Rohit Nayak <[email protected]> * Move unit race to vector image Signed-off-by: Rohit Nayak <[email protected]> * Add AWS creds to unit race because we need it for S3 access Signed-off-by: Rohit Nayak <[email protected]> * Mute tool outputs Signed-off-by: Rohit Nayak <[email protected]> * Recreate mysql80 unit test Signed-off-by: Rohit Nayak <[email protected]> --------- Signed-off-by: Rohit Nayak <[email protected]> Signed-off-by: Dirkjan Bussink <[email protected]> Signed-off-by: Shlomi Noach <[email protected]> Co-authored-by: Dirkjan Bussink <[email protected]> Co-authored-by: Shlomi Noach <[email protected]>
vitessio · Jun 27, 2024 · 3e48cc6 · 3e48cc6
1 parent db18b04
commit 3e48cc6
Show file tree

Hide file tree

Showing 75 changed files with 553 additions and 200 deletions.
diff --git a/.github/workflows/cluster_endtoend_12.yml b/.github/workflows/cluster_endtoend_12.yml
@@ -86,11 +86,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_13.yml b/.github/workflows/cluster_endtoend_13.yml
@@ -86,11 +86,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_15.yml b/.github/workflows/cluster_endtoend_15.yml
@@ -86,11 +86,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_18.yml b/.github/workflows/cluster_endtoend_18.yml
@@ -86,11 +86,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_21.yml b/.github/workflows/cluster_endtoend_21.yml
@@ -86,11 +86,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_backup_pitr.yml b/.github/workflows/cluster_endtoend_backup_pitr.yml
@@ -86,11 +86,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_ers_prs_newfeatures_heavy.yml b/.github/workflows/cluster_endtoend_ers_prs_newfeatures_heavy.yml
@@ -86,11 +86,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_mysql80.yml b/.github/workflows/cluster_endtoend_mysql80.yml
@@ -86,11 +86,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_mysql_server_vault.yml b/.github/workflows/cluster_endtoend_mysql_server_vault.yml
@@ -86,11 +86,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_onlineddl_revert.yml b/.github/workflows/cluster_endtoend_onlineddl_revert.yml
@@ -87,11 +87,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_onlineddl_scheduler.yml b/.github/workflows/cluster_endtoend_onlineddl_scheduler.yml
@@ -87,11 +87,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_onlineddl_vrepl.yml b/.github/workflows/cluster_endtoend_onlineddl_vrepl.yml
@@ -87,11 +87,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_onlineddl_vrepl_stress.yml b/.github/workflows/cluster_endtoend_onlineddl_vrepl_stress.yml
@@ -87,11 +87,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_onlineddl_vrepl_stress_suite.yml b/.github/workflows/cluster_endtoend_onlineddl_vrepl_stress_suite.yml
@@ -87,11 +87,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_onlineddl_vrepl_suite.yml b/.github/workflows/cluster_endtoend_onlineddl_vrepl_suite.yml
@@ -87,11 +87,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_schemadiff_vrepl.yml b/.github/workflows/cluster_endtoend_schemadiff_vrepl.yml
@@ -87,11 +87,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_tabletmanager_tablegc.yml b/.github/workflows/cluster_endtoend_tabletmanager_tablegc.yml
@@ -86,11 +86,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_tabletmanager_throttler_topo.yml b/.github/workflows/cluster_endtoend_tabletmanager_throttler_topo.yml
@@ -86,11 +86,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_topo_connection_cache.yml b/.github/workflows/cluster_endtoend_topo_connection_cache.yml
@@ -86,11 +86,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_vreplication_across_db_versions.yml b/.github/workflows/cluster_endtoend_vreplication_across_db_versions.yml
@@ -86,11 +86,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_vreplication_basic.yml b/.github/workflows/cluster_endtoend_vreplication_basic.yml
@@ -86,11 +86,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_vreplication_cellalias.yml b/.github/workflows/cluster_endtoend_vreplication_cellalias.yml
@@ -86,11 +86,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1

diff --git a/.github/workflows/cluster_endtoend_vreplication_copy_parallel.yml b/.github/workflows/cluster_endtoend_vreplication_copy_parallel.yml
@@ -86,11 +86,9 @@ jobs:
         sudo apt-get -qq install -y make unzip g++ etcd curl git wget awscli eatmydata xz-utils libncurses5
         sudo service etcd stop
 
-        # Get latest version of mysql from s3 bucket
-        LATEST_BUILD=$(aws s3api list-objects-v2 --bucket "planetscale-mysql-server-private-ci-artifacts" --prefix mysql/main/dist --query 'reverse(sort_by(Contents[?contains(Key, `jammy`)], &LastModified))[:1].Key' --output=text)
-        echo "latest build is $LATEST_BUILD"
         # Pin this to 8.0.34
         LAST_BUILD="mysql/main/8.0.34.20240216-ps-6ce6a79427b/dist/mysql-8.0.34.20240216-ps-6ce6a79427b-jammy-linux-x86_64.tar.gz"
+
         echo "installing psdb mysql $LAST_BUILD"
         aws s3 cp "s3://planetscale-mysql-server-private-ci-artifacts/${LAST_BUILD}" .
         sudo tar xf $(basename $LAST_BUILD) -v -C /usr --strip-components=1