Skip to content

CosmosDB iterator to use dynamic batch size after the first list #12049

CosmosDB iterator to use dynamic batch size after the first list

CosmosDB iterator to use dynamic batch size after the first list #12049

Triggered via pull request June 19, 2024 15:14
Status Success
Total duration 15m 32s
Artifacts 3

esti.yaml

on: pull_request
Check if secrets are available.
2s
Check if secrets are available.
Generate code from latest lakeFS app
2m 12s
Generate code from latest lakeFS app
Build lakeFS HadoopFS
36s
Build lakeFS HadoopFS
Prepare Spark Apps
41s
Prepare Spark Apps
login-to-amazon-ecr
3s
login-to-amazon-ecr
Build and push rclone export Docker image
26s
Build and push rclone export Docker image
Build and push Docker image
2m 33s
Build and push Docker image
Build metadata client for Spark 3.x
18s
Build metadata client for Spark 3.x
Test lakeFS rclone export functionality
52s
Test lakeFS rclone export functionality
Test lakeFS Hadoop FileSystem
3m 55s
Test lakeFS Hadoop FileSystem
Test lakeFS multipart upload with Hadoop S3A
1m 25s
Test lakeFS multipart upload with Hadoop S3A
Test metastore client commands using trino
53s
Test metastore client commands using trino
Run latest lakeFS app on AWS S3 DynamoDB KV
5m 22s
Run latest lakeFS app on AWS S3 DynamoDB KV
Run latest lakeFS app on AWS S3
7m 19s
Run latest lakeFS app on AWS S3
Run latest lakeFS app on Google Cloud Platform and Google Cloud Storage
5m 6s
Run latest lakeFS app on Google Cloud Platform and Google Cloud Storage
Run latest lakeFS app on Azure with Azure blobstore
4m 16s
Run latest lakeFS app on Azure with Azure blobstore
Run latest lakeFS app on Azure with Azure Data Lake Storage Gen2 and CosmosDB
10m 17s
Run latest lakeFS app on Azure with Azure Data Lake Storage Gen2 and CosmosDB
Test lakeFS against the python wrapper client
1m 31s
Test lakeFS against the python wrapper client
E2E - DynamoDB Local - Local Block Adapter
2m 15s
E2E - DynamoDB Local - Local Block Adapter
Matrix: spark
Test lakeFS metadata client export with Spark 3.x
1m 9s
Test lakeFS metadata client export with Spark 3.x
Test unified gc
3m 44s
Test unified gc
Fit to window
Zoom out
Zoom in

Annotations

1 error, 24 warnings, and 1 notice
Run latest lakeFS app on Azure with Azure Data Lake Storage Gen2 and CosmosDB
Process completed with exit code 1.
login-to-amazon-ecr
Your docker password is not masked. See https://github.com/aws-actions/amazon-ecr-login#docker-credentials for more information.
Build lakeFS HadoopFS
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-java@v3, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Build and push rclone export Docker image
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: docker/setup-buildx-action@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Prepare Spark Apps
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-java@v3, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Generate code from latest lakeFS app
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/cache@v3, actions/setup-go@v4, actions/setup-node@v3, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Build and push Docker image
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3, docker/setup-buildx-action@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Build metadata client for Spark 3.x
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/cache@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Test lakeFS rclone export functionality
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Test metastore client commands using trino
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: docker/login-action@v2, docker/setup-buildx-action@v2, actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Test lakeFS multipart upload with Hadoop S3A
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-java@v3, actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Test lakeFS against the python wrapper client
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-python@v4. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Test lakeFS metadata client export with Spark 3.x
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/cache@v3, actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
E2E - DynamoDB Local - Local Block Adapter
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-node@v3, actions/cache@v3, actions/upload-artifact@v3, actions/github-script@v6. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
E2E - DynamoDB Local - Local Block Adapter
No files were found with the provided path: webui/test-results/. No artifacts will be uploaded.
Test lakeFS Hadoop FileSystem
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Run latest lakeFS app on Azure with Azure blobstore
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Run latest lakeFS app on Google Cloud Platform and Google Cloud Storage
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Run latest lakeFS app on AWS S3 DynamoDB KV
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Test unified gc
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/setup-go@v4, actions/download-artifact@v3, actions/cache@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Run latest lakeFS app on AWS S3
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Test lakeFS with Spark 2.X
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3, actions/setup-python@v4. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Test lakeFS with Spark 3.X
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3, actions/setup-python@v4. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Run latest lakeFS app on Azure with Azure Data Lake Storage Gen2 and CosmosDB
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "generated-code", "lakefs-hadoopfs", "spark-apps". Please update your workflow to use v4 of the artifact actions. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
🎭 Playwright Run Summary
13 passed (28.0s)

Artifacts

Produced during runtime
Name Size
generated-code Expired
10.7 MB
lakefs-hadoopfs Expired
6.29 MB
spark-apps Expired
4.35 MB