Skip to content

Add documentation for standalone (sparkless) GC #13102

Add documentation for standalone (sparkless) GC

Add documentation for standalone (sparkless) GC #13102

Triggered via pull request October 27, 2024 15:11
Status Success
Total duration 22m 9s
Billable time 12m
Artifacts 3

esti.yaml

on: pull_request
Check if secrets are available.
3s
Check if secrets are available.
Generate code from latest lakeFS app
15s
Generate code from latest lakeFS app
Build lakeFS HadoopFS
40s
Build lakeFS HadoopFS
Prepare Spark Apps
41s
Prepare Spark Apps
login-to-amazon-ecr
4s
login-to-amazon-ecr
Build and push rclone export Docker image
24s
Build and push rclone export Docker image
Build and push Docker image
1m 56s
Build and push Docker image
Build metadata client for Spark 3.x
6s
Build metadata client for Spark 3.x
Test lakeFS rclone export functionality
51s
Test lakeFS rclone export functionality
Test lakeFS Hadoop FileSystem
4m 11s
Test lakeFS Hadoop FileSystem
Test lakeFS multipart upload with Hadoop S3A
1m 52s
Test lakeFS multipart upload with Hadoop S3A
Test metastore client commands using trino
49s
Test metastore client commands using trino
Run latest lakeFS app on AWS S3 DynamoDB KV
4m 56s
Run latest lakeFS app on AWS S3 DynamoDB KV
Run latest lakeFS app on AWS S3
7m 23s
Run latest lakeFS app on AWS S3
Run latest lakeFS app on Google Cloud Platform and Google Cloud Storage
8m 4s
Run latest lakeFS app on Google Cloud Platform and Google Cloud Storage
Run latest lakeFS app on Azure with Azure blobstore
5m 6s
Run latest lakeFS app on Azure with Azure blobstore
Run latest lakeFS app on Azure with Azure Data Lake Storage Gen2 and CosmosDB
19m 33s
Run latest lakeFS app on Azure with Azure Data Lake Storage Gen2 and CosmosDB
Test lakeFS against the python wrapper client
3m 18s
Test lakeFS against the python wrapper client
E2E - DynamoDB Local - Local Block Adapter
2m 3s
E2E - DynamoDB Local - Local Block Adapter
Quickstart
2m 5s
Quickstart
Run latest lakeFS app on AWS S3 + Basic Auth
6m 35s
Run latest lakeFS app on AWS S3 + Basic Auth
Matrix: spark
Test lakeFS metadata client export with Spark 3.x
1m 10s
Test lakeFS metadata client export with Spark 3.x
Test unified gc
2m 16s
Test unified gc
Fit to window
Zoom out
Zoom in

Annotations

26 warnings and 2 notices
login-to-amazon-ecr
Your docker password is not masked. See https://github.com/aws-actions/amazon-ecr-login#docker-credentials for more information.
Generate code from latest lakeFS app
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/upload-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Build and push rclone export Docker image
The following actions use a deprecated Node.js version and will be forced to run on node20: docker/setup-buildx-action@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Prepare Spark Apps
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-java@v3, actions/upload-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Build lakeFS HadoopFS
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-java@v3, actions/upload-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Build and push Docker image
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/download-artifact@v3, docker/setup-buildx-action@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Test metastore client commands using trino
The following actions use a deprecated Node.js version and will be forced to run on node20: docker/login-action@v2, docker/setup-buildx-action@v2, actions/download-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Test lakeFS rclone export functionality
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/download-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Test lakeFS metadata client export with Spark 3.x
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/download-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Test lakeFS multipart upload with Hadoop S3A
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-java@v3, actions/download-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
E2E - DynamoDB Local - Local Block Adapter
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-node@v3, actions/upload-artifact@v3, actions/github-script@v6. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
E2E - DynamoDB Local - Local Block Adapter
No files were found with the provided path: webui/test-results/. No artifacts will be uploaded.
Quickstart
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-node@v3, actions/upload-artifact@v3, actions/github-script@v6. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Quickstart
No files were found with the provided path: webui/test-results/. No artifacts will be uploaded.
Test unified gc
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-go@v4, actions/download-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Test lakeFS against the python wrapper client
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Test lakeFS Hadoop FileSystem
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/download-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run latest lakeFS app on AWS S3 DynamoDB KV
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/download-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run latest lakeFS app on Azure with Azure blobstore
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/download-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Test lakeFS with Spark 2.X
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/download-artifact@v3, actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run latest lakeFS app on AWS S3 + Basic Auth
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/download-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Test lakeFS with Spark 3.X
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/download-artifact@v3, actions/setup-python@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run latest lakeFS app on AWS S3
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/download-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run latest lakeFS app on Google Cloud Platform and Google Cloud Storage
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/download-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Deprecation notice: v1, v2, and v3 of the artifact actions
The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "generated-code", "lakefs-hadoopfs", "spark-apps". Please update your workflow to use v4 of the artifact actions. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
Run latest lakeFS app on Azure with Azure Data Lake Storage Gen2 and CosmosDB
The following actions use a deprecated Node.js version and will be forced to run on node20: azure/login@v1, actions/download-artifact@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
🎭 Playwright Run Summary
13 passed (27.5s)
🎭 Playwright Run Summary
11 passed (33.5s)

Artifacts

Produced during runtime
Name Size
generated-code
27.2 MB
lakefs-hadoopfs
6.29 MB
spark-apps
4.35 MB