Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mark flaky tests as xfail #98

Merged
merged 2 commits into from
Dec 1, 2023
Merged

Mark flaky tests as xfail #98

merged 2 commits into from
Dec 1, 2023

Conversation

pavelzw
Copy link
Member

@pavelzw pavelzw commented Dec 1, 2023

No description provided.

@pavelzw pavelzw added the ci Changes in the CI configuration label Dec 1, 2023
@pavelzw pavelzw merged commit b76244e into main Dec 1, 2023
18 checks passed
@pavelzw pavelzw deleted the xfail branch December 1, 2023 21:44
Copy link

github-actions bot commented Dec 1, 2023

(benchmark 7065502914 / attempt 1)
Base results / Our results / Change

Model Size Dump Time Load Time
sklearn rf 20M 23.4 MiB / 3.0 MiB / 7.67 x 0.01 s / 0.03 s / 2.16 x 0.02 s / 0.03 s / 1.25 x
sklearn rf 20M lzma 6.6 MiB / 2.0 MiB / 3.27 x 10.10 s / 0.98 s / 0.10 x 0.42 s / 0.15 s / 0.37 x
sklearn rf 200M 238.8 MiB / 30.8 MiB / 7.75 x 0.14 s / 0.23 s / 1.62 x 0.20 s / 0.37 s / 1.80 x
sklearn rf 200M lzma 48.0 MiB / 14.8 MiB / 3.24 x 75.77 s / 15.22 s / 0.20 x 3.18 s / 1.14 s / 0.36 x
sklearn rf 1G 1302.2 MiB / 168.0 MiB / 7.75 x 0.83 s / 1.15 s / 1.38 x 1.24 s / 1.88 s / 1.51 x
sklearn rf 1G lzma 259.6 MiB / 99.2 MiB / 2.62 x 390.21 s / 84.59 s / 0.22 x 16.28 s / 6.86 s / 0.42 x
sklearn gb 2M 2.5 MiB / 1.1 MiB / 2.16 x 0.02 s / 0.21 s / 9.60 x 0.05 s / 0.23 s / 4.46 x
sklearn gb 2M lzma 0.6 MiB / 0.2 MiB / 3.80 x 0.79 s / 0.36 s / 0.45 x 0.07 s / 0.22 s / 3.21 x
lgbm gbdt 2M 2.6 MiB / 1.0 MiB / 2.78 x 0.06 s / 0.18 s / 2.94 x 0.01 s / 0.08 s / 9.77 x
lgbm gbdt 2M lzma 0.9 MiB / 0.5 MiB / 1.90 x 1.00 s / 0.37 s / 0.37 x 0.06 s / 0.11 s / 1.93 x
lgbm gbdt 5M 5.3 MiB / 1.9 MiB / 2.81 x 0.11 s / 0.36 s / 3.22 x 0.02 s / 0.17 s / 10.02 x
lgbm gbdt 5M lzma 1.7 MiB / 0.8 MiB / 1.96 x 2.51 s / 0.79 s / 0.31 x 0.11 s / 0.22 s / 2.05 x
lgbm gbdt 20M 22.7 MiB / 7.6 MiB / 3.00 x 0.46 s / 1.49 s / 3.28 x 0.08 s / 0.70 s / 9.29 x
lgbm gbdt 20M lzma 6.3 MiB / 3.0 MiB / 2.09 x 13.55 s / 3.63 s / 0.27 x 0.42 s / 0.89 s / 2.11 x
lgbm gbdt 100M 101.1 MiB / 33.0 MiB / 3.06 x 2.10 s / 6.72 s / 3.20 x 0.36 s / 14.20 s / 39.07 x
lgbm gbdt 100M lzma 25.6 MiB / 10.6 MiB / 2.41 x 68.44 s / 18.06 s / 0.26 x 1.74 s / 3.68 s / 2.11 x
lgbm rf 10M 10.9 MiB / 3.2 MiB / 3.46 x 0.23 s / 0.47 s / 2.03 x 0.03 s / 0.31 s / 10.72 x
lgbm rf 10M lzma 0.7 MiB / 0.4 MiB / 1.86 x 1.39 s / 0.66 s / 0.47 x 0.08 s / 0.32 s / 3.80 x

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci Changes in the CI configuration
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant