Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Benchmark local PV #517

Open
wenhaocs opened this issue Jul 30, 2024 · 0 comments
Open

Benchmark local PV #517

wenhaocs opened this issue Jul 30, 2024 · 0 comments

Comments

@wenhaocs
Copy link

wenhaocs commented Jul 30, 2024

Customer finds that when using local PV, the CPU utilization is abnormally higher than using EBS.

(1) Under the local pv cluster, 20 CPU of storaged is being used which is so high for just 2K QPS. Because prod (with EBS) is using 50 CPU for 25k QPS...
(2) The queries and dataset between two clusters are exactly the same.

Here is the configuration:

Local PV cluster Prod cluster
Storaged instance type m6id.32xlarge 128cpu, 512 GiB Mem, 4 x 1900 NVMe SSD c7a.48xlarge 192cpu, 384 GiB mem, EBS Only
# instances 18 18
# partitions 120

Dataset size: 2.5 TB

When benchmarking, please focus on the CPU utilization of storaged under the same QPS. Please use reasonable dataset size, so that dataset is not too small. Below shows the I/Os during user's test and we can see there are I/Os on disk.

Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant