Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Large files performance #165

Open
maariolopezz opened this issue Nov 16, 2020 · 0 comments
Open

Large files performance #165

maariolopezz opened this issue Nov 16, 2020 · 0 comments

Comments

@maariolopezz
Copy link

I have recently been testing the reading/writing performance of Riofs and S3FS on an EC2 instance. The results I obtained show that Riofs is able read a 2GB file in 45 seconds on average and write a 2GB file in 97 seconds on average, while S3FS performs the reading in 7 seconds on average and the writing in 23 seconds. I have used the default configuration for both systems.

Any idea why this happens?

This is the test I am running to test writing performance (the rest of the tests are pretty much the same but with different input/output):

import time
import os

for x in range(10):
	os.system('rm -rf /tmp/riofs/*')
	os.system('(echo 3 | sudo tee /proc/sys/vm/drop_caches) > /dev/null')
	os.system('sudo riofs -c ~/.config/riofs/riofs.conf.xml -o direct_io mybucket /storage/riofsS3nc')
	time.sleep(3)

	tinit = time.time()
	os.system('dd if=/dev/zero of=/storage/riofsS3nc/riofs/tesFileLarge bs=1MB count=2000 oflag=nocache iflag=nocache status=none')
	lapse =  time.time() - tinit

	print("riofs: " + str(lapse))

	os.system('fusermount -u /storage/riofsS3nc/')
	time.sleep(2)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant