You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
fsspec's open takes block_size (passed into _open) to instruct on the size of the block to fetch to cover a requested by open range. The default (which we resort to ATM) is 5 * 2**20 = 5M.
block_size cannot be changed for an already existing sparsely cached file.
it would depend on use case on what could be the optimal block_size to provide optimal performance
... more to come ...
The text was updated successfully, but these errors were encountered:
fsspec's
open
takesblock_size
(passed into_open
) to instruct on the size of the block to fetch to cover a requested by open range. The default (which we resort to ATM) is5 * 2**20 = 5M
.The text was updated successfully, but these errors were encountered: