Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update TrinoFileSystemCache to represent latest hadoop implementation #13243

Merged
merged 2 commits into from
Jan 24, 2023
Merged

Update TrinoFileSystemCache to represent latest hadoop implementation #13243

merged 2 commits into from
Jan 24, 2023

Commits on Jan 17, 2023

  1. Update TrinoFileSystemCache to represent latest hadoop implementation 

     - Use ConcurrentHashMap to cache filesystem objects - improves
   concurrency by removing synchronized blocks
 - Filesystem object is created outside cache's lock - similar to latest
   hadoop fs cache impl, further reducing code in critical section.
   Helps with systems where filesystem creation is expensive.
 - Only one thread exclusively creates the filesystem object for a
   given key. Avoids speculative creation and then later discarding of
   filesystem objects compared to hadoop fs cache impl.
    @jitheshtr
    jitheshtr committed Jan 17, 2023
    Configuration menu
    Copy the full SHA
    1ef82f2 View commit details
    Browse the repository at this point in the history

  2. Add BenchmarkGetFileSystem to benchmark TrinoFileSytemCache

    @jitheshtr
    jitheshtr committed Jan 17, 2023
    Configuration menu
    Copy the full SHA
    f7f8460 View commit details
    Browse the repository at this point in the history