-
Notifications
You must be signed in to change notification settings - Fork 3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Load catalogs concurrently #15295
Load catalogs concurrently #15295
Conversation
Not sure whether we need release notes since it's an experimental feature ( cc @colebow |
core/trino-main/src/main/java/io/trino/connector/CoordinatorDynamicCatalogManager.java
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM.
I am not 100% sure but I recall there was a discussion if parallel startup would not make it harder to debug startup issues. @kokosing ?
When plugin concurrent loading was added (c5ac103), the catalogs could not be loaded concurrently easily, because `ConnectorManager.createCatalog` was synchronized. The code has evolved since then, reducing contention significantly and thus allowing for parallel startup.
c9722ca
to
92b128c
Compare
@findepi How could I delete a Catalog in CoordinatorDynamicCatalogManager.java |
i don't know, and it doesn't seem related to this PR |
When plugin concurrent loading was added
(c5ac103), the catalogs could be loaded concurrently easily, because
ConnectorManager.createCatalog
was synchronized. The code has evolved since then, reducing contention significantly and thus allowing for parallel startup.Fixes #15234
Follows #9521