Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add possibility to execute multiple slice queries together to KeyColumnValueStore #3824

Closed
porunov opened this issue Jun 14, 2023 · 0 comments · Fixed by #3825
Closed

Add possibility to execute multiple slice queries together to KeyColumnValueStore #3824

porunov opened this issue Jun 14, 2023 · 0 comments · Fixed by #3825

Comments

@porunov
Copy link
Member

porunov commented Jun 14, 2023

Discussion #3823

This issue is to add possibility to execute multiple slice queries to the storage providers only via a single call instead of multiple calls. This doesn't dictate how exactly those queries should be executed (i.e. sequentially / in parallel / grouped / asynchronously
/ etc), but just gives storage providers a possibility to execute those queries as fast as possible.
By doing so, storage providers will be able to fetch properties in parallel instead of doing so sequentially for multi-queries.

This issue will also unlock a possibility to complete #3816

@porunov porunov added this to the Release v1.0.0 milestone Jun 14, 2023
@porunov porunov self-assigned this Jun 14, 2023
porunov added a commit to porunov/janusgraph that referenced this issue Jun 14, 2023
…mnValueStore

- Adds possibility to execute groups of same key sets slice queries together
- Implement parallel execution of all provided Slice queries to CQL storage backend
- Adds a basic implementation (i.e. current non-optimized implementation) to any other storage backend which doesn't have optimized implementation right now

Fixes JanusGraph#3824
Related to JanusGraph#3816

Signed-off-by: Oleksandr Porunov <[email protected]>
porunov added a commit to porunov/janusgraph that referenced this issue Jun 15, 2023
…mnValueStore

- Adds possibility to execute groups of same key sets slice queries together
- Implement parallel execution of all provided Slice queries to CQL storage backend
- Adds a basic implementation (i.e. current non-optimized implementation) to any other storage backend which doesn't have optimized implementation right now

Fixes JanusGraph#3824
Related to JanusGraph#3816

Signed-off-by: Oleksandr Porunov <[email protected]>
porunov added a commit to porunov/janusgraph that referenced this issue Jun 15, 2023
…mnValueStore [cql-tests] [tp-tests]

- Adds possibility to execute groups of same key sets slice queries together
- Implement parallel execution of all provided Slice queries to CQL storage backend
- Adds a basic implementation (i.e. current non-optimized implementation) to any other storage backend which doesn't have optimized implementation right now

Fixes JanusGraph#3824
Related to JanusGraph#3816

Signed-off-by: Oleksandr Porunov <[email protected]>
@porunov porunov moved this to In Progress in MultiQuery optimization revamp Jun 15, 2023
porunov added a commit to porunov/janusgraph that referenced this issue Jun 16, 2023
…mnValueStore [cql-tests] [tp-tests]

- Adds possibility to execute groups of same key sets slice queries together
- Implement parallel execution of all provided Slice queries to CQL storage backend
- Adds a basic implementation (i.e. current non-optimized implementation) to any other storage backend which doesn't have optimized implementation right now

Fixes JanusGraph#3824
Related to JanusGraph#3816

Signed-off-by: Oleksandr Porunov <[email protected]>
porunov added a commit to porunov/janusgraph that referenced this issue Jun 16, 2023
…mnValueStore [cql-tests] [tp-tests]

- Adds possibility to execute groups of same key sets slice queries together
- Implement parallel execution of all provided Slice queries to CQL storage backend
- Adds a basic implementation (i.e. current non-optimized implementation) to any other storage backend which doesn't have optimized implementation right now
- Adds queries grouping algorithm (`MultiSliceQueriesGroupingUtil`) required for JanusGraph#3816

Fixes JanusGraph#3824
Related to JanusGraph#3816

Signed-off-by: Oleksandr Porunov <[email protected]>
porunov added a commit to porunov/janusgraph that referenced this issue Jun 17, 2023
…mnValueStore [cql-tests] [tp-tests]

- Adds possibility to execute groups of same key sets slice queries together
- Implement parallel execution of all provided Slice queries to CQL storage backend
- Adds a basic implementation (i.e. current non-optimized implementation) to any other storage backend which doesn't have optimized implementation right now
- Adds queries grouping algorithm (`MultiSliceQueriesGroupingUtil`) required for JanusGraph#3816

Fixes JanusGraph#3824
Related to JanusGraph#3816

Signed-off-by: Oleksandr Porunov <[email protected]>
porunov added a commit to porunov/janusgraph that referenced this issue Jun 17, 2023
…mnValueStore [cql-tests] [tp-tests]

- Adds possibility to execute groups of same key sets slice queries together
- Implement parallel execution of all provided Slice queries to CQL storage backend
- Adds a basic implementation (i.e. current non-optimized implementation) to any other storage backend which doesn't have optimized implementation right now
- Adds queries grouping algorithm (`MultiSliceQueriesGroupingUtil`) (required for JanusGraph#3816 and also mimimizes keys duplicate collections creation)

Fixes JanusGraph#3824
Related to JanusGraph#3816

Signed-off-by: Oleksandr Porunov <[email protected]>
porunov added a commit to porunov/janusgraph that referenced this issue Jun 17, 2023
…mnValueStore [cql-tests] [tp-tests]

- Adds possibility to execute groups of same key sets slice queries together
- Implement parallel execution of all provided Slice queries to CQL storage backend
- Adds a basic implementation (i.e. current non-optimized implementation) to any other storage backend which doesn't have optimized implementation right now
- Adds queries grouping algorithm (`MultiSliceQueriesGroupingUtil`) (required for JanusGraph#3816 and also mimimizes keys duplicate collections creation)

Fixes JanusGraph#3824
Related to JanusGraph#3816

Signed-off-by: Oleksandr Porunov <[email protected]>
porunov added a commit to porunov/janusgraph that referenced this issue Jun 21, 2023
…mnValueStore [cql-tests] [tp-tests]

- Adds possibility to execute groups of same key sets slice queries together
- Implement parallel execution of all provided Slice queries to CQL storage backend
- Adds a basic implementation (i.e. current non-optimized implementation) to any other storage backend which doesn't have optimized implementation right now
- Adds queries grouping algorithm (`MultiSliceQueriesGroupingUtil`) (required for JanusGraph#3816 and also mimimizes keys duplicate collections creation)

Fixes JanusGraph#3824
Related to JanusGraph#3816

Signed-off-by: Oleksandr Porunov <[email protected]>
porunov added a commit to porunov/janusgraph that referenced this issue Jun 22, 2023
…mnValueStore [cql-tests] [tp-tests]

- Adds possibility to execute groups of same key sets slice queries together
- Implement parallel execution of all provided Slice queries to CQL storage backend
- Adds a basic implementation (i.e. current non-optimized implementation) to any other storage backend which doesn't have optimized implementation right now
- Adds queries grouping algorithm (`MultiSliceQueriesGroupingUtil`) (required for JanusGraph#3816 and also mimimizes keys duplicate collections creation)

Fixes JanusGraph#3824
Related to JanusGraph#3816

Signed-off-by: Oleksandr Porunov <[email protected]>
porunov added a commit to porunov/janusgraph that referenced this issue Jun 22, 2023
…mnValueStore [cql-tests] [tp-tests]

- Adds possibility to execute groups of same key sets slice queries together
- Implement parallel execution of all provided Slice queries to CQL storage backend
- Adds a basic implementation (i.e. current non-optimized implementation) to any other storage backend which doesn't have optimized implementation right now
- Adds queries grouping algorithm (`MultiSliceQueriesGroupingUtil`) (required for JanusGraph#3816 and also mimimizes keys duplicate collections creation)

Fixes JanusGraph#3824
Related to JanusGraph#3816

Signed-off-by: Oleksandr Porunov <[email protected]>
@github-project-automation github-project-automation bot moved this from In Progress to Done in MultiQuery optimization revamp Jun 22, 2023
porunov added a commit that referenced this issue Jun 22, 2023
…mnValueStore [cql-tests] [tp-tests]

- Adds possibility to execute groups of same key sets slice queries together
- Implement parallel execution of all provided Slice queries to CQL storage backend
- Adds a basic implementation (i.e. current non-optimized implementation) to any other storage backend which doesn't have optimized implementation right now
- Adds queries grouping algorithm (`MultiSliceQueriesGroupingUtil`) (required for #3816 and also mimimizes keys duplicate collections creation)

Fixes #3824
Related to #3816

Signed-off-by: Oleksandr Porunov <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment