Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Tracing: use pagination for queries fetching a huge number of spans #2688

Open
guilload opened this issue Jan 20, 2023 · 0 comments
Open

Tracing: use pagination for queries fetching a huge number of spans #2688

guilload opened this issue Jan 20, 2023 · 0 comments
Labels
enhancement New feature or request tracing
Milestone
Tracing

Comments

@guilload
Copy link
Member

guilload commented Jan 20, 2023 •
edited
Loading

I have implemented streaming spans ordered by trace ID in batches of size 1,000. However, regarding memory consumption, all the spans are still held in memory because we don't have a streaming search endpoint that allows sorting by a field (yet). An alternative solution would be to use pagination.
@guilload guilload added the enhancement New feature or request label Jan 20, 2023
@guilload guilload added this to the Tracing milestone Jan 20, 2023
@guilload guilload changed the title Tracing: stream spans from leaves rather than collecting them all at once in a single vector Tracing: use pagination for queries fetching a huge number of spans Jan 27, 2023
@kalil-pelissier kalil-pelissier mentioned this issue Apr 20, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request tracing
Projects
None yet
Milestone
Tracing
Development

No branches or pull requests
1 participant
@guilload