Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add segment writer client #3505

Merged
merged 36 commits into from
Aug 27, 2024
Merged

Conversation

kolesnikovae
Copy link
Collaborator

@kolesnikovae kolesnikovae commented Aug 20, 2024

Depends on #3506
Closes: #199, #185 (private)

The change introduces the segment writer client and the write-path router components. A basic distribution algorithm based on jump consistent hashing was also implemented: dynamic sizing is to be implemented later.

Note that this also moves pprof-split out of the distributor – to be implemented in the segment writer in a follow-up PR.

@kolesnikovae kolesnikovae force-pushed the feat/distributor-segment-writer branch from 7ea333f to 46e54a3 Compare August 25, 2024 09:20
@kolesnikovae kolesnikovae force-pushed the feat/distributor-segment-writer branch from f7788f5 to 60ad16e Compare August 25, 2024 10:50
@kolesnikovae kolesnikovae force-pushed the feat/distributor-segment-writer branch from f9c119d to 3efb5c0 Compare August 26, 2024 11:21
@kolesnikovae kolesnikovae force-pushed the feat/distributor-segment-writer branch from 3efb5c0 to a16dafb Compare August 26, 2024 11:55
@kolesnikovae kolesnikovae changed the title WIP: feat: add segment writer client feat: add segment writer client Aug 26, 2024
@kolesnikovae kolesnikovae marked this pull request as ready for review August 26, 2024 12:08
@kolesnikovae kolesnikovae requested review from a team as code owners August 26, 2024 12:08
# Conflicts:
#	pkg/experiment/ingester/service.go
#	pkg/phlare/modules_experimental.go
@korniltsev korniltsev self-requested a review August 27, 2024 10:49
Copy link
Collaborator

@korniltsev korniltsev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I love have the routing is separated from the distributor

pkg/util/circuitbreaker/cirquit_breaker.go Outdated Show resolved Hide resolved
@korniltsev
Copy link
Collaborator

and sorry for merge conflicts 🤷

@kolesnikovae kolesnikovae merged commit b190683 into main Aug 27, 2024
18 checks passed
@kolesnikovae kolesnikovae deleted the feat/distributor-segment-writer branch August 27, 2024 11:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants