Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Split membership sync endpoints #2773

Merged
merged 9 commits into from
Nov 25, 2018

Conversation

manishrjain
Copy link
Contributor

@manishrjain manishrjain commented Nov 25, 2018

This change is Reviewable

@manishrjain manishrjain merged commit 60bbf0a into master Nov 25, 2018
@manishrjain manishrjain deleted the mrjn/split-membership-endpoints branch November 25, 2018 02:58
dna2github pushed a commit to dna2fork/dgraph that referenced this pull request Jul 19, 2019
…o#2773)

- Now that Zero followers cannot send proposals to leader, Alphas must send their membership updates
  to the Zero leader.
- The membership updates can be received from any Zero server, leader or follower.
- So, this PR splits the job of sending and receiving updates into two different endpoints:
  StreamMembership and UpdateMembership.

- Purge Timestamps are now calculated using the Snapshot timestamp of the group. This is simpler,
  easier to predict and makes this system run like clockwork. That is, a snapshot calculation in
  Alpha leader would cause all Alpha followers to get that snapshot, which would then cause Zero to
  purge the timestamps below that snapshot ts (assuming other groups have caught up).
- This removes the need for Zero to query all Alpha leaders, via PurgeTs endpoint. That is now
  removed.

- Removed a lot of error variables, switching them with explanatory errors about what is going on in
  the system, making things easier to debug.

Commits:

* Working membership endpoint split.
* Removed PurgeTs endpoint. Passing snapshot ts during membership update, so Zero can use that information to purge Oracle.
* Block on Tablet call until we find a Zero leader.
* More debugging via traces.
* Simplify connToZeroLeader. Try to not add new bugs.
* Update blockade test with restart option.
* Self Reviews.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

2 participants