Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(restore-test): Use separate map directory for each group in offline restore #8047

Merged
merged 1 commit into from
Sep 22, 2021

Conversation

ahsanbarkati
Copy link
Contributor

@ahsanbarkati ahsanbarkati commented Sep 21, 2021

Offline restore was using the same map directory for all the groups. This causes the same map files to get reduced in multiple groups.


This change is Reviewable

Copy link
Contributor

@danielmai danielmai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed 3 of 3 files at r1, all commit messages.
Reviewable status: all files reviewed, 1 unresolved discussion (waiting on @ahsanbarkati and @manishrjain)


dgraph/cmd/debug/run.go, line 883 at r1 (raw file):

		WithBlockCacheSize(1 << 30).
		WithIndexCacheSize(1 << 30).
		WithExternalMagic(opt.magic).

Is setting the ExternalMagic option needed in the debug tool now? This is just reading whatever the existing magic version is on disk, righT?

@ahsanbarkati
Copy link
Contributor Author


dgraph/cmd/debug/run.go, line 883 at r1 (raw file):

Previously, danielmai (Daniel Mai) wrote…

Is setting the ExternalMagic option needed in the debug tool now? This is just reading whatever the existing magic version is on disk, righT?

Yeah. It is used for verification purposes only.

@ahsanbarkati ahsanbarkati merged commit ccca737 into master Sep 22, 2021
@ahsanbarkati ahsanbarkati deleted the ahsan/restore-text-fix branch September 22, 2021 11:36
ahsanbarkati added a commit that referenced this pull request Sep 23, 2021
…r each group (#8047)

Fix offline restore by making offline restore use a separate map directory for all the groups.

(cherry picked from commit ccca737)
ahsanbarkati added a commit that referenced this pull request Sep 23, 2021
…r each group (#8047) (#8051)

Fix offline restore by making offline restore use a separate map directory for all the groups.

(cherry picked from commit ccca737)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

2 participants