Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

meta/redis: fix loading large directory into Redis #1858

Merged
merged 1 commit into from
Apr 21, 2022
Merged

meta/redis: fix loading large directory into Redis #1858

merged 1 commit into from
Apr 21, 2022

Conversation

davies
Copy link
Contributor

@davies davies commented Apr 21, 2022

If there is a big directory or big file, the pipeline could be too big for Redis to process, we should split them into smaller batches.

@davies davies requested a review from zhijian-pro April 21, 2022 08:00
@davies davies changed the title fix loading large directory into Redis meta/redis: fix loading large directory into Redis Apr 21, 2022
@davies davies merged commit ec33353 into main Apr 21, 2022
@davies davies deleted the load_redis branch April 21, 2022 09:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants