-
-
Notifications
You must be signed in to change notification settings - Fork 29
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
gcs_list_objects seems limited to return 1000 rows max #58
Comments
@G3rtjan thanks, thats a bug. I'll look to add paging ASAP |
@MarkEdmondson1234 I've created a workaround for myself for the time being and in doing so I found out that:
I hope this helps :) |
Thanks @G3rtjan , I will handle it in a very similar manner to what you outline above. |
@G3rtjan I have published a fix for this, if you have time please test it let me know if it works as expected. |
Ok it works, but if you have a lot of objects it takes ages. Going to add a limit to it |
No limit as the order it comes out is random so doesn't make much sense, but use the new |
Calling gcs_list_objects() on my Google Cloud bucket returns exactly 1000 rows, even after adding some additional files just to make sure that here is more in there than a 1000 files.
Maybe the maxResults parameter in one of the API calls you use can be used:
https://cloud.google.com/storage/docs/json_api/v1/objects/list
Perhaps this could be implemented as a parameter in the function :)
The text was updated successfully, but these errors were encountered: