Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Amazon scraper: Pull page numbers if available #95

Closed
alykat opened this issue Nov 16, 2021 · 3 comments
Closed

Amazon scraper: Pull page numbers if available #95

alykat opened this issue Nov 16, 2021 · 3 comments

Comments

@alykat
Copy link
Member

alykat commented Nov 16, 2021

Useful for the books team to identify entries that would be tagged "rather long" or "rather short"

@alykat
Copy link
Member Author

alykat commented Nov 3, 2023

Beth reiterated her interest in such a feature. I briefly looked into the amazon scraper code, and it looks like what we're saving out to the CSV is everything that's offered in the search return. Would need to take more time to figure out how to query additional metadata, if that's offered in this API.

@thomaswilburn
Copy link
Contributor

I think this is actually available in the API: https://webservices.amazon.com/paapi5/documentation/item-info.html#contentinfo

If you look at the bottom of tasks/lib/amazon-product.js, you'll find the keys being extracted, and can add this.

@alykat
Copy link
Member Author

alykat commented Nov 5, 2023

Ahhh! I totally missed the second script in the lib folder. This did the trick. Thank you so much!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants