Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Skeb] Can't download; "429 Too Many Requests" #5766

Closed
MarqFJA87 opened this issue Jun 20, 2024 · 6 comments
Closed

[Skeb] Can't download; "429 Too Many Requests" #5766

MarqFJA87 opened this issue Jun 20, 2024 · 6 comments

Comments

@MarqFJA87
Copy link

MarqFJA87 commented Jun 20, 2024

Woke up to find that I can't download from Skeb anymore due to a "429 Too Many Requests" error. Here's an example log (the link is NSFW).

[gallery-dl][debug] Version 1.27.0
[gallery-dl][debug] Python 3.10.0 - Windows-10-10.0.19045-SP0
[gallery-dl][debug] requests 2.32.2 - urllib3 2.2.1
[gallery-dl][debug] Configuration Files ['%USERPROFILE%\\gallery-dl\\config.json']
[gallery-dl][debug] Starting DownloadJob for 'https://skeb.jp/@monobe_yuri/works/549'
[skeb][debug] Using SkebPostExtractor for 'https://skeb.jp/@monobe_yuri/works/549'
[skeb][debug] Loading cookies from 'C:/Users/marq_/gallery-dl/cookies.txt'
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): skeb.jp:443
[urllib3.connectionpool][debug] https://skeb.jp:443 "GET /api/users/monobe_yuri/works/549 HTTP/1.1" 429 1601
[skeb][debug] '429 ' for 'https://skeb.jp/api/users/monobe_yuri/works/549' (1/5)
[skeb][info] Waiting until 13:28:09 (429 Too Many Requests)

It just keeps on looping from then on, as when the stated time is reached, the exact same error is returned and a new time is given, repeat ad infinitum.

@mikf
Copy link
Owner

mikf commented Jun 20, 2024

The sleep-429 option introduced in 1.27.0 interferes here
and skeb itself changed how it sets the needed request_key cookie.

-o sleep-429=0 and providing the request_key cookie from your web browser might work until this is fixed.

@MarqFJA87
Copy link
Author

Tried that. Now I'm getting a slightly different error, and it just terminates afterwards.

[gallery-dl][debug] Version 1.27.0
[gallery-dl][debug] Python 3.10.0 - Windows-10-10.0.19045-SP0
[gallery-dl][debug] requests 2.32.2 - urllib3 2.2.1
[gallery-dl][debug] Configuration Files ['%USERPROFILE%\\gallery-dl\\config.json']
[gallery-dl][debug] Starting DownloadJob for 'https://skeb.jp/@monobe_yuri/works/549'
[skeb][debug] Using SkebPostExtractor for 'https://skeb.jp/@monobe_yuri/works/549'
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): skeb.jp:443
[urllib3.connectionpool][debug] https://skeb.jp:443 "GET /api/users/monobe_yuri/works/549 HTTP/1.1" 429 1601
[skeb][error] HttpError: '429 ' for 'https://skeb.jp/api/users/monobe_yuri/works/549'

@SAI13103
Copy link

SAI13103 commented Jun 20, 2024

gallery-dl.exe https://skeb.jp/@takunomi_athome/works/22 -v
[gallery-dl][debug] Version 1.27.1-dev:2024.06.12 - Executable (dev/windows_x86)
[gallery-dl][debug] Python 3.8.10 - Windows-10-10.0.18363-SP0
[gallery-dl][debug] requests 2.31.0 - urllib3 2.2.1
[gallery-dl][debug] Configuration Files ['E:\\Software\\gallery-dl\\gallery-dl.conf']
[gallery-dl][debug] Starting DownloadJob for 'https://skeb.jp/@takunomi_athome/works/22'
[skeb][debug] Using SkebPostExtractor for 'https://skeb.jp/@takunomi_athome/works/22'
[skeb][debug] Loading cookies from 'E:/Software/gallery-dl/cookies.txt'
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): skeb.jp:443
[urllib3.connectionpool][debug] https://skeb.jp:443 "GET /api/users/takunomi_athome/works/22 HTTP/1.1" 429 1601
[skeb][error] HttpError: '429 ' for 'https://skeb.jp/api/users/takunomi_athome/works/22'

mikf added a commit that referenced this issue Jun 20, 2024
Introduce '_handle_429' method to make it easier for Extractors to react
to 429 errors regardless of 'sleep-429' settings.
@mikf
Copy link
Owner

mikf commented Jun 20, 2024

Fixed in 11421cf

@mikf mikf closed this as completed Jun 20, 2024
@mikf mikf pinned this issue Jun 20, 2024
@biggestsonicfan
Copy link

Fixed my issue, thanks!

@chaimao403
Copy link

HOW TO USE SKEB,PY

@mikf mikf unpinned this issue Jul 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants