Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Request] skeb.jp #1031

Closed
indrakaw opened this issue Sep 25, 2020 · 9 comments
Closed

[Request] skeb.jp #1031

indrakaw opened this issue Sep 25, 2020 · 9 comments

Comments

@indrakaw
Copy link

No description provided.

mikf pushed a commit that referenced this issue Oct 26, 2021
* Create skeb.py

* Update __init__.py

* Update supportedsites.py

* Update supportedsites.md

* Update supportedsites.py

* Update skeb.py
@biggestsonicfan
Copy link

biggestsonicfan commented Apr 4, 2022

I realize for the most part skeb.jp is supported, but last night I ran into a user that has a portfolio but no works and I could not download from the portfolio. They have since (between last night and now) added one work. https://skeb.jp/@hataraku73

EDIT: Also for your consideration Google seems to crawl non-watermarked images somehow...

@nisehime
Copy link

nisehime commented Jun 23, 2022

EDIT: Also for your consideration Google seems to crawl non-watermarked images somehow...

That's interesting @mikf
You can compare this two URLs:
From google: link
From skeb page: link

Basically, the one from google have different http parameters, but if you try to modify them by yourself you will get 403 error, so it doesn't seem to help much. The response to the modified parameters seems to be tied to the s= parameter (md5?), which is somehow generated for those set of parameters. I don't know but what if the algorithm for it is in the page script lol?

Anyway, the sample-less link from google is actually in the page's source code, so there's no some special privileges for google. I guess it might be considered as an option to download, however there's 2 issues:

  1. The sample-less image has smaller resolution.
  2. The sample-less image does not always exists in the page's source.

@mikf
Copy link
Owner

mikf commented Jul 8, 2022

seems to be tied to the s= parameter (md5?)

The hex-digest length fits, but they are most likely applying some not easy to guess transformation to URL or query string before MD5-ing it.

  1. The sample-less image has smaller resolution.
  2. The sample-less image does not always exists in the page's source.

and 3. the sample-less images got generated with a terrible JPEG compression value: &q=45

@nisehime
Copy link

nisehime commented Jul 8, 2022

  1. the sample-less images got generated with a terrible JPEG compression value: &q=45

I wouldn't really call it terrible tbh. Some people still might prefer it over the text covering half of the image.

@NeroTheYoung
Copy link

EDIT: Also for your consideration Google seems to crawl non-watermarked images somehow...

That's interesting @mikf You can compare this two URLs: From google: link From skeb page: link

Basically, the one from google have different http parameters, but if you try to modify them by yourself you will get 403 error, so it doesn't seem to help much. The response to the modified parameters seems to be tied to the s= parameter (md5?), which is somehow generated for those set of parameters. I don't know but what if the algorithm for it is in the page script lol?

Anyway, the sample-less link from google is actually in the page's source code, so there's no some special privileges for google. I guess it might be considered as an option to download, however there's 2 issues:

  1. The sample-less image has smaller resolution.
  2. The sample-less image does not always exists in the page's source.

How did you get the sample-less url from google?

@biggestsonicfan
Copy link

@NeroTheYoung I reverse image searched the image on Google, but the Google url doesn't appear to be valid anymore.

@biggestsonicfan
Copy link

Just an FYI: https://twitter.com/skeb_jp/status/1606106596764852225

🚨Attention🚨
Using extensions that scrape or increase access to Skeb is a violation of our terms and policies.

@rautamiekka
Copy link
Contributor

Just an FYI: https://twitter.com/skeb_jp/status/1606106596764852225

🚨Attention🚨
Using extensions that scrape or increase access to Skeb is a violation of our terms and policies.

What else is new ? I mean, you must expect scrapers/downloaders not being allowed, so this is nothing unexpected nor new.

@biggestsonicfan
Copy link

I understand, but this is the first official statement I've seen of it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

6 participants