Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Submit requests for sites to support here. #502

Closed
metaprime opened this issue Apr 6, 2017 · 60 comments
Closed

Submit requests for sites to support here. #502

metaprime opened this issue Apr 6, 2017 · 60 comments

Comments

@metaprime
Copy link
Collaborator

metaprime commented Apr 6, 2017

Moved to RipMeApp/ripme#38

Assume all links are NSFW (unless marked SFW).

Commenters: Please mark your NSFW links anyway.

Please open a new issue if you're reporting a problem in the ripper for a site we already support. This issue is to request support for new sites.

PLEASE include an example URL of the type of album to rip.

This issue replaces #8 which had gotten too huge to load or peruse in a reasonable amount of time.
This will give an opportunity to actually look at the older requests without new requests coming in to make that more difficult, and will help to see the more modern requests.

#510 will track received requests and aggregate links to the work in progress on each request.

Already-supported sites: https://github.com/ripmeapp/ripme/wiki/Supported-Sites

@Cottoneyes
Copy link

https://purpleport.com/ has models and photographers with images, see: https://purpleport.com/portfolio/bluethealienteafairy/

@IT6uru
Copy link

IT6uru commented Apr 6, 2017

VSCO

@Wiiplay123
Copy link
Contributor

Deviantart, because support is currently broken. :(

@metaprime
Copy link
Collaborator Author

metaprime commented Apr 8, 2017

@IT6uru please provide example links?
Also it might not be possible to support. #8 (comment)

@Wiiplay123 DA issues are being tracked. Limited dev-hours. Please feel free to contribute!

@Marquis-deCarabas
Copy link

Two suggestions: https://en.zenfolio.com and https://www.smugmug.com/

@Hrxn
Copy link

Hrxn commented Apr 13, 2017

Two suggestions: https://en.zenfolio.com and https://www.smugmug.com/

Good idea. Seconded.

@MrBiggz007
Copy link

Can you please add support back for OneClickChicks? Thanks for taking this project over and continuing it!

@cyian-1756
Copy link
Contributor

@MrBiggz007 Please provide example links

@gdude2002
Copy link

I see that DeviantArt albums are supported, but what about DeviantArt favourites galleries?

@MrBiggz007
Copy link

MrBiggz007 commented Apr 24, 2017 via email

@MrBiggz007
Copy link

MrBiggz007 commented Apr 25, 2017 via email

@metaprime
Copy link
Collaborator Author

@MrBiggz007

www.tumblr.com/liked/by/X/

Please provide a working example link. Every user I tried this for gives me a permission denied message.

@MrBiggz007
Copy link

MrBiggz007 commented Apr 25, 2017 via email

@itscoldoutside
Copy link

Certain types of Eroshare links don't work ex. https://eroshare.com/14ld5ka2?
Get error "eroshare album not found in https://eroshare.com/14ld5ka2?, expected https://eroshare.com/album"

@jamedom
Copy link

jamedom commented May 17, 2017

could you add some more website such as http://www.porncomix.info . Thank you

@metaprime
Copy link
Collaborator Author

@metaprime
Copy link
Collaborator Author

Another example with multiple pages: https://rule34.xxx/index.php?page=post&s=list&tags=69

@ryanliang88
Copy link

Absolutely love you guys for this application! This is going to change my life. I'm a new computer science student too.

Requesting https://www.pixiv.net/ to be supported.

Sample links:
https://www.pixiv.net/member.php?id=6996493 (Illustrator)
https://www.pixiv.net/member_illust.php?id=6996493 (All of an illustrator's illustrations)
https://www.pixiv.net/member_illust.php?mode=medium&illust_id=63069362 (An illustration which may or may not include just one image or a set of images or a gif/dunno image formats)
https://www.pixiv.net/member_illust.php?mode=manga&illust_id=63069362 (An illustration or a set of illustrations)

Able to provide additional support if necessary. Would love to learn how you did this.

@metaprime
Copy link
Collaborator Author

@Ryalia888 Always happy to have more help! If you want to get started, it's best to just dive right in. Very little knowledge is necessary to get started. You can start by reading https://github.com/4pr0n/ripme/wiki/How-To-Create-A-Ripper-for-HTML-websites -- however, probably the easiest thing to do is to copy the source code from an existing Ripper that seems simple-to-understand, start a new file, and replace the code specific to the site with the code to rip from another site. You basically just need to follow the pattern already there, and use CSS-style queries to get the elements from the web page. It's sort of like a treasure hunt through the HTML to find the image URLs. There are a lot of suggestions of easy-to-implement sites on this issue and issue #8.

Let us know if you need help while implementing. Issue #510 (or a new issue you create, specific to the ripper you're working on) is a better place for that kind of discussion. You can use the Gitter chat to discuss with RipMe developers: https://gitter.im/4pr0n-ripme/Lobby.

@Flip32
Copy link

Flip32 commented Jun 7, 2017

Hi, It seems Imagebam it's not working! And when does, the pics come smaller.
Can you help me?

ex.: http://www.imagebam.com/gallery/72c5utvqv44wcqnkc9vzapm5yck8j1cr

@Flip32
Copy link

Flip32 commented Jun 7, 2017

Please support for http://apina.nwps.ws

sample: http://apina.nwps.ws/realgirls/madisondeckk/

@Flip32
Copy link

Flip32 commented Jun 10, 2017

Please support for http://imgbox.com/

sample: http://imgbox.com/g/9rHTTaEOjd

It works, but not with the original size

@cyian-1756
Copy link
Contributor

Shimmie based sites like https://rule34.paheal.net/

Can you provide an example album?

Dutchbear (http://www.dutchbear.com) and its streaming site AEBN

Again example album/video please

xHamster VIDEOS

You can use youtube-dl to download from xHamster (At least to hold you over while video support is added to ripme)

Always try to use HTTPS over HTTP

We do, however sometimes due to poorly configured servers we have to use http (Like with xHamster)

as some countries block HTTP connections to certain sites (especially in South Korea)

Whats to stop those countries from just block https as well?

Pause ripping when disk space is getting critically low (leaving only few hundred megabytes for recycling bin)

I imagine that would be a pain to implement in any cross platform manner

@rautamiekka
Copy link

rautamiekka commented Jul 29, 2017

^

I imagine that would be a pain to implement in any cross platform manner

On the contrary: https://stackoverflow.com/a/7816211/460695

Found that by java available disk space. It says how Java 1.7 (I think that means Java SE 7; Java always used 2 different version numbers for the same thing, as evident from Wikipedia article) changed it from 1.6, and another answer shows it was added in 1.6 since the implementation is platform-specific.

Could've changed in 1.8 (SE 8) as well, but I didn't check any further.

@UnforeseenOcean
Copy link

UnforeseenOcean commented Jul 29, 2017

^^

  1. Examples for Rule34?
    Try https://rule34.paheal.net/post/list/Baradok/1

  2. Examples for Dutchbear?
    Unfortunately it works a little bit different from other sites (it's more like a collection of images and not quite a make-a-profile-and-upload-stuff-there business), and AEBN is blocked here so I can't provide examples for the latter one. However, I can provide a page link, like this one: http://pictures.dutchbear.com/feature/realmen/real4/realmen34.html

  3. Use youtube-dl for xHamster duty
    Sure, I will check. I needed a freeware solution to the one I used previously, anyway.

  4. It depends on the case
    Understood.

  5. Why are they not blocking HTTPS in the first place?
    I dunno, but it's pretty stupid anyway.

  6. Disk use alarm is kind of tough thing to deal with, when taking multi-platform into consideration
    There indeed is a way to do so without breaking compatibility with Linux and OSX (as shown by rautamiekka), but then they will not be compatible with older versions of Java.

@rautamiekka
Copy link

^ There are no reasons to use so old Java anyway; 1.6 == SE 6, 1.7 == SE 7, and so on. If any, such are something like 1 in a billion, to put into a perspective.

@cyian-1756
Copy link
Contributor

On the contrary: https://stackoverflow.com/a/7816211/460695

Neat. If we do implement it it should be a option tho. Scanning / on some set ups (NASs come to mind) will take a great deal of time/cause all discs to spin up

@cyian-1756
Copy link
Contributor

@UnforeseenOcean It seems that https://rule34.paheal.net/ is already supported, did you mean generic support for sites that use the same software? If so can link me to that software source/other sites that use it?

@UnforeseenOcean
Copy link

UnforeseenOcean commented Jul 30, 2017

@cyian-1756 Yes. Looks like Danbooru style pages use some sort of forked source of Shimmie. I don't know a lot about sites utilizing such library, but I think most of them work in the same way.

@cyian-1756
Copy link
Contributor

@UnforeseenOcean I'll get on adding generic support for Shimmie

@tjlsmith
Copy link

Hi. This site http://www.aerisdies.com has a remarkable selection of Doujin... Like this http://www.aerisdies.com/html/lb/douj_s369.html

Thank you for this dream piece of software.

@cyian-1756
Copy link
Contributor

@tjlsmith I added support for http://www.aerisdies.com in my latest commit, it should be ripme in the next update or so

@rautamiekka
Copy link

rautamiekka commented Aug 11, 2017

@gdude2002 DeviantArt support is mostly perfect: you can rip

  1. specific folders from both the gallery and favs (it can't distinguish between them. Example=http://rautamiekka.deviantart.com/gallery/61237849/Finnish-works-by-me)
  2. the 'Featured' section from both gallery and favs (example=http://rautamiekka.deviantart.com/gallery/)
  3. 'All' link from both gallery and favs to get everything (examples=http://rautamiekka.deviantart.com/gallery/?catpath=/), but that way you won't get them in their folders
  4. scraps

What doesn't work at the time of writing this:

  1. avatar fetching (always fails with an incorrect path): During gallery/folder ripping the DeviantArt avatar fetching fails with 404 due to an old hardcoded address #577
  2. recursive ripping, meaning auto-walking folders as they come, putting stuff in the folders as they appear: [DeviantArt] Add support for recursive ripping #550
  3. the favs folder address parsing has an unreported bug I found that shows up only in specific cases. Long story short, the full folder name as given by DA is mandatory.

@rautamiekka
Copy link

rautamiekka commented Aug 11, 2017

http://philosophyfetish.deviantart.com/favourites/ ripped perfectly with DA's expectable delay, same as any other place (assuming the User haven't deactivated or been banned).

Window$ 7 Ultimate SP1 x64, Oracle Java SE 8 Update 144 x64, RipMe 1.5.2.

@gdude2002
Copy link

That's excellent, thanks for letting me know @rautamiekka

@tim712
Copy link

tim712 commented Aug 14, 2017

Hello,
Can you add support for book.fr
https://lolajrenault.book.fr

thanks

@Michael9450
Copy link

Could there be support for http://hgamecg.com/ . If anyone can do this that would be great but thanks anyway.

@wankio
Copy link

wankio commented Aug 25, 2017

Site Suggestion: http://www.bobx.com/ (NSFW)
http://www.bobx.com/dark/ | http://www.bobx.com/av-idol/index_all_pictures.html | v.v..etc...
all will end up with http://www.bobx.com/av-idol/[name]

Example: http://www.bobx.com/av-idol/ruru-anoa/

Each av-idol have photosets :
Example : http://www.bobx.com/av-idol/ruru-anoa/photoset/graphis-gals-_194---exclaiming-0-2-8.html

Photos link : http://www.bobx.com/av-idol/ruru-anoa/large-ruru-anoa-471704/
DDL when clicked on HI-RES (if available) : http://www.bobx.com/av-idol/ruru-anoa/large-ruru-anoa-471704/ -> http://www.bobx.com/av-idol/ruru-anoa/ruru-anoa-00471704.jpg

What i want is download all images from photoset link and rename to <title>
Example : Ruru Anoa in Graphis Gals #194 - Exclaiming - @0 of 96

Thank

@RahulJanagouda
Copy link

Pinterest?? anyone

@tjlsmith
Copy link

tjlsmith commented Oct 27, 2017

https://voat.co/v/FarmGirls (nsfw)

voat.co in general, really - it should be like Reddit...

@lucasporlier
Copy link

On the SFW side, commons.wikimedia.org, with metadata options if doable

@metaprime
Copy link
Collaborator Author

@tjlsmith about Voat.co: I wonder if there's actually any difference between that site and Reddit. It might be using Reddit's front-end code (as of some point in the past), in which case, our Reddit ripper may already support it, or a slightly modified version of it would do the job.

@metaprime
Copy link
Collaborator Author

metaprime commented Nov 13, 2017

@wankio www.bobx.com/dark is great (however I feel like it's a sponsored front for osakagirls, a paid site that all the ads and links on bobx tend to redirect to) -- bobx.com is actually how I found my first content download accelerator (DownThemAll Firefox add-on), and then promptly got IP banned for "spidering" aka making too many requests too quickly. Since I've got experience with that one I'll probably make the ripper, but we'll have to be careful to make the delay long enough to avoid getting users banned -- probably start really conservatively long and go from there.

@metaprime
Copy link
Collaborator Author

metaprime commented Nov 14, 2017

Requests issue moved to the new repo:

RipMeApp/ripme#38

@OwlDragon
Copy link

Please could yo add pixiv.net support

@DipayanDey
Copy link

http://demo.modelnet.club/

Studio Manager area:
http://demo.modelnet.club/exec/manager/
Login: admin
Password: admin

Performers area:
http://demo.modelnet.club/exec/performer/index.jsp
Login: model
Password: model

Client area:
http://demo.modelnet.club/exec/

other site is with same features
http://demo.online-webcam.net/

@DJboutit
Copy link

DJboutit commented Jul 8, 2022

Please add https://coomer.party/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests