Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Has iOS support and what model is supported? #22

Open
paulocoutinhox opened this issue Nov 12, 2023 · 1 comment
Open

Has iOS support and what model is supported? #22

paulocoutinhox opened this issue Nov 12, 2023 · 1 comment

Comments

@paulocoutinhox
Copy link

Hi,

First, nice project.

  1. It has iOS/Android support?
  2. What i need to run in iOS?
  3. And what models are supported?
  4. Can i use safetensors or ckpt models?

Thanks.

@axodox
Copy link
Owner

axodox commented Nov 21, 2023

  1. Not yet, admittedly speed and/or resolution would be limited on a mobile chip, or would take quite long to generate an image.
  2. Would require some work, but should not be very substantial as the base code is written in a platform agnostic way. You would need to configure the sessions to use an IOS compatible execution provider, and port a little code (e.g. mainly image loading, saving) to the OS.
  3. Currently SD 1.5 works with all basic features (txt2img, img2img, inpainting) and controlnet. SD XL support is in progress on the sdxl branch, basic image generation works, but quality is not perfect yet. I do not think you will run SDXL on a phone though, it is quite heavy for that.
  4. The lib uses ONNX models. However I wrote a guide for conversion: https://github.com/axodox/unpaint/wiki/Model-import. The upcoming version of the ONNX converter respects the weight tensor names, so with that it will be possible to load model weights from safetensors and other formats.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants