Skip to content

nagolinc/StableCraft

Repository files navigation

StableCraft

Currently this is just a VR viewer for StableDiffusion outputs, but I'm planning to make it into a fully fledged RPG maker

When in VR, press "A" button on your controller to record audio.

  1. this is convered using OpenAI's whisper into a text prompt
  2. this text prompt is rendered using StableDiffusion
  3. a depth map is generated using DPT
  4. and that is all rendered back for you in VR

To run, you need to start the server: flask_app.py and then go to the page /static/examples/whisper.html

The easiest way is probably just with colab

screenshot

Check out the demo

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages