Skip to content

Latest commit

 

History

History
88 lines (55 loc) · 2.28 KB

README.md

File metadata and controls

88 lines (55 loc) · 2.28 KB
Raw

Chatbot Ollama

About

Chatbot Ollama is an open source chat UI for Ollama.

This project is based on chatbot-ui by Mckay Wrigley.

Chatbot Ollama

Updates

Chatbot Ollama will be updated over time.

Next up

  • pull a model
  • delete a model
  • show model information

Docker

Build locally:

docker build -t chatbot-ollama .
docker run -p 3000:3000 chatbot-ollama

Pull from ghcr:

docker run -p 3000:3000 ghcr.io/ivanfioravanti/chatbot-ollama:main

Running Locally

1. Clone Repo

git clone https://github.com/ivanfioravanti/chatbot-ollama.git

2. Move to folder

cd chatbot-ollama

3. Install Dependencies

npm ci

4. Run Ollama server

Either via the cli:

ollama serve

or via the desktop client

5. Run App

npm run dev

6. Use It

You should be able to start chatting.

Configuration

When deploying the application, the following environment variables can be set:

Environment Variable Default value Description
DEFAULT_MODEL mistral:latest The default model to use on new conversations
NEXT_PUBLIC_DEFAULT_SYSTEM_PROMPT see here The default system prompt to use on new conversations
NEXT_PUBLIC_DEFAULT_TEMPERATURE 1 The default temperature to use on new conversations

Contact

If you have any questions, feel free to reach out to me on X.