🥃 Anarchy's Distillery 🥃

Shrink your models

This is Anarchy's effort to help wean you off of closed-source models.

Table of Contents

• Table of Contents
• About
• Quick Start and Installation
  • Requirements
  • Installation
  • Usage
• Contributing

💁 What is the Distillery?

If you're doing one thing lots of times, why use a giant expensive and slow general purpose model when a fine-tuned small model could suffice? Where do you get the training data? Why not from running a big model on user data?
What if you don't have enough user data? Synthesize some with the big model.

Distillery does this. Replace openai.complete or whatever with distillery.complete and it will help you automatically switch over to a custom fine-tuned model.

🚀 Quickstart

Installation Requirements

Python >=3.10 Supported. Older versions of Python are on a best-effort basis.

Use bash > python3 --version to check what version you are on.

To upgrade your python, either create a new python env using bash > conda create -n myenv python=3.10 or go to https://www.python.org/downloads/ to download the latest version.

Installation

TODO: The quickest way to get started is to run pip install distillery in your Python environment.

Alternatively you could do this:

> git clone https://github.com/anarchy-ai/distillery.git
> cd distillery
> python -m venv <name>
> source <name>/bin/activate
> python -m pip install -e ."[dev]"

✅ Usage

# import our client
from distillery.client import Client

# Select which LLM you want to use, here we have OpenAI 
client = Client(big_model = 'chat_gpt')

# Put in your prompt and go!
response = client.complete(system_prompt = '', prompt = 'What is Anarchy?', openai_key = 'ENTER_YOUR_API_KEY')
print(response)
# Anarchy is a political ideology that advocates for the absence of government...

🩷 Contributing

We welcome contributors! To get started is to join our active discord community. Otherwise here are some ways to contribute and get paid:

Jobs

• We're always looking for serious hackers. Prove that you can build and creatively solve hard problems and reach out!
• The easiest way to secure a job/internship with us is to submit pull requests that address or resolve open issues.
• Then, you can apply directly here https://forms.gle/bUWDKW3cwZ8n6qsU8

Bounty

We offer bounties for closing specific tickets! Look at the ticket labels to see how much the bounty is. To get started, join the discord and read the guide

🙏 Acknowledgements

• Matthew Mirman - CEO

  • GitHub: @mmirman
  • LinkedIn: @matthewmirman
  • Twitter: @mmirman
  • Website: mirman.com

• Victor Odede - Undoomer

  • GitHub: @VictorOdede
  • LinkedIn: @victor-odede

• Abhigya Sodani - Research Intern

  • GitHub: @abhigya-sodani
  • LinkedIn: @abhigya-sodani

License

MIT License