NousCon 2024

This repo contains slides and code for Cameron Pfiffer's NousCon 2024 talk about Outlines and .txt.

It is intended to be run on Modal for people who do not have large GPUs, but the code in demo.py can easily be adapted to use local hardware.

Usage

pip install -r requirements.txt

If using Modal:

modal run demo.py

Modal does annoying things to the terminal output, so you may wish to disable it by running in quiet mode:

modal run -q demo.py