My Model

My model is a 10 billion parameter LLM designed by Acme, Inc...

It is available under the MIT license

Requires an A10 for inference, expected to take 5 seconds per thousand tokens

Deploy My Model to Baseten

1. Install Truss
2. Make an API key
3. Deploy to Baseten

Here are some links to docs about stuff:

• Model resources
• Model health
• Model logs

Using My Model

Example usage

cURL https://baseten.co/endpoint

Parameters

(Table of parameters)

With the Python client

MyModel.predict("prompt")