ChatGLM

Go binding for ChatGLM.cpp.

Usage

Get the Code

git clone --recursive https://github.com/go-aie/chatglm.git && cd chatglm

Or:

git clone https://github.com/go-aie/chatglm.git && cd chatglm
git submodule update --init --recursive

Quantize Model

Transform ChatGLM-6B into 4-bit quantized GGML format:

make convert

For other transformations, see Quantize Model.

Build & Test

Build the ChatGLM.cpp libraries:

make build

Run the tests:

go test -v -race ./...

License

MIT