v1.21.0 - LocalAI functions!

[mudler]

What's Changed

Bug fixes 🐛

• fix: make first stream message to send empty content by @mudler in fix: make first stream message to send empty content #751

Exciting New Features 🎉

• feat: [whisper] Partial support for verbose_json format in transcribe endpoint by @ldotlopez in feat: [whisper] Partial support for verbose_json format in transcribe endpoint #721
• feat: LocalAI functions by @mudler in feat: LocalAI functions #726
• feat: gRPC-based backends by @mudler in feat: gRPC-based backends #743
• feat: falcon support (7b and 40b) with ggllm.cpp by @mudler in feat: gRPC-based backends #743

Other Changes

• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in ⬆️ Update nomic-ai/gpt4all #704
• fix(deps): bump go-llama.cpp by @mudler in fix(deps): bump go-llama.cpp #719
• Create FUNDING.yml by @mudler in Create FUNDING.yml #725
• fix(deps): update module github.com/sashabaranov/go-openai to v1.13.0 by @renovate in fix(deps): update module github.com/sashabaranov/go-openai to v1.13.0 #667
• fix(deps): update module github.com/otiai10/openaigo to v1.5.2 by @renovate in fix(deps): update module github.com/otiai10/openaigo to v1.5.2 #731
• fix(deps): update github.com/tmc/langchaingo digest to a875e6b by @renovate in fix(deps): update github.com/tmc/langchaingo digest to a875e6b #700
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to ffa57fb by @renovate in fix(deps): update github.com/go-skynet/go-llama.cpp digest to ffa57fb #707
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to d611d10 by @renovate in fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to d611d10 #699
• Update README with sponsors section by @mudler in Update README with sponsors section #732
• fix(deps): update github.com/go-skynet/go-ggml-transformers.cpp digest to 3fec197 by @renovate in fix(deps): update github.com/go-skynet/go-ggml-transformers.cpp digest to 3fec197 #706
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in ⬆️ Update nomic-ai/gpt4all #705
• fix(deps): update module google.golang.org/protobuf to v1.31.0 by @renovate in fix(deps): update module google.golang.org/protobuf to v1.31.0 #746
• fix(deps): update module github.com/sashabaranov/go-openai to v1.14.0 by @renovate in fix(deps): update module github.com/sashabaranov/go-openai to v1.14.0 #739
• fix(deps): update module gopkg.in/yaml.v2 to v3 by @renovate in fix(deps): update module gopkg.in/yaml.v2 to v3 #299
• fix(deps): update github.com/go-skynet/go-ggml-transformers.cpp digest to ffb09d7 by @renovate in fix(deps): update github.com/go-skynet/go-ggml-transformers.cpp digest to ffb09d7 #744
• ⬆️ Update donomii/go-rwkv.cpp by @ci-robbot in ⬆️ Update donomii/go-rwkv.cpp #750
• fix(deps): update github.com/mudler/go-ggllm.cpp digest to 862477d by @renovate in fix(deps): update github.com/mudler/go-ggllm.cpp digest to 862477d #745
• fix(deps): update github.com/tmc/langchaingo digest to dcf7ecd by @renovate in fix(deps): update github.com/tmc/langchaingo digest to dcf7ecd #736
• fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to cfd70b6 by @renovate in fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to cfd70b6 #734
• fix(deps): update github.com/go-skynet/go-llama.cpp digest to 6c97625 by @renovate in fix(deps): update github.com/go-skynet/go-llama.cpp digest to 6c97625 #733
• ⬆️ Update nomic-ai/gpt4all by @ci-robbot in ⬆️ Update nomic-ai/gpt4all #735
• ⬆️ Update go-skynet/go-ggml-transformers.cpp by @ci-robbot in ⬆️ Update go-skynet/go-ggml-transformers.cpp #711
• fix(deps): update github.com/go-skynet/go-bert.cpp digest to 6abe312 by @renovate in fix(deps): update github.com/go-skynet/go-bert.cpp digest to 6abe312 #756
• fix(deps): update module github.com/gofiber/fiber/v2 to v2.48.0 by @renovate in fix(deps): update module github.com/gofiber/fiber/v2 to v2.48.0 #757

New Contributors

• @ldotlopez made their first contribution in feat: [whisper] Partial support for verbose_json format in transcribe endpoint #721

Full Changelog: v1.20.1...v1.21.0

---

This discussion was created from the release v1.21.0 - LocalAI functions!.

[tmc]

Great release! Can you point me to how to run the falcon 7b model via grpc?

[rioncarter]

Were you able to find a way to run Falcon? My attempts all seem to end with:

"message": "rpc error: code = Unknown desc = unimplemented"

[djmaze]

Same here.