Merge pull request #27 from better629/main

update OPENAI_API_BASE to OPEN_LLM_API_BASE
geekan · Nov 23, 2023 · 69c5ce8 · 69c5ce8
2 parents 88c3692 + 89f2f52
commit 69c5ce8
Show file tree

Hide file tree

Showing 2 changed files with 6 additions and 8 deletions.
diff --git a/src/guide/tutorials/integration_with_open_llm.md b/src/guide/tutorials/integration_with_open_llm.md
@@ -179,12 +179,11 @@ Such as LLaMA-Factory, FastChat, vllm openai compatible interface
 
 **config/key.yaml**
 ```yaml
-OPENAI_API_BASE: "http://0.0.0.0:8000/v1"
-OPENAI_API_KEY: "sk-xxx"
-OPENAI_API_MODEL: "llama2-13b"
+OPEN_LLM_API_BASE: "http://106.75.10.65:8001/v1"
+OPEN_LLM_API_MODEL: "llama2-13b"
 ```
 
-The complete routing of the openapi interface `http://0.0.0.0:8000/v1/chat/completions`, `OPENAI_API_BASE` only needs to be configured to `http://0.0.0.0:8000/v1`, and the remaining parts will be filled by openai sdk itself. `OPENAI_API_KEY` needs to be set to any value starting with `sk-`. `OPENAI_API_MODEL` is the actual value of the request interface parameter `model`.
+The complete routing of the openapi interface `http://0.0.0.0:8000/v1/chat/completions`, `OPEN_LLM_API_BASE` only needs to be configured to `http://0.0.0.0:8000/v1`, and the remaining parts will be filled by openai sdk itself. `OPEN_LLM_API_MODEL` is the actual value of the request interface parameter `model`.
 
 #### ollama api interface
 

diff --git a/src/zhcn/guide/tutorials/integration_with_open_llm.md b/src/zhcn/guide/tutorials/integration_with_open_llm.md
@@ -179,12 +179,11 @@ curl -X POST http://localhost:11434/api/generate -d '{
 
 **config/key.yaml**
 ```yaml
-OPENAI_API_BASE: "http://0.0.0.0:8000/v1"
-OPENAI_API_KEY: "sk-xxx"
-OPENAI_API_MODEL: "llama2-13b"
+OPEN_LLM_API_BASE: "http://106.75.10.65:8001/v1"
+OPEN_LLM_API_MODEL: "llama2-13b"
 ```
 
-openapi接口的完整路由`http://0.0.0.0:8000/v1/chat/completions`，`OPENAI_API_BASE`只需要配置到`http://0.0.0.0:8000/v1` ，剩余部分openai sdk会补齐。`OPENAI_API_KEY`需要设置为以`sk-`开头的任意值。`OPENAI_API_MODEL`为请求接口参数`model`的实际值。
+openapi接口的完整路由`http://0.0.0.0:8000/v1/chat/completions`，`OPEN_LLM_API_BASE`只需要配置到`http://0.0.0.0:8000/v1` ，剩余部分openai sdk会补齐。`OPEN_LLM_API_MODEL`为请求接口参数`model`的实际值。
 
 
 #### ollama api接口