replace openai

[world2025]

can you tell me how to use local llm to replace the openai model,thanks, i can not find related codes

[Howardqlz]

Nice work and i have the same question. Is there a way to override LLM function to use customize llms?

[sneedger]

+1

[20001LastOrder]

I guess that you can inherit the base LLM model and implement the _call function. You can check an example here (This is a fake LLM used for testing purpose I believe )

[dosubot]

Hi, @tkone2018! I'm Dosu, and I'm here to help the LangChain team manage their backlog. I wanted to let you know that we are marking this issue as stale.

From what I understand, you were seeking guidance on how to use a local language model (llm) to replace the openai model. Howardqlz and others have also expressed interest in the same question. 20001LastOrder suggested inheriting the base LLM model and implementing the _call function, and even provided an example in a comment.

Before we close this issue, we wanted to check with you if it is still relevant to the latest version of the LangChain repository. If it is, please let us know by commenting on the issue. Otherwise, feel free to close the issue yourself or it will be automatically closed in 7 days.

Thank you for your contribution and we hope to hear from you soon!