You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Ollama integrations do not support the full capabilities of the generation methods. Namely OllamaGenerator.generate and OllamaChatGenerator.chat methods. I was trying to add the keep_alive option to the generation using the OllamaGenerator. But when I inspected the code, I've seen that the method only passed down the model, prompt, stream and options parameters, even though the Ollama client is capable of utilizing more:
Describe the solution you'd like
Adding all the top level parameters that ollama client is able to use to the OllamaGenerator and OllamaChatGenerator constructors respectively.
Describe alternatives you've considered
Using kwargs to pass down the parameters manually:
Is your feature request related to a problem? Please describe.
Ollama integrations do not support the full capabilities of the generation methods. Namely
OllamaGenerator.generate
andOllamaChatGenerator.chat
methods. I was trying to add the keep_alive option to the generation using the OllamaGenerator. But when I inspected the code, I've seen that the method only passed down themodel
,prompt
,stream
andoptions
parameters, even though the Ollama client is capable of utilizing more:Describe the solution you'd like
Adding all the top level parameters that ollama client is able to use to the
OllamaGenerator
andOllamaChatGenerator
constructors respectively.Describe alternatives you've considered
Using kwargs to pass down the parameters manually:
Additional context
The text was updated successfully, but these errors were encountered: