Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Llama multiple function calls + raw_mode #80

Merged
merged 2 commits into from
Oct 1, 2024

Conversation

andthattoo
Copy link
Contributor

  • Added support for multiple function calls for Llama3.1 models Multiple function calls aren't supported #75
  • Added raw_mode for function call, which results in returning raw function calls without executing the tools and returning results. You do this by simply calling raw_mode() at the end of the function call
    let result = ollama
        .send_function_call(
            FunctionCallRequest::new(MODEL.to_string(), vec![search], vec![user_message])
                .raw_mode(),
            parser,
        )
        .await
        .unwrap();

andthattoo and others added 2 commits September 26, 2024 21:28
added raw mode, returning function calls only without calling tools

updated tests

.DS_store for gitignore
@andthattoo
Copy link
Contributor Author

@pepperoni21 this is some useful functionality for function calling with llama models!

@pepperoni21
Copy link
Owner

Thanks for the contribution!

@pepperoni21 pepperoni21 merged commit 273cf2a into pepperoni21:master Oct 1, 2024
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants