Choice of AI model (Advanced Paste)

[syhxsthy36g]

Description of the new feature / enhancement

Choice of AI model. Currently, to use the "Advanced Paste" function, we don't have a choice of model. For example, we could choose between the ChatGPT API (Open AI), Claude IA or Mistral. If the choice of several models is not possible, have the choice between using GPT-3.5 and GPT-4. Thank you for your interest.

Edit: I completely agree with the comments, local support for greater security and privacy would be great.

Scenario when this would be used?

Because I prefer to have the choice, and not to be forced, so that I can change as I please.

We could imagine a switch that lets you choose between online AI and local AI. Or even the ability to specify the url yourself. In the case of a predefined or known supported online model (in the example this would be between GPT, Claud or Mistral), we'd have a drop-down menu to choose the model. Based on this choice, a second choice would follow. This would be followed by a second one, this time allowing you to choose the version of the model. To return to the example, you can choose between GPT-3 or 4 (after choosing ChatGPT).

Supporting information

https://platform.openai.com/docs/introduction
https://www.anthropic.com/api
https://docs.mistral.ai/

[nolanblew]

I personally don't mind running my models through OpenAI's APIs, but when offline or for better privacy it would be nice to also specify a locally-running model, such as Llama3, Phi-3, or other SLMs

[g0t4]

PowerToys/src/modules/AdvancedPaste/AdvancedPaste/Helpers/AICompletionsHelper.cs

Line 79 in 16e68af

DeploymentName = "gpt-3.5-turbo-instruct",

3.5-turbo-instruct is what I found in my API usage logs, that is a terrible model to use when one of the 4-turbo models is far superior and we're talking about negligible cost differences when you consider how often someone would use advanced paste

b/c of 3.5 => simple tasks like "convert to c#" doesn't recognize the source language... and so I have to re-prompt with "convert javascript to c#"

please allow us to choose, or at least default to a 4-turbo/4o model

[Loongphy]

I hope to support custom API URLs. I have some Azure APIs converted into OpenAI format.

[htcfreek]

/dup #32960

[microsoft-github-policy-service]

Hi! We've identified this issue as a duplicate of another one that already exists on this Issue Tracker. This specific instance is being closed in favor of tracking the concern over on the referenced thread. Thanks for your report!