Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can you provide prompts for ChatGPT 3.5? #44

Open
k1tano opened this issue Jan 15, 2024 · 1 comment
Open

Can you provide prompts for ChatGPT 3.5? #44

k1tano opened this issue Jan 15, 2024 · 1 comment

Comments

@k1tano
Copy link

k1tano commented Jan 15, 2024

I've encountered significant performance gaps while reproducing your work. I understand that your work is based on code-davinci-002, and ViperGPT's performance on ChatGPT 3.5 seems far from what is mentioned in your paper. Could you offer prompts designed for ChatGPT (such as Refcoco dataset)? This is crucial for my work, and I appreciate your assistance!

@surisdi
Copy link
Contributor

surisdi commented Jan 15, 2024

Hi @k1tano, we did not run any experiments with ChatGPT 3.5, so we do not have prompts that work specifically for it (nor GPT-4, nor CodeLlama). If you manage to find prompts that work better for ChatGPT 3.5, we would appreciate it if you can share them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants