You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I've encountered significant performance gaps while reproducing your work. I understand that your work is based on code-davinci-002, and ViperGPT's performance on ChatGPT 3.5 seems far from what is mentioned in your paper. Could you offer prompts designed for ChatGPT (such as Refcoco dataset)? This is crucial for my work, and I appreciate your assistance!
The text was updated successfully, but these errors were encountered:
Hi @k1tano, we did not run any experiments with ChatGPT 3.5, so we do not have prompts that work specifically for it (nor GPT-4, nor CodeLlama). If you manage to find prompts that work better for ChatGPT 3.5, we would appreciate it if you can share them.
I've encountered significant performance gaps while reproducing your work. I understand that your work is based on code-davinci-002, and ViperGPT's performance on ChatGPT 3.5 seems far from what is mentioned in your paper. Could you offer prompts designed for ChatGPT (such as Refcoco dataset)? This is crucial for my work, and I appreciate your assistance!
The text was updated successfully, but these errors were encountered: