Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Overall slowness #33

Closed
WH-Creations opened this issue Apr 6, 2023 · 1 comment
Closed

Overall slowness #33

WH-Creations opened this issue Apr 6, 2023 · 1 comment

Comments

@WH-Creations
Copy link

Hey there!

Just wanted to confirm some expected behavior. Calls are taking about 20 seconds to return a response, is that expected behavior?

If not, any tips on optimizing the prompt for quicker responses?
@anasfik
Copy link
Owner

anasfik commented Apr 9, 2023

Hi, yes it is what is expected from OpenAI APIs, they are relatively slow to generate one final result.

well, the solution or workaround that you can do, is to use the Stream based methods offered by the package, or by preloading requests for the end users

@anasfik anasfik closed this as completed Apr 9, 2023
@jonny7737 jonny7737 mentioned this issue May 23, 2023
Closed
@niluved niluved mentioned this issue May 27, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@anasfik @WH-Creations