Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature request, restful api / exposure #162

Closed
aratic opened this issue Mar 15, 2023 · 3 comments
Closed

feature request, restful api / exposure #162

aratic opened this issue Mar 15, 2023 · 3 comments
Labels
duplicate This issue or pull request already exists enhancement New feature or request

Comments

@aratic
Copy link

aratic commented Mar 15, 2023

hi team,

was playing interactive mode for couple hours, pretty impressive

resides what's mentioned in #145 ,
it might be not too far, to plug this a endpoint / functional call ( like swig or socket or openapi to replace current stdin ?, then self-host can have a very powerful new residents, like i got a powerful PC at home to be personal assist

also found that -n is the context / token limit, would be great if engine can start with 0 presume context ( which is to lift off / decouple a bit from stdin

kindly let me know if there are directions or others interested in this ( also a developer here but not so C / tensor flavored
( as without advice, force hi-jack stdin / stdout seems stupid

@aratic
Copy link
Author

aratic commented Mar 15, 2023

seems in progress ? like what's mentioned in #122 (comment) , so both api or ipython like conversational can happen?. any feature branch for the binding work , @gjmulder , then i may close this as duplicate. ( or to join the collabaration in same thread

@aratic
Copy link
Author

aratic commented Mar 15, 2023

seems mentioned in #82 , whether a WIP or existing binding handler

@gjmulder gjmulder added the enhancement New feature or request label Mar 15, 2023
@gjmulder
Copy link
Collaborator

Marked as duplicate

@gjmulder gjmulder closed this as not planned Won't fix, can't repro, duplicate, stale Mar 15, 2023
@gjmulder gjmulder added the duplicate This issue or pull request already exists label Mar 15, 2023
Deadsg pushed a commit to Deadsg/llama.cpp that referenced this issue Dec 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
duplicate This issue or pull request already exists enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants