Skip to content

Commit

Permalink
Remove NeuralChatEndpoint (#75)
Browse files Browse the repository at this point in the history
* Revert NeuralChatEndpoint

Signed-off-by: lvliang-intel <[email protected]>
  • Loading branch information
lvliang-intel committed Apr 12, 2024
1 parent ec50098 commit cfd3a15
Show file tree
Hide file tree
Showing 2 changed files with 1 addition and 249 deletions.
236 changes: 0 additions & 236 deletions ChatQnA/langchain/docker/qna-app/app/NeuralChatEndpoint.py

This file was deleted.

14 changes: 1 addition & 13 deletions ChatQnA/langchain/docker/qna-app/app/server.py
Original file line number Diff line number Diff line change
Expand Up @@ -69,19 +69,7 @@ def __init__(self, upload_dir, entrypoint, safety_guard_endpoint, tei_endpoint=N
repetition_penalty=1.03,
streaming=True,
)
# for NeuralChatEndpoint:
"""
self.llm = NeuralChatEndpoint(
endpoint_url=entrypoint,
max_new_tokens=1024,
top_k=10,
top_p=0.95,
typical_p=0.95,
temperature=0.01,
repetition_penalty=1.03,
streaming=True,
)
"""

if self.safety_guard_endpoint:
self.llm_guard = HuggingFaceEndpoint(
endpoint_url=safety_guard_endpoint,
Expand Down

0 comments on commit cfd3a15

Please sign in to comment.