Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LabsPhi3_sk_rag01 fails #144

Open
Barshan-Mandal opened this issue Aug 15, 2024 · 3 comments
Open

LabsPhi3_sk_rag01 fails #144

Barshan-Mandal opened this issue Aug 15, 2024 · 3 comments
Assignees

Comments

@Barshan-Mandal
Copy link

System.MissingMethodException HResult=0x80131513 Message=Method not found: 'System.ValueTuple3<System.ReadOnlyMemory1<Int64>,System.ReadOnlyMemory1,System.ReadOnlyMemory1<Int64>> FastBertTokenizer.BertTokenizer.Encode(System.String, Int32, System.Nullable1)'.
Source=SmartComponents.LocalEmbeddings
StackTrace:
at SmartComponents.LocalEmbeddings.LocalEmbedder.Embed[TEmbedding](String inputText, Nullable1 outputBuffer, Int32 maximumTokens) at SmartComponents.LocalEmbeddings.LocalEmbedder.Embed(String inputText, Int32 maximumTokens) at SmartComponents.LocalEmbeddings.SemanticKernel.LocalTextEmbeddingGenerationService.GenerateEmbeddingsAsync(IList1 data, Kernel kernel, CancellationToken cancellationToken)
at Microsoft.SemanticKernel.Embeddings.EmbeddingGenerationExtensions.d__02.MoveNext() at Microsoft.SemanticKernel.Memory.SemanticTextMemory.<SaveInformationAsync>d__3.MoveNext() at phi3vision_aiconsole.Program.<Phi3MemoryRAG>d__2.MoveNext() in O:\Windows For Programming\Projects\Visual Studio\Console\Ai\phi3vision_aiconsole\Program.cs:line 86 at phi3vision_aiconsole.Program.<Main>d__0.MoveNext() in O:\Windows For Programming\Projects\Visual Studio\Console\Ai\phi3vision_aiconsole\Program.cs:line 24

occurs at the following line

await memory.SaveInformationAsync(MemoryCollectionName, id: "info1", text: "Gisela's favourite super hero is Batman");

@leestott
Copy link
Contributor

Hi @Barshan-Mandal are you taking the semantic Kernel samples from https://github.com/elbruno/phi3-labs by @elbruno?

If so please raise issues on that repo?

@elbruno
Copy link
Contributor

elbruno commented Aug 16, 2024

Hi
I'm working on update this sample to make it work again. In the meantime, you can refer to this post from Arafat, who performs a very similar scenario doing RAG in local mode.

https://arafattehsin.com/ai-copilot-offline-phi3-semantic-kernel/

Best

@Barshan-Mandal
Copy link
Author

semantic text cant handle long books .try using kernel memory

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants