How to turn off MMAP? #557

bnusunny · 2023-06-10T03:54:10Z

bnusunny
Jun 10, 2023

Hi, is there a way to turn off MMAP? I'm testing local-ai on AWS Lambda. The process crashes when loading the model. Lambda does not support MMAP. Is there any configuration to turn off it?

Answered by bnusunny

Jun 11, 2023

I found out how to disable MMAP without changing the code. In the configuration file, you just specify mmap: false.

name: gpt-3.5-turbo
# Default model parameters
parameters:
  # Relative to the models path
  model: WizardLM-7B-uncensored.ggmlv3.q4_K_M.bin
  repeat_penalty: 1.2
  temperature: 0.2
  mmap: false
  mmlock: false

View full answer

bnusunny · 2023-06-10T04:00:21Z

bnusunny
Jun 10, 2023
Author

Hmm, I turned MMAP off in the source code. But still get error. Any idea about the "SIGILL: illegal instruction"?

2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.239000 Starting LocalAI using 6 threads, with models path: /app/models
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.241000 3:54AM DBG Model: gpt-3.5-turbo (config: {OpenAIRequest:{Model:wizardlm-7B-uncensored.ggml.q5_1.bin File: Language: ResponseFormat: Size: Prompt:<nil> Instruction: Input:<nil> Stop:<nil> Messages:[] Stream:false Echo:false TopP:0 TopK:0 Temperature:0.2 Maxtokens:0 N:0 Batch:0 F16:false IgnoreEOS:false RepeatPenalty:0 Keep:0 MirostatETA:0 MirostatTAU:0 Mirostat:0 FrequencyPenalty:0 TFZ:0 Seed:0 Mode:0 Step:0} Name:gpt-3.5-turbo StopWords:[] Cutstrings:[] TrimSpace:[] ContextSize:0 F16:false Threads:0 Debug:false Roles:map[] Embeddings:false Backend: TemplateConfig:{Completion: Chat: Edit:} MirostatETA:0 MirostatTAU:0 Mirostat:0 NGPULayers:0 MMap:false MMlock:false TensorSplit: MainGPU: ImageGenerationAssets: PromptCachePath: PromptCacheAll:false PromptCacheRO:false PromptStrings:[] InputStrings:[] InputToken:[]})
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.264000 3:54AM DBG GPT4ALL_IMPLEMENTATIONS_PATH: /tmp/localai/backend_data/backend-assets/gpt4all
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.265000 ┌───────────────────────────────────────────────────┐ 
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.265000 │                   Fiber v2.46.0                   │ 
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.265000 │               http://127.0.0.1:8080               │ 
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.265000 │       (bound on host 0.0.0.0 and port 8080)       │ 
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.265000 │                                                   │ 
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.265000 │ Handlers ............ 24  Processes ........... 1 │ 
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.265000 │ Prefork ....... Disabled  PID ................ 20 │ 
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.265000 └───────────────────────────────────────────────────┘ 
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.267000 [127.0.0.1]:50650  404  -  GET      /
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.268000 EXTENSION    Name: lambda-adapter    State: Ready     Events: []
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.269000 START RequestId: 560753d4-8046-46c3-9f59-e40ad5069d70 Version: 11
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.271000 3:54AM DBG Request received: {"model":"gpt-3.5-turbo","file":"","language":"","response_format":"","size":"","prompt":"\n\n### Instructions:\nTell me about Shanghai\n\n### Response:\n","instruction":"","input":null,"stop":["###"],"messages":null,"stream":true,"echo":false,"top_p":0,"top_k":0,"temperature":0.2,"max_tokens":256,"n":0,"batch":0,"f16":false,"ignore_eos":false,"repeat_penalty":1.2,"n_keep":0,"mirostat_eta":0,"mirostat_tau":0,"mirostat":0,"frequency_penalty":0,"tfz":0,"seed":0,"mode":0,"step":0}
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.271000 3:54AM DBG `input`: &{Model:gpt-3.5-turbo File: Language: ResponseFormat: Size: Prompt:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.271000 ### Instructions:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.271000 Tell me about Shanghai
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.271000 ### Response:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.271000 Instruction: Input:<nil> Stop:[###] Messages:[] Stream:true Echo:false TopP:0 TopK:0 Temperature:0.2 Maxtokens:256 N:0 Batch:0 F16:false IgnoreEOS:false RepeatPenalty:1.2 Keep:0 MirostatETA:0 MirostatTAU:0 Mirostat:0 FrequencyPenalty:0 TFZ:0 Seed:0 Mode:0 Step:0}
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.271000 3:54AM DBG Parameter Config: &{OpenAIRequest:{Model:wizardlm-7B-uncensored.ggml.q5_1.bin File: Language: ResponseFormat: Size: Prompt:<nil> Instruction: Input:<nil> Stop:<nil> Messages:[] Stream:false Echo:false TopP:0 TopK:0 Temperature:0.2 Maxtokens:256 N:0 Batch:0 F16:false IgnoreEOS:false RepeatPenalty:1.2 Keep:0 MirostatETA:0 MirostatTAU:0 Mirostat:0 FrequencyPenalty:0 TFZ:0 Seed:0 Mode:0 Step:0} Name:gpt-3.5-turbo StopWords:[###] Cutstrings:[] TrimSpace:[] ContextSize:0 F16:false Threads:6 Debug:true Roles:map[] Embeddings:false Backend: TemplateConfig:{Completion: Chat: Edit:} MirostatETA:0 MirostatTAU:0 Mirostat:0 NGPULayers:0 MMap:false MMlock:false TensorSplit: MainGPU: ImageGenerationAssets: PromptCachePath: PromptCacheAll:false PromptCacheRO:false PromptStrings:[
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.271000 ### Instructions:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.271000 Tell me about Shanghai
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.271000 ### Response:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.271000 ] InputStrings:[] InputToken:[]}
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.271000 3:54AM DBG Stream request received
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.271000 [127.0.0.1]:50650  200  -  POST     /v1/completions
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.271000 3:54AM DBG Loading model 'wizardlm-7B-uncensored.ggml.q5_1.bin' greedly
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.271000 3:54AM DBG [llama] Attempting to load
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.271000 3:54AM DBG Loading model llama from wizardlm-7B-uncensored.ggml.q5_1.bin
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.271000 3:54AM DBG Loading model in memory from file: /app/models/wizardlm-7B-uncensored.ggml.q5_1.bin
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.272000 llama.cpp: loading model from /app/models/wizardlm-7B-uncensored.ggml.q5_1.bin
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.289000 SIGILL: illegal instruction
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.289000 PC=0x9fcaca m=8 sigcode=2
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.289000 signal arrived during cgo execution
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.289000 instruction bytes: 0x62 0xf2 0xfd 0x8 0x7c 0xc1 0x48 0x1 0xca 0x48 0x89 0x55 0x10 0xc5 0xfa 0x7f
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.289000 goroutine 7 [syscall]:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.289000 runtime.cgocall(0x955ee0, 0xc00018cf98)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.289000 /snap/go/current/src/runtime/cgocall.go:157 +0x5c fp=0xc00018cf70 sp=0xc00018cf38 pc=0x419f1c
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 github.com/go-skynet/go-llama%2ecpp._Cfunc_load_model(0x7eff54000b70, 0x200, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x2706b30, ...)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 _cgo_gotypes.go:232 +0x4d fp=0xc00018cf98 sp=0xc00018cf70 pc=0x89ff2d
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 github.com/go-skynet/go-llama%2ecpp.New({0xc0000281b0, 0x30}, {0xc000236040, 0x3, 0x1?})
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /home/ubuntu/projects/github.com/go-skynet/LocalAI/go-llama/llama.go:26 +0x236 fp=0xc00018d098 sp=0xc00018cf98 pc=0x8a05b6
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 github.com/go-skynet/LocalAI/pkg/model.llamaLM.func1({0xc0000281b0?, 0xe0264e?})
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /home/ubuntu/projects/github.com/go-skynet/LocalAI/pkg/model/initializers.go:116 +0x2a fp=0xc00018d0d0 sp=0xc00018d098 pc=0x8a60ca
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 github.com/go-skynet/LocalAI/pkg/model.(*ModelLoader).LoadModel(0xc000186a20, {0xc0000d6150, 0x24}, 0xc0002360c0)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /home/ubuntu/projects/github.com/go-skynet/LocalAI/pkg/model/loader.go:127 +0x1fe fp=0xc00018d1c8 sp=0xc00018d0d0 pc=0x8a7ffe
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 github.com/go-skynet/LocalAI/pkg/model.(*ModelLoader).BackendLoader(0xc000186a20, {0xde8546, 0x5}, {0xc0000d6150, 0x24}, {0xc000236040, 0x3, 0x4}, 0x6)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /home/ubuntu/projects/github.com/go-skynet/LocalAI/pkg/model/initializers.go:142 +0x34d fp=0xc00018d268 sp=0xc00018d1c8 pc=0x8a674d
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 github.com/go-skynet/LocalAI/pkg/model.(*ModelLoader).GreedyLoader(0xc000186a20, {0xc0000d6150, 0x24}, {0xc000236040, 0x3, 0x4}, 0x0?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /home/ubuntu/projects/github.com/go-skynet/LocalAI/pkg/model/initializers.go:196 +0x3a5 fp=0xc00018d3b0 sp=0xc00018d268 pc=0x8a7005
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 github.com/go-skynet/LocalAI/api.ModelInference({_, _}, _, {{{0xc0000d6150, 0x24}, {0x0, 0x0}, {0x0, 0x0}, {0x0, ...}, ...}, ...}, ...)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /home/ubuntu/projects/github.com/go-skynet/LocalAI/api/prediction.go:258 +0x145 fp=0xc00018d6a8 sp=0xc00018d3b0 pc=0x921fe5
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 github.com/go-skynet/LocalAI/api.ComputeChoices({0xc000030140, 0x3a}, 0xc000222000, 0xc0000e2b00, 0xc000186a20?, 0x12684e8, 0xc000012030?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /home/ubuntu/projects/github.com/go-skynet/LocalAI/api/prediction.go:598 +0x138 fp=0xc00018df48 sp=0xc00018d6a8 pc=0x925f98
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 github.com/go-skynet/LocalAI/api.completionEndpoint.func1({0xc000030140, 0x3a}, 0xc000222000, 0x0?, 0x0?, 0xc0000961e0)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /home/ubuntu/projects/github.com/go-skynet/LocalAI/api/openai.go:151 +0xb1 fp=0xc00018dfa0 sp=0xc00018df48 pc=0x926d51
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 github.com/go-skynet/LocalAI/api.completionEndpoint.func2.3()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /home/ubuntu/projects/github.com/go-skynet/LocalAI/api/openai.go:214 +0x3f fp=0xc00018dfe0 sp=0xc00018dfa0 pc=0x91b3df
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 runtime.goexit()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00018dfe8 sp=0xc00018dfe0 pc=0x47d1e1
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 created by github.com/go-skynet/LocalAI/api.completionEndpoint.func2
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /home/ubuntu/projects/github.com/go-skynet/LocalAI/api/openai.go:214 +0x654
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 goroutine 1 [IO wait]:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/runtime/proc.go:381 +0xd6 fp=0xc00019d288 sp=0xc00019d268 pc=0x44df16
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 runtime.netpollblock(0x7eff99840d08?, 0x4195af?, 0x0?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/runtime/netpoll.go:527 +0xf7 fp=0xc00019d2c0 sp=0xc00019d288 pc=0x4467b7
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 internal/poll.runtime_pollWait(0x7eff70cb5458, 0x72)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/runtime/netpoll.go:306 +0x89 fp=0xc00019d2e0 sp=0xc00019d2c0 pc=0x477989
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 internal/poll.(*pollDesc).wait(0xc00012e380?, 0x4?, 0x0)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/internal/poll/fd_poll_runtime.go:84 +0x32 fp=0xc00019d308 sp=0xc00019d2e0 pc=0x4ee8f2
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 internal/poll.(*pollDesc).waitRead(...)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/internal/poll/fd_poll_runtime.go:89
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 internal/poll.(*FD).Accept(0xc00012e380)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/internal/poll/fd_unix.go:614 +0x2bd fp=0xc00019d3b0 sp=0xc00019d308 pc=0x4f41fd
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 net.(*netFD).accept(0xc00012e380)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/net/fd_unix.go:172 +0x35 fp=0xc00019d468 sp=0xc00019d3b0 pc=0x57b0f5
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 net.(*TCPListener).accept(0xc0000ac648)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/net/tcpsock_posix.go:148 +0x25 fp=0xc00019d490 sp=0xc00019d468 pc=0x5914a5
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 net.(*TCPListener).Accept(0xc0000ac648)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/net/tcpsock.go:297 +0x3d fp=0xc00019d4c0 sp=0xc00019d490 pc=0x59059d
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 github.com/valyala/fasthttp.acceptConn(0xc0001f8000, {0x12f8c40, 0xc0000ac648}, 0xc00019d6b8)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /home/ubuntu/go/pkg/mod/github.com/valyala/[email protected]/server.go:1930 +0x62 fp=0xc00019d5a0 sp=0xc00019d4c0 pc=0x7c8de2
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 github.com/valyala/fasthttp.(*Server).Serve(0xc0001f8000, {0x12f8c40?, 0xc0000ac648})
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /home/ubuntu/go/pkg/mod/github.com/valyala/[email protected]/server.go:1823 +0x4f4 fp=0xc00019d6e8 sp=0xc00019d5a0 pc=0x7c83f4
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 github.com/gofiber/fiber/v2.(*App).Listen(0xc0000e9200, {0xde7e0c?, 0x7?})
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /home/ubuntu/go/pkg/mod/github.com/gofiber/fiber/[email protected]/listen.go:82 +0x110 fp=0xc00019d748 sp=0xc00019d6e8 pc=0x85e130
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 main.main.func1(0xc0001ea160?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /home/ubuntu/projects/github.com/go-skynet/LocalAI/main.go:140 +0x6c6 fp=0xc00019d990 sp=0xc00019d748 pc=0x955766
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 github.com/urfave/cli/v2.(*Command).Run(0xc0001ea160, 0xc0000ea900, {0xc0000b2000, 0x5, 0x5})
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /home/ubuntu/go/pkg/mod/github.com/urfave/cli/[email protected]/command.go:274 +0x9eb fp=0xc00019dc30 sp=0xc00019d990 pc=0x942c4b
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 github.com/urfave/cli/v2.(*App).RunContext(0xc0001e6000, {0x12f8fa8?, 0xc0000b4000}, {0xc0000b2000, 0x5, 0x5})
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /home/ubuntu/go/pkg/mod/github.com/urfave/cli/[email protected]/app.go:332 +0x616 fp=0xc00019dca0 sp=0xc00019dc30 pc=0x93f576
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 github.com/urfave/cli/v2.(*App).Run(...)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /home/ubuntu/go/pkg/mod/github.com/urfave/cli/[email protected]/app.go:309
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 main.main()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /home/ubuntu/projects/github.com/go-skynet/LocalAI/main.go:144 +0xff6 fp=0xc00019df80 sp=0xc00019dca0 pc=0x954fd6
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 runtime.main()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/runtime/proc.go:250 +0x207 fp=0xc00019dfe0 sp=0xc00019df80 pc=0x44dae7
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 runtime.goexit()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00019dfe8 sp=0xc00019dfe0 pc=0x47d1e1
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 goroutine 2 [force gc (idle)]:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/runtime/proc.go:381 +0xd6 fp=0xc00004afb0 sp=0xc00004af90 pc=0x44df16
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 runtime.goparkunlock(...)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/runtime/proc.go:387
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 runtime.forcegchelper()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/runtime/proc.go:305 +0xb0 fp=0xc00004afe0 sp=0xc00004afb0 pc=0x44dd50
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 runtime.goexit()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00004afe8 sp=0xc00004afe0 pc=0x47d1e1
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 created by runtime.init.6
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/runtime/proc.go:293 +0x25
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 goroutine 3 [GC sweep wait]:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/runtime/proc.go:381 +0xd6 fp=0xc00004b780 sp=0xc00004b760 pc=0x44df16
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 runtime.goparkunlock(...)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/runtime/proc.go:387
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 runtime.bgsweep(0x0?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/runtime/mgcsweep.go:319 +0xde fp=0xc00004b7c8 sp=0xc00004b780 pc=0x43a0be
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 runtime.gcenable.func1()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/runtime/mgc.go:178 +0x26 fp=0xc00004b7e0 sp=0xc00004b7c8 pc=0x42f326
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 runtime.goexit()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00004b7e8 sp=0xc00004b7e0 pc=0x47d1e1
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 created by runtime.gcenable
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/runtime/mgc.go:178 +0x6b
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 goroutine 4 [GC scavenge wait]:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 runtime.gopark(0xc000074000?, 0x12f1150?, 0x0?, 0x0?, 0x0?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/runtime/proc.go:381 +0xd6 fp=0xc00004bf70 sp=0xc00004bf50 pc=0x44df16
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 runtime.goparkunlock(...)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/runtime/proc.go:387
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 runtime.(*scavengerState).park(0x179a220)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/runtime/mgcscavenge.go:400 +0x53 fp=0xc00004bfa0 sp=0xc00004bf70 pc=0x437f93
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 runtime.bgscavenge(0x0?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 /snap/go/current/src/runtime/mgcscavenge.go:633 +0x65 fp=0xc00004bfc8 sp=0xc00004bfa0 pc=0x438585
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.290000 runtime.gcenable.func2()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/mgc.go:179 +0x26 fp=0xc00004bfe0 sp=0xc00004bfc8 pc=0x42f2c6
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.goexit()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00004bfe8 sp=0xc00004bfe0 pc=0x47d1e1
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 created by runtime.gcenable
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/mgc.go:179 +0xaa
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 goroutine 18 [finalizer wait]:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.gopark(0x1a0?, 0x179af00?, 0xe0?, 0xa4?, 0xc00004a770?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/proc.go:381 +0xd6 fp=0xc00004a628 sp=0xc00004a608 pc=0x44df16
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.runfinq()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/mfinal.go:193 +0x107 fp=0xc00004a7e0 sp=0xc00004a628 pc=0x42e367
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.goexit()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00004a7e8 sp=0xc00004a7e0 pc=0x47d1e1
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 created by runtime.createfing
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/mfinal.go:163 +0x45
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 goroutine 19 [GC worker (idle)]:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/proc.go:381 +0xd6 fp=0xc000046750 sp=0xc000046730 pc=0x44df16
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.gcBgMarkWorker()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/mgc.go:1275 +0xf1 fp=0xc0000467e0 sp=0xc000046750 pc=0x431091
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.goexit()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000467e8 sp=0xc0000467e0 pc=0x47d1e1
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 created by runtime.gcBgMarkStartWorkers
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/mgc.go:1199 +0x25
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 goroutine 20 [GC worker (idle)]:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.gopark(0x20f282a468b?, 0x0?, 0x0?, 0x0?, 0x0?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/proc.go:381 +0xd6 fp=0xc000046f50 sp=0xc000046f30 pc=0x44df16
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.gcBgMarkWorker()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/mgc.go:1275 +0xf1 fp=0xc000046fe0 sp=0xc000046f50 pc=0x431091
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.goexit()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000046fe8 sp=0xc000046fe0 pc=0x47d1e1
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 created by runtime.gcBgMarkStartWorkers
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/mgc.go:1199 +0x25
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 goroutine 5 [GC worker (idle)]:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.gopark(0x20f282bc443?, 0x0?, 0x0?, 0x0?, 0x0?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/proc.go:381 +0xd6 fp=0xc00004c750 sp=0xc00004c730 pc=0x44df16
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.gcBgMarkWorker()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/mgc.go:1275 +0xf1 fp=0xc00004c7e0 sp=0xc00004c750 pc=0x431091
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.goexit()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00004c7e8 sp=0xc00004c7e0 pc=0x47d1e1
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 created by runtime.gcBgMarkStartWorkers
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/mgc.go:1199 +0x25
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 goroutine 34 [GC worker (idle)]:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.gopark(0x1b9d020?, 0x3?, 0x4f?, 0x6a?, 0x0?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/proc.go:381 +0xd6 fp=0xc0004dc750 sp=0xc0004dc730 pc=0x44df16
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.gcBgMarkWorker()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/mgc.go:1275 +0xf1 fp=0xc0004dc7e0 sp=0xc0004dc750 pc=0x431091
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.goexit()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0004dc7e8 sp=0xc0004dc7e0 pc=0x47d1e1
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 created by runtime.gcBgMarkStartWorkers
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/mgc.go:1199 +0x25
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 goroutine 6 [GC worker (idle)]:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.gopark(0x20f282ab9c6?, 0x0?, 0x0?, 0x0?, 0x0?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/proc.go:381 +0xd6 fp=0xc00004cf50 sp=0xc00004cf30 pc=0x44df16
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.gcBgMarkWorker()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/mgc.go:1275 +0xf1 fp=0xc00004cfe0 sp=0xc00004cf50 pc=0x431091
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.goexit()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00004cfe8 sp=0xc00004cfe0 pc=0x47d1e1
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 created by runtime.gcBgMarkStartWorkers
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/mgc.go:1199 +0x25
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 goroutine 21 [GC worker (idle)]:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.gopark(0x20f282aad0e?, 0x0?, 0x0?, 0x0?, 0x0?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/proc.go:381 +0xd6 fp=0xc000047750 sp=0xc000047730 pc=0x44df16
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.gcBgMarkWorker()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/mgc.go:1275 +0xf1 fp=0xc0000477e0 sp=0xc000047750 pc=0x431091
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.goexit()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000477e8 sp=0xc0000477e0 pc=0x47d1e1
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 created by runtime.gcBgMarkStartWorkers
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/mgc.go:1199 +0x25
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 goroutine 35 [select]:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.gopark(0xc0004dff10?, 0x2?, 0x0?, 0x0?, 0xc0004dfee4?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/proc.go:381 +0xd6 fp=0xc0004dfd30 sp=0xc0004dfd10 pc=0x44df16
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.selectgo(0xc0004dff10, 0xc0004dfee0, 0x0?, 0x0, 0x0?, 0x1)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/select.go:327 +0x7be fp=0xc0004dfe70 sp=0xc0004dfd30 pc=0x45da9e
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 github.com/go-skynet/LocalAI/api.(*galleryApplier).start.func1()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /home/ubuntu/projects/github.com/go-skynet/LocalAI/api/gallery.go:103 +0xe6 fp=0xc0004dffe0 sp=0xc0004dfe70 pc=0x918f26
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.goexit()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0004dffe8 sp=0xc0004dffe0 pc=0x47d1e1
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 created by github.com/go-skynet/LocalAI/api.(*galleryApplier).start
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /home/ubuntu/projects/github.com/go-skynet/LocalAI/api/gallery.go:101 +0xaa
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 goroutine 36 [sleep]:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.gopark(0x20f27e21265?, 0xc000047f88?, 0x25?, 0xd2?, 0xc0000ccb70?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/proc.go:381 +0xd6 fp=0xc000047f58 sp=0xc000047f38 pc=0x44df16
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 time.Sleep(0x2540be400)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/time.go:195 +0x135 fp=0xc000047f98 sp=0xc000047f58 pc=0x47a055
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 github.com/valyala/fasthttp.(*workerPool).Start.func2()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /home/ubuntu/go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:67 +0x56 fp=0xc000047fe0 sp=0xc000047f98 pc=0x7d58d6
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.goexit()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000047fe8 sp=0xc000047fe0 pc=0x47d1e1
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 created by github.com/valyala/fasthttp.(*workerPool).Start
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /home/ubuntu/go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:59 +0xdd
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 goroutine 37 [select]:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.gopark(0xc0001a1a08?, 0x3?, 0xe?, 0xb0?, 0xc0001a19da?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/proc.go:381 +0xd6 fp=0xc0001a1860 sp=0xc0001a1840 pc=0x44df16
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 runtime.selectgo(0xc0001a1a08, 0xc0001a19d4, 0x1b9d020?, 0x0, 0x7eff70c9f988?, 0x1)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /snap/go/current/src/runtime/select.go:327 +0x7be fp=0xc0001a19a0 sp=0xc0001a1860 pc=0x45da9e
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 github.com/valyala/fasthttp/fasthttputil.(*pipeConn).readNextByteBuffer(0xc0000fc958, 0x1)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /home/ubuntu/go/pkg/mod/github.com/valyala/[email protected]/fasthttputil/pipeconns.go:188 +0x1b3 fp=0xc0001a1a48 sp=0xc0001a19a0 pc=0x787c53
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 github.com/valyala/fasthttp/fasthttputil.(*pipeConn).read(0xc0000fc958, {0xc0001ec000, 0x1000, 0x7c1975?}, 0x0?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /home/ubuntu/go/pkg/mod/github.com/valyala/[email protected]/fasthttputil/pipeconns.go:165 +0x3a fp=0xc0001a1a78 sp=0xc0001a1a48 pc=0x78799a
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 github.com/valyala/fasthttp/fasthttputil.(*pipeConn).Read(0x16dcc20?, {0xc0001ec000?, 0x6?, 0x0?})
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /home/ubuntu/go/pkg/mod/github.com/valyala/[email protected]/fasthttputil/pipeconns.go:148 +0x88 fp=0xc0001a1af8 sp=0xc0001a1a78 pc=0x787888
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 github.com/valyala/fasthttp.writeBodyChunked(0xc0000d2330?, {0x7eff703cf920, 0xc0000fc958})
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /home/ubuntu/go/pkg/mod/github.com/valyala/[email protected]/http.go:2064 +0x95 fp=0xc0001a1b68 sp=0xc0001a1af8 pc=0x7c15b5
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 github.com/valyala/fasthttp.(*Response).writeBodyStream(0xc0000d2330, 0xc0000b0ae0?, 0x1)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /home/ubuntu/go/pkg/mod/github.com/valyala/[email protected]/http.go:1976 +0x1f1 fp=0xc0001a1be0 sp=0xc0001a1b68 pc=0x7c0e11
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 github.com/valyala/fasthttp.(*Response).Write(0xc0000e9200?, 0x4a19b7?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /home/ubuntu/go/pkg/mod/github.com/valyala/[email protected]/http.go:1877 +0x157 fp=0xc0001a1c38 sp=0xc0001a1be0 pc=0x7c0a97
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 github.com/valyala/fasthttp.writeResponse(0xc0000d2000?, 0x16f0bd4?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /home/ubuntu/go/pkg/mod/github.com/valyala/[email protected]/server.go:2577 +0x5b fp=0xc0001a1c58 sp=0xc0001a1c38 pc=0x7cbf7b
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 github.com/valyala/fasthttp.(*Server).serveConn(0xc0001f8000, {0x12fb6e0?, 0xc0000ae458})
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.291000 /home/ubuntu/go/pkg/mod/github.com/valyala/[email protected]/server.go:2418 +0x1667 fp=0xc0001a1ec8 sp=0xc0001a1c58 pc=0x7cada7
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 github.com/valyala/fasthttp.(*Server).serveConn-fm({0x12fb6e0?, 0xc0000ae458?})
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 <autogenerated>:1 +0x39 fp=0xc0001a1ef0 sp=0xc0001a1ec8 pc=0x7da1d9
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 github.com/valyala/fasthttp.(*workerPool).workerFunc(0xc0000ccb40, 0xc0000b85a0)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 /home/ubuntu/go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:224 +0xa9 fp=0xc0001a1fa0 sp=0xc0001a1ef0 pc=0x7d6409
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 github.com/valyala/fasthttp.(*workerPool).getCh.func1()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 /home/ubuntu/go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:196 +0x38 fp=0xc0001a1fe0 sp=0xc0001a1fa0 pc=0x7d6178
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 runtime.goexit()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 /snap/go/current/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0001a1fe8 sp=0xc0001a1fe0 pc=0x47d1e1
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 created by github.com/valyala/fasthttp.(*workerPool).getCh
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 /home/ubuntu/go/pkg/mod/github.com/valyala/[email protected]/workerpool.go:195 +0x1b0
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 goroutine 38 [sleep]:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 runtime.gopark(0x20f27fc86fb?, 0xc0000487d0?, 0x78?, 0x61?, 0xc0000ccb40?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 /snap/go/current/src/runtime/proc.go:381 +0xd6 fp=0xc000048788 sp=0xc000048768 pc=0x44df16
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 time.Sleep(0x3b9aca00)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 /snap/go/current/src/runtime/time.go:195 +0x135 fp=0xc0000487c8 sp=0xc000048788 pc=0x47a055
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 github.com/valyala/fasthttp.updateServerDate.func1()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 /home/ubuntu/go/pkg/mod/github.com/valyala/[email protected]/header.go:2247 +0x1e fp=0xc0000487e0 sp=0xc0000487c8 pc=0x7d685e
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 runtime.goexit()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 /snap/go/current/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000487e8 sp=0xc0000487e0 pc=0x47d1e1
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 created by github.com/valyala/fasthttp.updateServerDate
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 /home/ubuntu/go/pkg/mod/github.com/valyala/[email protected]/header.go:2245 +0x25
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 goroutine 8 [chan receive]:
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 /snap/go/current/src/runtime/proc.go:381 +0xd6 fp=0xc0004ded10 sp=0xc0004decf0 pc=0x44df16
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 runtime.chanrecv(0xc0000961e0, 0xc0004def10, 0x1)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 /snap/go/current/src/runtime/chan.go:583 +0x49d fp=0xc0004deda0 sp=0xc0004ded10 pc=0x41ccdd
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 runtime.chanrecv2(0x0?, 0x0?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 /snap/go/current/src/runtime/chan.go:447 +0x18 fp=0xc0004dedc8 sp=0xc0004deda0 pc=0x41c818
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 github.com/go-skynet/LocalAI/api.completionEndpoint.func2.1(0x0?)
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 /home/ubuntu/projects/github.com/go-skynet/LocalAI/api/openai.go:218 +0xc5 fp=0xc0004defa0 sp=0xc0004dedc8 pc=0x91b085
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 github.com/valyala/fasthttp.NewStreamReader.func1()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 /home/ubuntu/go/pkg/mod/github.com/valyala/[email protected]/stream.go:44 +0x38 fp=0xc0004defe0 sp=0xc0004defa0 pc=0x7ce398
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 runtime.goexit()
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 /snap/go/current/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0004defe8 sp=0xc0004defe0 pc=0x47d1e1
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 created by github.com/valyala/fasthttp.NewStreamReader
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 /home/ubuntu/go/pkg/mod/github.com/valyala/[email protected]/stream.go:43 +0x37c
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 rax    0x7eff541d65e8
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 rbx    0x0
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 rcx    0x7eff541f75a0
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 rdx    0x8
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 rdi    0x0
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 rsi    0x7eff541d65e0
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 rbp    0x7eff541f7560
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 rsp    0x7eff62ffb140
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 r8     0x8
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 r9     0x7eff541f75a0
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 r10    0x7eff54002360
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 r11    0x7eff54000090
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 r12    0x0
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 r13    0x7eff62ffb210
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 r14    0x0
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 r15    0x7eff541f7480
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 rip    0x9fcaca
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 rflags 0x10202
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 cs     0x33
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 fs     0x0
2023/06/10/[11]d2155f1cf4e946728a2e75e44d1f3dea 2023-06-10T03:54:20.292000 gs     0x0

0 replies

bnusunny · 2023-06-10T04:02:16Z

bnusunny
Jun 10, 2023
Author

The same model loads successfully with llama-cpp-python package.

0 replies

bnusunny · 2023-06-10T04:21:21Z

bnusunny
Jun 10, 2023
Author

Hmm, these instructions could be AVX-512 SMID instructions. Lambda x86_64 only supports AVX and AVX2. Is there a way to complie llama.cpp only for AVX2?

0 replies

bnusunny · 2023-06-10T05:46:20Z

bnusunny
Jun 10, 2023
Author

I found a workaround: compiling Local-ai on c4 instances, which does not have AVX-512 support. Again, is there any configuration to turn off MMAP, so that I don't know to modify the code and recompile it?

0 replies

bnusunny · 2023-06-11T05:50:52Z

bnusunny
Jun 11, 2023
Author

I found out how to disable MMAP without changing the code. In the configuration file, you just specify mmap: false.

name: gpt-3.5-turbo
# Default model parameters
parameters:
  # Relative to the models path
  model: WizardLM-7B-uncensored.ggmlv3.q4_K_M.bin
  repeat_penalty: 1.2
  temperature: 0.2
  mmap: false
  mmlock: false

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

How to turn off MMAP? #557

{{title}}

Replies: 5 comments

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

How to turn off MMAP? #557

bnusunny Jun 10, 2023

Replies: 5 comments

bnusunny Jun 10, 2023 Author

bnusunny Jun 10, 2023 Author

bnusunny Jun 10, 2023 Author

bnusunny Jun 10, 2023 Author

bnusunny Jun 11, 2023 Author

bnusunny
Jun 10, 2023

bnusunny
Jun 10, 2023
Author

bnusunny
Jun 10, 2023
Author

bnusunny
Jun 10, 2023
Author

bnusunny
Jun 10, 2023
Author

bnusunny
Jun 11, 2023
Author