how i can connect lmstudio (NOT olama), i wont select the installed models. Sample Code?
At this moment, there is no direct built-in support for LM Studio. We have only developed & tested against Ollama & llama.cpp for local LLM.
We see that LM Studio gains some traction, so we'll investigate & consider supporting it in a future update.
LM Studio sits on top of Llama.cpp. I don't remember having too many problems with the provided samples, just make sure the provider is llama.cpp.
1 Like