Is it possible to use a locally privatized model?

[645293829]

If I download a model from Hugging Face to my local machine, can I use this local model directly instead of calling it through an API?

[pontus-devoteam]

Created a PR for to support this and any provider #26

[keldenl]

ollama or any openai-compatible LLM work, see #120 . Stuff that require tool calling would require the api and model to support toolcalling

[github-actions]

This issue is stale because it has been open for 7 days with no activity.