Can use local model?

[tigercj2010-Jeff]

Can it use local model hub such like OpenwebUI or LM Studio?

[dmitrii-khizbullin]

Hi @tigercj2010-Jeff! Thank you for your interest to the project. We did not check local models yet. If you make the necessary changes, your PR is absolutely welcome.