Anyone has this running via openwebui and locally hosted models?

[snizzleorg]

Hi,
thanks for this great tool. It works very nicely via Claude but... it would be better to be able to run with locally hosted models in order to avoid GDPR and privacy issues. Anyone has had success with this? And if what are the recommendations?

Thanks again!

[Erudition]

I think it requires a pretty smart model, as the tool API is not very agent-friendly, and constantly makes mistakes before getting the calls right to make the MCP server happy. Otherwise, sure, local models all the way.