[Feature] Is there any Providers can you support instead of OpenAI

[StevenOng97]

As title, I'm wondering do you have any plan to provide another providers? OpenAI is expensive for paid plan, for the free tier It always throw the Rate limit (RPM) when I'm trying to request.

[StevenOng97]

also, I'm wondering do you have a plan to implement Auth for our repo for saving the chat history?

[miurla]

Due to the need for tool calling and JSON output in some parts, it is not possible to replace everything at the moment. However, we have made it possible to specify an API for the final output that does not require these. Please give it a try.

#58