Allow using 3rd party AI services that are compatible with OpenAI API format in the openai-gpt
agent
#331
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR Summary
Add support for users to user an AI endpoint whose API is compatible with OpenAI API format.
Azure OpenAI
It requires the
endpoint
,deployment name
, and themodel name
.Public OpenAI
It requires the
model name
. No endpoint, no deployment name.OpenAI-compatible AI endpoint
It requires the
endpoint
andmodel name
. Nodeployment name
.CompatibleThirdParty
is added as a newEndpointType
member.Many LLM tools can setup local or remote API endpoint that is compatible with OpenAI API format for users to call a model hosted by the tool, such as Ollama, LM Studio, LocalAI. The DeepSeek v3 and Google Gemini also provide OpenAI compatibility for their API endpoints.
To add an GPT targeting DeepSeek or Google Gemini, add the following to the
openai.agent.json
file: