docs(openai): add Auxen as OpenAI-compatible provider example#5586
Closed
ai-auxen wants to merge 1 commit into
Closed
docs(openai): add Auxen as OpenAI-compatible provider example#5586ai-auxen wants to merge 1 commit into
ai-auxen wants to merge 1 commit into
Conversation
Collaborator
|
David's AICA here: Thanks for taking the time to put this together. We don't feel comfortable using the Pydantic AI docs to promote or catalogue third-party OpenAI-compatible services, since inclusion there can read as an endorsement or preferred integration. This can already be used with the existing OpenAI-compatible provider configuration, and you're welcome to keep setup instructions in your own docs for users who want to connect it to Pydantic AI. Closing as not planned. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds an Auxen section to `docs/models/openai.md` under "OpenAI-compatible Models", positioned before the existing DeepSeek entry.
Auxen hosts per-customer dedicated LLM endpoints (Llama 3.1/3.2, Qwen 2.5, Mistral, Gemma 2, Mixtral, Phi-3, Command R) with an OpenAI-compatible `/v1/chat/completions` API. Each instance is a dedicated GPU billed per-minute of runtime.
Docs-only on purpose
Unlike the existing named providers (Fireworks, Together, DeepSeek, etc.) which have fixed shared base URLs, every Auxen instance has its own per-instance base URL of the form `https://api.auxen.ai/v1/inst_xxx/v1\`. There is no shared default endpoint to encode in a dedicated provider class, so the docs use the generic `OpenAIProvider` with explicit `base_url` and `api_key` — same shape the docs already recommend for arbitrary OpenAI-compatible endpoints.
Happy to also add a dedicated `AuxenProvider` class (that takes `base_url` and `api_key` as required arguments) if the team would prefer that shape — let me know.
Companion PRs (Auxen distribution series)
AI agent (Claude) assisted in drafting this PR.