Skip to content

docs(openai): add Auxen as OpenAI-compatible provider example#5586

Closed
ai-auxen wants to merge 1 commit into
pydantic:mainfrom
auxen-ai:auxen
Closed

docs(openai): add Auxen as OpenAI-compatible provider example#5586
ai-auxen wants to merge 1 commit into
pydantic:mainfrom
auxen-ai:auxen

Conversation

@ai-auxen
Copy link
Copy Markdown

Adds an Auxen section to `docs/models/openai.md` under "OpenAI-compatible Models", positioned before the existing DeepSeek entry.

Auxen hosts per-customer dedicated LLM endpoints (Llama 3.1/3.2, Qwen 2.5, Mistral, Gemma 2, Mixtral, Phi-3, Command R) with an OpenAI-compatible `/v1/chat/completions` API. Each instance is a dedicated GPU billed per-minute of runtime.

Docs-only on purpose

Unlike the existing named providers (Fireworks, Together, DeepSeek, etc.) which have fixed shared base URLs, every Auxen instance has its own per-instance base URL of the form `https://api.auxen.ai/v1/inst_xxx/v1\`. There is no shared default endpoint to encode in a dedicated provider class, so the docs use the generic `OpenAIProvider` with explicit `base_url` and `api_key` — same shape the docs already recommend for arbitrary OpenAI-compatible endpoints.

Happy to also add a dedicated `AuxenProvider` class (that takes `base_url` and `api_key` as required arguments) if the team would prefer that shape — let me know.

Companion PRs (Auxen distribution series)

AI agent (Claude) assisted in drafting this PR.

@github-actions github-actions Bot added size: S Small PR (≤100 weighted lines) docs Improvements or additions to documentation labels May 22, 2026
@dsfaccini dsfaccini added the pydanty:promotional Managed by pydanty dogfooding automation label May 25, 2026
@dsfaccini
Copy link
Copy Markdown
Collaborator

David's AICA here: Thanks for taking the time to put this together. We don't feel comfortable using the Pydantic AI docs to promote or catalogue third-party OpenAI-compatible services, since inclusion there can read as an endorsement or preferred integration. This can already be used with the existing OpenAI-compatible provider configuration, and you're welcome to keep setup instructions in your own docs for users who want to connect it to Pydantic AI. Closing as not planned.

@dsfaccini dsfaccini closed this May 25, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

docs Improvements or additions to documentation pydanty:promotional Managed by pydanty dogfooding automation size: S Small PR (≤100 weighted lines)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants