Skip to content
This repository was archived by the owner on Mar 29, 2026. It is now read-only.

Does Vanna2.0 support connecting with vLLM? #1104

Description

@viphonestsong

My environment uses an Oracle database, and the large model is deployed locally via vLLM. On the official website, I only found documentation for OpenAI or Ollama, but no instructions for a locally deployed vLLM model.
I would like to know:

  1. Does Vanna 2.0 support locally deployed vLLM, or large models that follow the OpenAI-compatible API specification?
  2. If not, can I implement support by extending the code myself?
  3. Could you provide some guidance and hints? Thank you.🙇‍

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions