Popular repositories Loading

1. manifests manifests Public

   Forked from kubeflow/manifests

   A repository for Kustomize manifests

   YAML

2. vllm-fork vllm-fork Public

   Forked from HabanaAI/vllm-fork

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

3. llm-d llm-d Public

   Forked from llm-d/llm-d

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell

4. Enterprise-Inference Enterprise-Inference Public

   Forked from opea-project/Enterprise-Inference

   Intel® AI for Enterprise Inference optimizes AI inference services on Intel hardware using Kubernetes Orchestration. It automates LLM model deployment for faster inference, resource provisioning, a…

   Python

5. agent-x agent-x Public

   A repo contains code for creating, managing and orchestrating Agents

   Python

6. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python