Pinned Loading

1. llm-d/llm-d llm-d/llm-d Public

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell 3.2k 473

2. kserve/kserve kserve/kserve Public

   Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

   Go 5.5k 1.5k

3. llm-d/llm-d-router llm-d/llm-d-router Public

   llm-d Router: The intelligent entry point for inference requests

   Go 186 200

4. knative/eventing knative/eventing Public

   Event-driven application platform for Kubernetes

   Go 1.5k 630