ai-agent

Rbg

Name: Rbg
Author: sgl-project

A workload for deploying LLM inference services on Kubernetes

229 stars60 forksGoUpdated 6/10/2026100% free · open source

About this skill

A workload for deploying LLM inference services on Kubernetes

Topics

k8s

llm

pd-disagg

sglang

What's inside — free to inspect

No purchase needed

Read the entire source before you build — unlike paid marketplaces that hide it behind a buy button.

top-level files

folders

37.7M

repo size

Apache-2.0

license

Key files

README-zh_CN.md

README.md

File tree

.github/

api/

client-go/

cmd/

config/

deploy/

doc/

examples/

hack/

internal/

keps/

pkg/

test/

tools/

vendor/

version/

.coveralls.yml

.dockerignore

.gitignore

.golangci.yml

.yamllint.yml

CONTRIBUTING.md

Dockerfile

go.mod

Quick Actions

Details

Creator

sgl-project

Language

Related skills

More ai-agent tools founders pair with this one.

ai-agent★ 173,241

ollama: Run AI models

Get AI models up and running with ollama. For founders using Go and AI.

ai-agent★ 168,458

Improve Code with andrej-karpathy-skills

Get better code behavior with andrej-karpathy-skills, 165k+ GitHub stars, for founders using LLMs.

ai-agent★ 161,315

Transformers: AI Models

Get state-of-the-art machine learning models with Transformers, for startup founders, with 161k+ GitHub stars.

ai-agent★ 104,971

Gemini CLI

An open-source AI agent that brings the power of Gemini directly into your terminal.

ai-agent★ 82,731

Vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

ai-agent★ 81,981

RAGFlow: Smarter LLM Context

Get a superior context layer for LLMs with RAGFlow, a retrieval-augmented generation engine, ideal for founders in AI, with 82k+ GitHub stars.