ai-agent

vllm-ascend: Simplify AI

Name: vllm-ascend: Simplify AI
Author: vllm-project

Get community maintained hardware plugin for vLLM on Ascend, ideal for founders, with 2.2k+ GitHub stars

2,177 stars1,316 forksC++Quality 8/10Updated 6/2/2026100% free · open source

About this skill

Community maintained hardware plugin for vLLM on Ascend

Topics

ascend

inference

llm

llm-serving

llmops

mlops

model-serving

transformer

vllm

What's inside — free to inspect

No purchase needed

Read the entire source before you build — unlike paid marketplaces that hide it behind a buy button.

top-level files

folders

45.4M

repo size

Apache-2.0

license

Key files

.pre-commit-config.yaml

AGENTS.md

README.md

README.zh.md

requirements-dev.txt

requirements-lint.txt

File tree

.agents/

.claude/

.gemini/

.github/

benchmarks/

cmake/

csrc/

docs/

examples/

tests/

tools/

vllm_ascend/

.clang-format

.gitignore

.gitmodules

.markdownlint.yaml

.pre-commit-config.yaml

.readthedocs.yaml

AGENTS.md

CLAUDE.md

CMakeLists.txt

CODE_OF_CONDUCT.md

codecov.yml

collect_env.py

Quick Actions

Details

Creator

vllm-project

Language

C++

Related skills

More ai-agent tools founders pair with this one.

ai-agent★ 173,241

ollama: Run AI models

Get AI models up and running with ollama. For founders using Go and AI.

ai-agent★ 168,458

Improve Code with andrej-karpathy-skills

Get better code behavior with andrej-karpathy-skills, 165k+ GitHub stars, for founders using LLMs.

ai-agent★ 161,315

Transformers: AI Models

Get state-of-the-art machine learning models with Transformers, for startup founders, with 161k+ GitHub stars.

ai-agent★ 104,971

Gemini CLI

An open-source AI agent that brings the power of Gemini directly into your terminal.

ai-agent★ 82,731

Vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

ai-agent★ 81,981

RAGFlow: Smarter LLM Context

Get a superior context layer for LLMs with RAGFlow, a retrieval-augmented generation engine, ideal for founders in AI, with 82k+ GitHub stars.