The marketplace for AI skills that launch offers, rank in AI search, and automate operations. No coding required.

Marketplace

Browse Skills
AI Agents
Claude Skills
MCP Servers
Prompts

Solutions

For Founders
For Agencies
For Ecommerce
Agent Builder
Starter Packs
Playbooks

Learn

How It Works
What Are Skills
What Are Agents
What Is MCP
For Creators
Submit a Tool
Security

Company

Become a Creator
About
Enterprise
API Docs
Terms
Privacy
Support

Compatible with

🤖ChatGPT

✨Claude

💎Gemini

🛍️Shopify

🔍Ahrefs

📊Sheets

💬WhatsApp

📱Meta Ads

+50 moreCreator program →

© 2026 WorkflowStacks. All rights reserved.

Terms Privacy Support

ai-agent

Paddler

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and sim…

1,591 stars90 forksRustUpdated 6/9/2026100% free · open source

About this skill

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

Topics

ai

llamacpp

llm

llmops

load-balancer

What's inside — free to inspect

No purchase needed

Read the entire source before you build — unlike paid marketplaces that hide it behind a buy button.

23

top-level files

25

folders

9.3M

repo size

Apache-2.0

license

Key files

.editorconfig

eslint.config.js

package.json

README.md

tsconfig.json

File tree

.claude/

.config/

.github/

example/

fixtures/

jarmuz/

paddler_agent/

paddler_balancer/

paddler_bootstrap/

paddler_cache_dir/

paddler_cli/

paddler_cli_tests/

paddler_client/

paddler_client_javascript/

paddler_client_python/

paddler_download_manager/

paddler_gui/

paddler_messaging/

paddler_openai_client_python_test/

paddler_openai_response_format_validator/

paddler_state_conversion/

paddler_test_cluster_harness/

paddler_tests/

resources/

Quick Actions

Details

Creator

intentee

Language

Rust

Category

ai-agent

Published

4/27/2024

Are you the creator of this tool? Claim your listing → and earn 85% of every sale.

Related skills

More ai-agent tools founders pair with this one.

ai-agent★ 173,241

ollama: Run AI models

Get AI models up and running with ollama. For founders using Go and AI.

ai-agent★ 168,458

Improve Code with andrej-karpathy-skills

Get better code behavior with andrej-karpathy-skills, 165k+ GitHub stars, for founders using LLMs.

ai-agent★ 161,315

Transformers: AI Models

Get state-of-the-art machine learning models with Transformers, for startup founders, with 161k+ GitHub stars.

ai-agent★ 104,971

An open-source AI agent that brings the power of Gemini directly into your terminal.

ai-agent★ 82,731

A high-throughput and memory-efficient inference and serving engine for LLMs

ai-agent★ 81,981

RAGFlow: Smarter LLM Context

Get a superior context layer for LLMs with RAGFlow, a retrieval-augmented generation engine, ideal for founders in AI, with 82k+ GitHub stars.