workflowstacks

The marketplace for AI skills that launch offers, rank in AI search, and automate operations. No coding required.

๐•โšก๐Ÿ’ฌ

Marketplace

  • Browse Skills
  • AI Agents
  • Claude Skills
  • MCP Servers
  • Prompts

Solutions

  • For Founders
  • For Agencies
  • For Ecommerce
  • Agent Builder
  • Starter Packs
  • Playbooks

Learn

  • How It Works
  • What Are Skills
  • What Are Agents
  • What Is MCP
  • For Creators
  • Submit a Tool
  • Security

Company

  • Become a Creator
  • About
  • Enterprise
  • API Docs
  • Terms
  • Privacy
  • Support
Compatible with
๐Ÿค–ChatGPT
โœจClaude
๐Ÿ’ŽGemini
๐Ÿ›๏ธShopify
๐Ÿ”Ahrefs
๐Ÿ“ŠSheets
๐Ÿ’ฌWhatsApp
๐Ÿ“ฑMeta Ads
+50 moreCreator program โ†’

ยฉ 2026 WorkflowStacks. All rights reserved.

TermsPrivacySupport
ai-agent

TensorRT-Edge-LLM: Fast AI Inference

Get high-performance AI inference with TensorRT-Edge-LLM, for founders building physical AI products.
456 stars83 forksPythonQuality 8/10Updated 7/3/2026100% free ยท open source
What it does

TensorRT-Edge-LLM enables high-performance AI inference for physical AI products by optimizing large language models and vision models for edge devices

Install / run
git clone https://github.com/NVIDIA/TensorRT-Edge-LLM.git
When to use it
  • โ€ขBuilding a smart home device that requires real-time voice or image processing
  • โ€ขDeveloping an autonomous robot that needs to quickly process visual or auditory data
  • โ€ขCreating a wearable device that requires low-latency AI-driven insights
Quick start
  1. 1Navigate to the cloned repository: cd TensorRT-Edge-LLM
  2. 2Build the TensorRT-Edge-LLM library: mkdir build && cd build && cmake .. && make
  3. 3Run the sample inference application: ./sample_inference
  4. 4Modify the config file (e.g. config.json) to suit your specific use case
  5. 5Use the provided Python API (e.g. trt_edge_llm.py) to integrate with your application
Ready-to-paste prompt
Run the sample inference application with a custom prompt: ./sample_inference -m models/bert-base-uncased.pt -p 'What is the capital of France?'
Heads up: Ensure you have the necessary NVIDIA hardware and software dependencies installed, including CUDA and cuDNN, to run TensorRT-Edge-LLM
Saves to your device
What's inside โ€” free to inspect
No purchase needed

Read the entire source before you build โ€” unlike paid marketplaces that hide it behind a buy button.

19
top-level files
13
folders
50.7M
repo size
Apache-2.0
license
Key files
.pre-commit-config.yaml
AGENTS.md
README.md
requirements-server.txt
requirements.txt
File tree
.claude/
.github/
3rdParty/
cmake/
cpp/
docs/
examples/
experimental/
kernelSrcs/
scripts/
tensorrt_edgellm/
tests/
unittests/
.clang-format
.dockerignore
.gitattributes
.gitignore
.gitmodules
.pre-commit-config.yaml
AGENTS.md
CHANGELOG.md
CMakeLists.txt
CODE_OF_CONDUCT.md
CODING_GUIDELINES.md
Quick Actions
Details
Creator
NVIDIA
Language
Python
Category
ai-agent
Published
10/2/2025

Are you the creator of this tool? Claim your listing โ†’ and earn 85% of every sale.

Related skills

More ai-agent tools founders pair with this one.

ai-agentโ˜… 512,463
build-your-own-x: Learn by Recreating
Improve programming skills by rebuilding tech from scratch. For startup founders and programmers.
ai-agentโ˜… 450,961
Learn to code with freeCodeCamp
Get free programming education with freeCodeCamp, for startup founders and beginners.
ai-agentโ˜… 439,771
Public-apis: Free API Access
Get free APIs for development. For startup founders and developers.
ai-agentโ˜… 390,947
Free Programming Books
Discover free programming books for founders and developers. Learn with free-programming-books.
ai-agentโ˜… 350,624
coding-interview-university: Learn to Code
Get a complete study plan to become a software engineer, for startup founders, with 351k+ GitHub stars
ai-agentโ˜… 297,550
Selfhosted Control with awesome-selfhosted
Host your own network services and web apps. For founders seeking privacy and control.