Find compatible AI models for your hardware with llmfit, a tool for founders, with 29k+ GitHub stars.
29,171 stars1,783 forksRustQuality 9/10Updated 7/7/2026100% free ยท open source
What it does
Llmfit helps founders find compatible AI models that can run on their specific hardware with a single command, simplifying the process of selecting appropriate models for their projects.
Install / run
cargo install llmfit
When to use it
โขWhen you need to quickly determine which AI models can run on your local machine without extensive research.
โขWhen you're working with limited hardware resources and need to optimize AI model selection for performance.
โขWhen you want to explore and compare various AI models from different providers to find the best fit for your startup's needs.
Quick start
1Run `llmfit discover` to find compatible models for your hardware.
2Use `llmfit list` to view a list of available models and providers.
3Utilize `llmfit info <model_name>` to get detailed information about a specific model.
4Filter results by specifying a provider with `llmfit discover --provider <provider_name>`.
5Save your favorite models for easy reference with `llmfit favorites add <model_name>`.
Ready-to-paste prompt
llmfit discover --provider huggingface
Heads up: Ensure you have Rust and Cargo installed on your system, as llmfit is built with Rust and relies on Cargo for installation and management.
Saves to your device
Topics
gguf
llm
localai
mlx
skill
unsloth
What's inside โ free to inspect
No purchase needed
Read the entire source before you build โ unlike paid marketplaces that hide it behind a buy button.