analytics

openlit: AI Observability

Name: openlit: AI Observability
Author: openlit

Get AI engineering insights with openlit. For startup founders, with 2.6k+ GitHub stars.

2,581 stars319 forksTypeScriptQuality 8/10Updated 7/7/2026100% free · open source

What it does

OpenLit provides AI engineering insights by offering a platform for Observability, Monitoring, and Management of Large Language Models (LLMs) with integration to over 50 LLM providers and other AI tools

Install / run

git clone https://github.com/openlit/openlit.git

When to use it

•When you need to monitor and optimize the performance of your LLMs in production
•When integrating multiple LLM providers and want a unified dashboard for management
•When you require advanced features like guardrails, evaluations, and prompt management for your AI engineering workflow

Quick start

1Navigate to the cloned repository: cd openlit
2Follow the setup instructions in the README to configure your environment, including setting up necessary integrations and variables
3Review the configuration options in the provided example files to tailor OpenLit to your specific use case
4Run the platform locally or deploy it to your preferred production environment
5Explore the web interface or API to start managing your LLMs and accessing insights

Ready-to-paste prompt

Run a sample evaluation with a specific LLM provider by executing a command similar to what's outlined in the OpenLit documentation, e.g., using the CLI to start an evaluation task

Heads up: Ensure you have the necessary prerequisites installed, such as Node.js and TypeScript, and be aware that some features might require setting up API keys for the integrated LLM providers and other services

Saves to your device