Librechat, developed by Danny Avila, is a free, self-hosted AI chat platform built with TypeScript and Node.js. It functions as an open-source AI platform, integrating diverse AI models and external services through the Model Context Protocol (MCP). Deployable via Docker Compose, npm, or Helm Chart, Librechat provides a unified interface for AI interaction. It supports various AI providers and offers extensive customization for private AI infrastructure. This platform is ideal for teams seeking control over their AI deployments.

What does Librechat connect to?

Librechat serves as a unified AI chat platform, connecting to many AI models and providers. These include OpenAI, Anthropic, Google (Vertex AI, Gemini), Azure OpenAI, AWS Bedrock, Groq, DeepSeek, OpenRouter, Ollama, and Mistral AI. It also supports custom endpoints. Beyond AI models, Librechat integrates with external tools and services using the Model Context Protocol (MCP), such as file systems, web browsers, specialized APIs, and custom business tools.

Core features and tools

Librechat exposes various callable tools. Built-in agent tools include OpenAI Image Tools, Gemini Image Tools, DALL-E-3, Flux, Stable Diffusion, Wolfram, OpenWeather, Google Search, Calculator, Tavily Search, and Azure AI Search. It features a Code Interpreter for Python, JavaScript, TypeScript, Go, C, C++, Java, PHP, Rust, and Fortran. Web Search is also available. Custom tools are supported via MCP servers and OpenAPI-schema-described HTTP APIs through Actions.

Who is it for?

Librechat targets developers, teams, and enterprises desiring control over their AI infrastructure. It suits those needing a private and adaptable alternative to hosted AI chat services. Regulated teams, such as healthcare providers and financial institutions, will find its self-hosting capabilities beneficial for private data interaction. This platform is designed for organizations prioritizing data privacy and custom integration. Skip this if you require a fully managed, third-party hosted AI chat solution without any local setup.

How to get started

Access is granted through a standard OAuth authorization flow, or via email/password, OpenID Connect, SAML, and LDAP. For production, unique and securely stored JWT_SECRET and REFRESH_SECRET values are required.

Use cases

• Unified AI Chat and Agent Orchestration: Interact with diverse AI models and create custom agents with tools for general AI interaction and task automation.
• Secure Enterprise AI Integration: Self-hosted deployments connect with internal systems via MCP, using strong authentication and granular access control for private data.
• Code Interpretation and Development Assistance: Developers use the secure Code Interpreter for multi-language code execution, file processing, and AI-assisted coding.

Librechat offers a powerful, self-hosted AI chat platform for managing diverse AI models and external integrations. Its extensive authentication options and granular access control make it suitable for regulated environments. The platform's ability to execute code and orchestrate agents provides significant utility for development and automation.