mirror of
https://github.com/danny-avila/LibreChat.git
synced 2026-10-22 10:02:41 +00:00
Enhanced ChatGPT Clone: Features Agents, MCP, DeepSeek, Anthropic, AWS, OpenAI, Responses API, Azure, Groq, o1, GPT-5, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, Code Interpreter, langchain, DALL-E-3, OpenAPI Actions, Functions, Secure Multi-User Auth, Presets, open-source for self-hosting. Active.
https://librechat.ai/
aianthropicartifactsawsazurechatgptchatgpt-cloneclaudeclonedeepseekgeminigooglegpt-5librechatmcpo1openairesponses-apivisionwebui
e1f2298cb8
* 🗓️ fix: Surface a Run Now Scheduled Chat in the Sidebar Run Now left the conversation list untouched, so the chat it started was invisible until a reload. Refetching the list on success would not have fixed it either: run-now answers once the trigger delivery is durable, and the generation that writes the conversation starts after that, so the refetch comes back without the chat. Seed the row instead, from the id the response already names and the cached schedule's name and agent, resolving the destination project the same way the fire path does so it lands in that project's list and no other. Report the started generation to the active-job list and re-arm it, since it stops polling while nothing is listed and is the only thing that can show the row as running. * 🩹 fix: Wait for the Run to be Admitted Instead of Seeding a Row Codex found four ways the optimistic row goes wrong, three of them inherent to seeding a chat the server has not created: it is assembled from a client snapshot of the schedule that another tab may have moved on from, it outlives a delivery that never admits, and it can be opened before the conversation exists, which bounces that tab to a new chat it never recovers from. The conversation route answers 404 until the generation's first write commits and applies the same visibility rule the list query does, so it is an exact admission probe: a 200 means the chat is listable now and carries the server's own row. Wait on that instead, over a bounded set of probes, and add what came back. Nothing is written for a run that never admits. Re-arming the active-job poll moves to admission too, where a generation is known to exist, rather than at the click, where the thirty-second grace can lapse before a retried dispatch ever starts one. * 🩹 fix: Cover the Delivery Retry Window and Keep Transient Probes Alive Two follow-ups from codex on the admission watch. The probe budget stopped at forty-three seconds, inside the window the server is still willing to admit in: the trigger engine allows eight attempts backing off from a second and doubling, about two minutes of retries at worst. Widen to roughly five minutes across eleven probes, which covers that twice over. A dispatch refused with a long Retry-After can still be re-driven hours later; a watch held open for that is worse than the list refetch that already covers it. Ending the watch on any non-404 also gave up on failures that say nothing about the run: a 5xx, or a request that never got a response, is the probe failing while the durable delivery is still free to admit. Only a 4xx that is not 404 settles the matter. * 🩹 fix: Fence the Admission Watch to its Session and Queue its Title Two more from codex, both real. The watch can run for minutes, and signing out or signing in as someone else empties the query cache in between. A response arriving after that wrote one user's chat into another's sidebar. Fence it: capture who the cache belonged to when the watch started, and check again before probing and before writing. A conversation admitted mid-run has not been titled yet, so the row lands as "New Chat". The foreground paths hand that to the title queue, which already owns the timing the server was configured for; a scheduled run has no foreground path, so hand it over here instead of leaving the placeholder until an unrelated refetch. Not taken: widening the probe budget again to cover the trigger host's per-attempt timeout. That is the third arithmetic for the same knob, and no fixed budget closes the class — a Retry-After refusal can defer admission by up to a day. The ceiling is deliberate and the miss degrades to the next list refetch. * 🩹 fix: Honour Retryable Statuses and Keep Archived Chats Out of the Sidebar Two narrow ones from codex, plus a test-coupling bug they exposed. 408 and 429 ask to be retried by definition, and a proxy in front of the app can raise either without the run being involved, so a blanket "any 4xx but 404 is terminal" abandoned a watch over something that was going to resolve. The conversation route serves an archived chat while the list query filters one out, so a run archived from another tab between its first write and the next probe would land a row in the sidebar that no refetch agrees belongs there. The archive was deliberate; leave it alone. The archived-row assertion passed at first against the missing guard, because `clearAllMocks` leaves an undrained `mockRejectedValueOnce` queued for the next test, where it answered the first probe. Reset implementations between tests so one test's leftovers cannot vouch for another's. * 🩹 fix: Bind the Session Fence Late When the User Query is Still Loading The fence I added last round read an unloaded user cache as an identity. A run started before that query resolved captured `undefined`, and the account's own arrival then looked like the cache changing hands, so the watch abandoned a run it should have tracked — the fence failing closed on the feature it was protecting. Run-now answering 200 is itself proof a session existed at the click, so an empty entry then is a cache still loading rather than nobody signed in. Bind the owner on first sight instead, and fence only once one is known. Also restores import order in the spec, which is what Static checks caught: a later edit added an import without re-running the sorter. * 🩹 fix: Refuse the Write While the Cache Owner is Unknown Last round's fence compared only once an owner was known, which left the hole it was built to close: a run started before the user query resolved kept an undefined baseline, so a sign-in arriving while the probe was in flight was never noticed and one account's chat could seed another's cache. An unknown owner cannot be compared, so it cannot be seen to change either — "still loading" and "changed hands" are the same reading. Refuse the write instead. A late-resolving query still binds and still tracks, because that happens before the probe; only the genuinely ambiguous case is dropped, and every caller of this has a signed-in session. The tests now sign in, which is the only state this runs in, and the one that starts signed out keeps its premise so the boundary stays pinned from both sides. * 🩹 fix: Write the Session Fence Once and Mirror Foreground Project Bookkeeping Four rounds of fence patches each fixed one cell of a three-state problem and broke another. Write it as one state machine instead, on the property that makes it tractable: the server enforces ownership on the probe itself, so a request sent under one account can never return another's chat, and the only dangerous response is one sent under the account that clicked and landing after someone else signed in. So the owner is bound only from a reading taken before a probe goes out, a successful probe with no baseline yet is skipped rather than abandoned, and once bound any different reading ends the watch. Mirror the foreground path's project bookkeeping: a chat filed under a project moves that project's count and recent-activity ordering, which live on the project rows the conversation caches never touch. The watch moves to its own module so the schedules panel can hand it an automatic occurrence, and a run announced twice — by the click and by the poll that then lists it — is watched once. |
||
|---|---|---|
| .claude/skills | ||
| .devcontainer | ||
| .github | ||
| .husky | ||
| .vscode | ||
| api | ||
| client | ||
| config | ||
| docs | ||
| e2e | ||
| helm | ||
| otel/langfuse-fanout | ||
| packages | ||
| redis-config | ||
| scripts | ||
| search | ||
| skill | ||
| src/tests | ||
| utils | ||
| .codex | ||
| .dockerignore | ||
| .env.example | ||
| .gitattributes | ||
| .gitignore | ||
| .nvmrc | ||
| .prettierrc | ||
| AGENTS.md | ||
| bun.lock | ||
| CLAUDE.md | ||
| CONTEXT.md | ||
| deploy-compose.langfuse-fanout.yml | ||
| deploy-compose.yml | ||
| docker-compose.langfuse-fanout.yml | ||
| docker-compose.override.yml.example | ||
| docker-compose.yml | ||
| Dockerfile | ||
| Dockerfile.multi | ||
| eslint.config.mjs | ||
| librechat.example.yaml | ||
| LICENSE | ||
| package-lock.json | ||
| package.json | ||
| rag.yml | ||
| README.md | ||
| README.zh.md | ||
| tool-intent-spec.md | ||
| turbo.json | ||
LibreChat
English · 中文
🚀 What's New in v0.8.8-rc2
- Agent run control: Interrupt an Agent before visible answer text, steer runs with files and quoted excerpts, durably queue follow-ups, and recover saved partial work with Keep going or Answer now.
- Agent activity: Optional generated labels group reasoning and tool work, fold completed groups into live phase cards, keep generated files visible, summarize multi-step phases, and show the current reasoning direction.
- Human-in-the-loop Agents: Stream up to four related questions, pause for input or tool approval, and resume durably.
- Unified Agent Builder: Configure Skills, MCP, Code Interpreter, orchestration, Programmatic Tool Calling, model-spec controls, and per-tool background and intent settings in one Tools marketplace; Skills can be enabled for standalone runtime authoring without exposing the existing catalog.
- Durable Agent automation: Authenticated Agent Events support bound child actors, expected-action receipts, per-actor mailboxes, event batching, durable human pauses, and automatic detached Actions across built-in stream stores.
- Deeper Subagent history: Browse branch-aware child turns with bounded reasoning and stable live event views, load earlier activity, inspect event details, continue completed child chats, and automatically wake saved parent Agents when detached work settles.
- Background tools: Eligible Code Interpreter, MCP, Plugin, and Action tools can run while an Agent keeps working, with automatic delivery for supported completions and polling controls when needed.
- Code Interpreter workflows: Sandbox images return as viewable artifacts; highly experimental stateful sessions add scoped managed, attached, or personal environments, per-message file downloads, and guarded file-write and command permissions.
- Agent extensibility: Experimental Agent Plugins bundle deployment Skills, MCP servers, and opt-in command hooks; saved Agent teams run as isolated Subagent graphs.
- Scheduled Chats (experimental): Run saved Agents with presets or custom cron, selectable time zones, multi-day weekly cadence, and optional Chat Project destinations.
- Memory and context: Agents can use optionally isolated memory, preserve adaptive context fading across turns, and show categorized current-window usage, tokens, and optional cost.
- Editable long pastes: Long pasted text becomes an editable attachment that can be moved back into the composer; attachment-only turns and reliable Upload as Text downloads are also supported.
- Projects, settings, and navigation: Search conversation titles and message contents, manage project chats, use searchable settings and shortcuts, pin chats, choose clock/week conventions, and navigate faster on mobile.
- Sharing and artifacts: Stable shared links support personal copies; fullscreen previews, Mermaid export, PowerPoint templates, shell scripts, and original Office downloads expand file workflows.
- Web search: Keenable adds keyless search and page fetch, while SearXNG and Tavily gain richer controls and all web-tool egress uses stronger SSRF protection.
- Security and authentication: Default HTTP security headers, opt-in nonce CSP, authenticated local images, per-user Code Interpreter JWTs, stable SAML identity binding, live-session OpenID token refresh, and retired JWT-secret rejection harden deployments.
- Models and reasoning: Added GPT-5.6 with Responses reasoning controls, Claude Fable 5.1, Opus 5, and Sonnet 5, plus Gemini 3.8/3.7/3.6 Flash and Gemini 3.5 Flash-Lite.
- Langfuse observability: Configure encrypted in-app connections, tenant fanout, authenticated gateways, export-decision telemetry, and authorized session links in chats and shared views.
- Administration: Source-aware content filters can audit or block model-bound data, while tenant Insights, delegated configuration, encrypted secrets, and expiring violation scores improve operations.
- Streaming and reliability: Adaptive smoothing, Redis delta batching and failover recovery, automatic generation protocol v2, live MCP catalog refresh, Agent circuit breakers, and DocumentDB support improve long runs and scaled deployments.
Read the full v0.8.8-rc2 changelog.
✨ Features
-
🖥️ UI & Experience inspired by ChatGPT with enhanced design and features
-
🤖 AI Model Selection:
- Anthropic (Claude), AWS Bedrock, OpenAI, Azure OpenAI, Google, Vertex AI, OpenAI Responses API (incl. Azure)
- Custom Endpoints: Use any OpenAI-compatible API with LibreChat, no proxy required
- Compatible with Local & Remote AI Providers:
- Ollama, groq, Cohere, Mistral AI, Apple MLX, koboldcpp, together.ai,
- OpenRouter, Helicone, Perplexity, ShuttleAI, Deepseek, Qwen, and more
-
- Secure, Sandboxed Execution in Python, Node.js (JS/TS), Go, C/C++, Java, PHP, Rust, and Fortran
- Seamless File Handling: Upload, process, and download files directly
- No Privacy Concerns: Fully isolated and secure execution
- Open-Source & Self-Hostable: powered by ClickHouse/code-interpreter
-
🔦 Agents & Tools Integration:
- LibreChat Agents:
- No-Code Custom Assistants: Build specialized, AI-driven helpers
- Agent Marketplace: Discover and deploy community-built agents
- Collaborative Sharing: Share agents with specific users and groups
- Flexible & Extensible: Use MCP Servers, tools, file search, code execution, and more
- Skills: Create reusable
SKILL.mdinstruction bundles for manual, automatic, or always-on agent workflows - Agent Plugins: Experimentally bundle deployment Skills and MCP servers into startup-loaded packages
- Subagents: Delegate focused work to isolated child agent runs with their own context windows
- Compatible with Custom Endpoints, OpenAI, Azure, Anthropic, AWS Bedrock, Google, Vertex AI, Responses API, and more
- Model Context Protocol (MCP) Support for Tools
- LibreChat Agents:
-
🔍 Web Search:
- Search the internet and retrieve relevant information to enhance your AI context
- Combines search providers, content scrapers, and result rerankers for optimal results
- Customizable Jina Reranking: Configure custom Jina API URLs for reranking services
- Learn More →
-
🪄 Generative UI with Code Artifacts:
- Code Artifacts create React, HTML, and Mermaid content directly in chat
- Open previews fullscreen and export Mermaid diagrams as SVG or PNG
-
🎨 Image Generation & Editing
- Text-to-image and image-to-image with GPT-Image-1
- Text-to-image with DALL-E (3/2), Stable Diffusion, Flux, or any MCP server
- Produce stunning visuals from prompts or refine existing images with a single instruction
-
💾 Presets & Context Management:
- Create, Save, & Share Custom Presets
- Switch between AI Endpoints and Presets mid-chat
- Edit, Resubmit, and Continue Messages with Conversation branching
- Create and share prompts with specific users and groups
- Fork Messages & Conversations for Advanced Context control
-
💬 Multimodal & File Interactions:
- Upload and analyze images with Claude 3, GPT-4.5, GPT-4o, o1, Llama-Vision, and Gemini 📸
- Chat with Files using Custom Endpoints, OpenAI, Azure, Anthropic, AWS Bedrock, & Google 🗃️
-
🌎 Multilingual UI:
- English, 中文 (简体), 中文 (繁體), العربية, Deutsch, Español, Français, Italiano
- Polski, Português (PT), Português (BR), Русский, 日本語, Svenska, 한국어, Tiếng Việt
- Türkçe, Nederlands, עברית, Català, Čeština, Dansk, Eesti, فارسی
- Suomi, Magyar, Հայերեն, Bahasa Indonesia, ქართული, Latviešu, ไทย, ئۇيغۇرچە
-
🧠 Reasoning UI:
- Dynamic Reasoning UI for Chain-of-Thought/Reasoning AI models like DeepSeek-R1
-
🎨 Customizable Interface:
- Customizable Dropdown & Interface that adapts to both power users and newcomers
-
- Never lose a response: AI responses automatically reconnect and resume if your connection drops
- Multi-Tab & Multi-Device Sync: Open the same chat in multiple tabs or pick up on another device
- Production-Ready: Works from single-server setups to horizontally scaled deployments with Redis
-
🗣️ Speech & Audio:
- Chat hands-free with Speech-to-Text and Text-to-Speech
- Automatically send and play Audio
- Supports OpenAI, Azure OpenAI, and Elevenlabs
-
📥 Import & Export Conversations:
- Import Conversations from LibreChat, ChatGPT, Chatbot UI
- Export conversations as screenshots, markdown, text, json
-
🔍 Search & Discovery:
- Search all messages/conversations
-
👥 Multi-User & Secure Access:
- Multi-User, Secure Authentication with OAuth2, LDAP, & Email Login Support
- Built-in Moderation, and Token spend tools
-
🎛️ Admin Panel:
- Browser-based UI to manage users, groups, roles, and configuration overrides
- Edit settings and per-role/group permissions live, without redeploying
- Bundled with the Docker Compose stacks for one-command setup
-
⚙️ Configuration & Deployment:
- Configure Proxy, Reverse Proxy, Docker, & many Deployment options
- Use S3 with CloudFront for stable media links, edge delivery, signed cookies, and secured downloads
- Use completely local or deploy on the cloud
-
📖 Open-Source & Community:
- Completely Open-Source & Built in Public
- Community-driven development, support, and feedback
For a thorough review of our features, see our docs here 📚
🪶 All-In-One AI Conversations with LibreChat
LibreChat is a self-hosted AI chat platform that unifies all major AI providers in a single, privacy-focused interface.
Beyond chat, LibreChat provides AI Agents, Model Context Protocol (MCP) support, Artifacts, Code Interpreter, custom actions, conversation search, and enterprise-ready multi-user authentication.
Open source, actively developed, and built for anyone who values control over their AI infrastructure.
🌐 Resources
GitHub Repo:
- RAG API: github.com/danny-avila/rag_api
- Website: github.com/LibreChat-AI/librechat.ai
Other:
- Website: librechat.ai
- Documentation: librechat.ai/docs
- Blog: librechat.ai/blog
📝 Changelog
Keep up with the latest updates by visiting the releases page and notes:
⚠️ Please consult the changelog for breaking changes before updating.
⭐ Star History
✨ Contributions
Contributions, suggestions, bug reports and fixes are welcome!
For new features, components, or extensions, please open an issue and discuss before sending a PR.
If you'd like to help translate LibreChat into your language, we'd love your contribution! Improving our translations not only makes LibreChat more accessible to users around the world but also enhances the overall user experience. Please check out our Translation Guide.
💖 This project exists in its current state thanks to all the people who contribute
🎉 Special Thanks
We thank Locize for their translation management tools that support multiple languages in LibreChat.