* 🚐 perf: Enable Redis Stream Coalescing by Default
* fix: Preserve Legacy Chunk Frames in Coalesced Publications
* fix: Align Coalesced Publication and Append Size Thresholds
---------
Co-authored-by: Lia <lia@librechat.ai>
4.3 KiB
Upgrading LibreChat
Redis streaming now coalesces deltas by default
Redis-backed streams now batch model and tool-argument deltas in a 25 ms
window when STREAM_DELTA_COALESCE_MS is unset. Explicit 0 keeps per-delta
publication; existing explicit values retain their behavior. In-memory streams
are unchanged, including deployments using USE_REDIS_STREAMS=false.
The same window batches durable appends and publications. It reduces Redis round trips and repeated guard/TTL work, but not Pub/Sub message count at the cost of up to one window of buffering latency and possible loss of unflushed deltas on process crash. Terminal and non-coalescable barriers still flush pending batches before proceeding.
Coalescing batches Redis requests, not the subscriber wire format: each event
still publishes as an individually sequenced chunk frame. Subscribers from
before batch-frame support can read these publications without a preparatory
configuration change. New subscribers also retain chunk_batch decoding for
interoperation with existing opt-in batching producers.
This removes the new default's batch-frame compatibility hazard; it does not
promise compatibility across unrelated generation-protocol changes. If an
existing producer already emits chunk_batch frames through explicit opt-in,
keep those producers away from subscribers that predate batch-frame support,
or disable coalescing on those producers before introducing older subscribers.
Tenant index migration (v0.8.7 and earlier databases)
Upgrading an existing database can log Index build failed for User, Role,
Preset, AccessRole, MCPServer, AgentCategory, Message, or Conversation. Older
unique indexes (for example email_1 or name_1) conflict with current non-unique
indexes of the same name. Tenant-scoped compound indexes now enforce uniqueness.
This also affects single-tenant deployments. See #15759 (successor to #14826).
The tenant-index migration is an explicit maintenance command; startup does not
run it automatically. Use the updated code/image containing this command. For a
source checkout, install dependencies and build the packages first (npm run build:packages).
-
Back up MongoDB and stop all LibreChat API replicas and workers that write to the database. Keep MongoDB available throughout the migration.
-
Preview known legacy unique indexes using the deployment's
MONGO_URIand connection settings from.env:npm run migrate:tenant-indexes:dry-run -
Apply the migration:
npm run migrate:tenant-indexesWith Docker Compose, stop the API and run a one-off container from the updated image while MongoDB remains running. Use the same Compose file flags as your deployment (for example,
docker compose -f deploy-compose.yml). Set the working directory to/app, where the root npm scripts live; the production API image otherwise defaults to/app/api:docker compose stop api docker compose run --rm --no-deps -w /app api npm run migrate:tenant-indexes:dry-run docker compose run --rm --no-deps -w /app api npm run migrate:tenant-indexes docker compose up -d api -
Restart writers only after the command exits successfully (status 0). Verify that startup no longer reports these index conflicts.
The command first builds tenant-scoped unique indexes, then drops only known
superseded unique indexes, and explicitly creates current schema indexes for the
affected collections. It preserves custom indexes and current non-unique indexes;
it does not delete documents or use syncIndexes/dropIndexes. Automatic index
creation is disabled in the maintenance process to prevent races, even when the
server normally enables it. Current indexes are explicitly built even if the
server uses MONGO_AUTO_INDEX=false.
The dry run only lists removals: it does not validate replacement builds, database permissions, or duplicate data. Any listing, dropping, or building error makes the apply command fail. If replacement creation fails (for example due to existing duplicates or unsupported database index options), no old constraints have been dropped. Keep writers stopped, correct the reported problem, and rerun. A later failure can leave a partial migration; rerunning safely completes it. Index builds may take time on large collections. Do not drop all indexes to resolve a failure.