Couchbase Adds Managed Agent Memory and Semantic Caching to AI Data Plane

Couchbase expanded its AI Data Plane on Oct. 20 with managed agent memory and semantic caching, giving companies ways to reduce repeated model requests and context loading as they run AI agents. In Couchbase's semantic caching tests, reusing stored results for similar requests cut large language model calls by 40% to 60%. Agent Memory used 33% to 45% fewer tokens than leading alternatives on the LoCoMo benchmark. Vector-based retrieval generated prompts 70% smaller than full-context alternatives.

Source: TokenPost