Realtime AI News
Open-source AI gateway Experiential unifies cloud and local models behind one OpenAI-compatible API and caps agent spend
Experiential is an open-source AI gateway and router that puts cloud and local models behind a single OpenAI-compatible API, so teams can manage and optimise quality, speed and cost in one place. It also issues per-employee and per-agent API keys that let operators see, and control, how much their AI agents spend.
On September 21, GIGAZINE looked at Experiential, an open-source AI gateway and router published by Experiential Labs that gathers cloud and local models behind a single OpenAI-compatible API and lets operators manage and optimise them for quality, speed and cost.
The problem it targets is familiar. Teams that use GPT, Claude, Gemini and others usually configure a separate endpoint and API key for every provider, which scatters usage tracking and billing across dashboards. Experiential sits in between: an agent configures one OpenAI-compatible API and reaches every provider behind it.
More than 1,000 models ship in the standard catalogue, covering GPT, Claude and Gemini along with DeepSeek, Qwen, Kimi, GLM, Mistral and llama. Users who already hold provider keys can register them with Experiential and keep using them under a bring-your-own-key arrangement.
For companies, the gateway issues a dedicated Experiential API key per employee or per AI agent while the organisation keeps custody of the upstream provider keys. The Logs view records which key made each request in its request history, and filtering shows which models a given key used, so usage and spend can be attributed in one place.
Experiential also optimises model selection from real traffic. Once an agent's activity is accumulated in OpenTelemetry format, the system evaluates a task across several models and compares quality, latency and price to build a router, sending simple work to cheap fast models and hard work to stronger ones.
There are tier limits to note. The cloud Free plan excludes automatic routing and per-prompt model optimisation, which start at the Pro plan, while Free covers the basics of reaching several models through one API and reviewing usage and cost together. Self-hosted deployments can export history accumulated in tools such as Langfuse, in OpenTelemetry or other formats, and load it into Experiential to build a router.
The point of gateways like this is to turn multi-model use from a pile of per-vendor keys into infrastructure that can be observed, capped and optimised. Once agents call tools and spend money on their own, budget control and cost attribution stop being a finance question and become an engineering one.
The open-source gateway lane is getting crowded. GIGAZINE's related coverage on the same page includes Wayfinder, which switches between local and cloud models by task difficulty. Whether Experiential holds up on routing accuracy, self-hosting effort and billing fidelity is the thing to watch.
Why it matters
For teams running several model providers at once, Experiential pulls keys, usage and billing into one observable gateway and turns agent spend into something that can be capped and traced. How mature this layer becomes will shape whether multi-model agents stay affordable in production.
Nearby Updates
All09/21, 17:02
Xin Ziguang Group and Alibaba Cloud Sign Full-Stack AI Partnership
Futu Niuniu reports that Xin Ziguang Group has reached a full-stack AI partnership with Alibaba Cloud. The report gives only the conclusion, with no deal value, product list or timetable, so the practical weight of the tie-up between a hardware group and Alibaba's cloud and AI platform is still unclear.
09/21, 16:50
Tencent Hy4 Preview Surfaces as a 770B Open Model Taking On Kimi K3
Tencent's Hy4 Preview has surfaced as a 770B-parameter open model, with coverage framing its benchmark results as a head-to-head against Kimi K3. The preview label means licence terms, weight availability and independent reproduction of those numbers are still unconfirmed.
09/21, 16:47
Roewe 家越07 Opens Pre-Sales at 137,800 Yuan With Doubao Smart Cockpit Debut
According to Autohome, Roewe's 家越07 has opened pre-sales from 137,800 yuan with a 320 km pure-electric range, and it is the first production car to carry the Doubao smart cockpit. It is another step for ByteDance's Doubao into in-car systems, at a mainstream electric price point.
09/21, 16:47
Liu Dayiheng Takes Over as Alibaba's Qwen Lead After Lin Junyang's Exit
A Sina finance report says Liu Dayiheng has taken over as head of Alibaba's Qwen team about six months after Lin Junyang's exit. The report gives no effective date or roadmap changes, but a settled leadership line matters for a model team that relies on long-term developer trust.