Realtime AI News
Open-source AI gateway Experiential unifies cloud and local models behind one OpenAI-compatible API and caps agent spend
Experiential is an open-source AI gateway and router that puts cloud and local models behind a single OpenAI-compatible API, so teams can manage and optimise quality, speed and cost in one place. It also issues per-employee and per-agent API keys that let operators see, and control, how much their AI agents spend.
On September 21, GIGAZINE looked at Experiential, an open-source AI gateway and router published by Experiential Labs that gathers cloud and local models behind a single OpenAI-compatible API and lets operators manage and optimise them for quality, speed and cost.
The problem it targets is familiar. Teams that use GPT, Claude, Gemini and others usually configure a separate endpoint and API key for every provider, which scatters usage tracking and billing across dashboards. Experiential sits in between: an agent configures one OpenAI-compatible API and reaches every provider behind it.
More than 1,000 models ship in the standard catalogue, covering GPT, Claude and Gemini along with DeepSeek, Qwen, Kimi, GLM, Mistral and llama. Users who already hold provider keys can register them with Experiential and keep using them under a bring-your-own-key arrangement.
For companies, the gateway issues a dedicated Experiential API key per employee or per AI agent while the organisation keeps custody of the upstream provider keys. The Logs view records which key made each request in its request history, and filtering shows which models a given key used, so usage and spend can be attributed in one place.
Experiential also optimises model selection from real traffic. Once an agent's activity is accumulated in OpenTelemetry format, the system evaluates a task across several models and compares quality, latency and price to build a router, sending simple work to cheap fast models and hard work to stronger ones.
There are tier limits to note. The cloud Free plan excludes automatic routing and per-prompt model optimisation, which start at the Pro plan, while Free covers the basics of reaching several models through one API and reviewing usage and cost together. Self-hosted deployments can export history accumulated in tools such as Langfuse, in OpenTelemetry or other formats, and load it into Experiential to build a router.
The point of gateways like this is to turn multi-model use from a pile of per-vendor keys into infrastructure that can be observed, capped and optimised. Once agents call tools and spend money on their own, budget control and cost attribution stop being a finance question and become an engineering one.
The open-source gateway lane is getting crowded. GIGAZINE's related coverage on the same page includes Wayfinder, which switches between local and cloud models by task difficulty. Whether Experiential holds up on routing accuracy, self-hosting effort and billing fidelity is the thing to watch.
Why it matters
For teams running several model providers at once, Experiential pulls keys, usage and billing into one observable gateway and turns agent spend into something that can be capped and traced. How mature this layer becomes will shape whether multi-model agents stay affordable in production.
Nearby Updates
All09/21, 18:00
OpenAI Lays Out a Path to Shared Global AI Standards
OpenAI has published a proposal for a shared global approach to AI standards, built on coordinated evaluation, reporting and governance. The emphasis falls on comparable evidence and disclosure rather than on safety promises made by individual labs.
09/21, 18:00
5 Companies Using NVIDIA AI for Clean Energy
5 Companies Using NVIDIA AI for Clean Energy. Clean energy isn’t hard to come by, but the pace of large scale adoption has historically been slow due to bottlenecks — including out of date infrastructure, elongated research and development timelines, and upfront cost barriers. At New York Climate Week, NV...
09/21, 17:02
Xin Ziguang Group and Alibaba Cloud Sign Full-Stack AI Partnership
Futu Niuniu reports that Xin Ziguang Group has reached a full-stack AI partnership with Alibaba Cloud. The report gives only the conclusion, with no deal value, product list or timetable, so the practical weight of the tie-up between a hardware group and Alibaba's cloud and AI platform is still unclear.
09/21, 16:50
Tencent Hy4 Preview Surfaces as a 770B Open Model Taking On Kimi K3
Tencent's Hy4 Preview has surfaced as a 770B-parameter open model, with coverage framing its benchmark results as a head-to-head against Kimi K3. The preview label means licence terms, weight availability and independent reproduction of those numbers are still unconfirmed.