streaming UI

  • VidaiMock: Local Mock Server for LLM APIs


    Mock LLM APIs locally with real-world streaming physics (OpenAI/Anthropic/Gemini and more compatible)VidaiMock is a newly open-sourced local-first mock server designed to emulate the precise wire-format and latency of major LLM API providers, allowing developers to test streaming UIs and SDK resilience without incurring API costs. Unlike traditional mock servers that return static JSON, VidaiMock provides physics-accurate streaming by simulating the exact network protocols and per-token timing of providers like OpenAI and Anthropic. With features like chaos engineering for testing retry logic and dynamic response generation through Tera templates, VidaiMock offers a versatile and high-performance solution for developers needing realistic mock infrastructure. Built in Rust, it is easy to deploy with no external dependencies, making it accessible for developers to catch streaming bugs before they reach production. Why this matters: VidaiMock provides a cost-effective and realistic testing environment for developers working with LLM APIs, helping to ensure robust and reliable application performance in production.

    Read Full Article: VidaiMock: Local Mock Server for LLM APIs