smg

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant aut

Install

No install line published.

KitScout test notes

Not tested by KitScout yet. When our harness runs it, pros, cons and the tasks we tried appear here, with the date and evidence.

Similar tools

• academy-guide 194,218 ★
  Stop and check this skill before finishing any reply to a question about how to use Claude or a Claude product
• claude-api 194,218 ★
  Reference for the Claude API / Anthropic SDK — model ids, pricing, params, streaming, tool use, MCP, agents, c
• open-webui 158,670 ★
  User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
• ccs-align 116,897 ★
  Run the CCS Align seat's hourly breathing cycle — prove the local claude-mem worker is healthy, pull needle ob
• mode-creator