KitScout

Categories โ€บ Cloud & DevOps โ€บ Containers & Kubernetes

sample-genai-on-eks-starter-kit

MCP server

A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: ๐Ÿš€ AI Gateway (LiteLLM) ๐Ÿค– LLM Serving (vLLM, SGLang, Ollama) ๐Ÿ“Š Vector Databases, ๐Ÿ” Embedding Models (TEI) ๐Ÿ“ˆ Observability (Langfuse, Phoenix) etc. Fast-track you

Install

No install line published.

KitScout test notes

Not tested by KitScout yet. When our harness runs it, pros, cons and the tasks we tried appear here, with the date and evidence.

Similar tools