cardosofelipe/pragma-stack
Template
1
0
Fork 1
Code Issues 1 Pull Requests Packages Projects Releases Wiki Activity

feat(llm-gateway): implement LLM Gateway MCP Server (#56)

Browse Source 
Implements complete LLM Gateway MCP Server with:
- FastMCP server with 4 tools: chat_completion, list_models, get_usage, count_tokens
- LiteLLM Router with multi-provider failover chains
- Circuit breaker pattern for fault tolerance
- Redis-based cost tracking per project/agent
- Comprehensive test suite (209 tests, 92% coverage)

Model groups defined per ADR-004:
- reasoning: claude-opus-4 → gpt-4.1 → gemini-2.5-pro
- code: claude-sonnet-4 → gpt-4.1 → deepseek-coder
- fast: claude-haiku → gpt-4.1-mini → gemini-2.0-flash
This commit is contained in:
Felipe Cardoso
2026-01-03 20:31:19 +01:00
parent ffde0cb2a9
commit 678b3fffdd
23 changed files with 9794 additions and 93 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
mcp-servers/llm-gateway/tests/__init__.py Normal file
View File

@@ -0,0 +1 @@
"""Tests for LLM Gateway MCP Server."""