Call 100+ LLM APIs via OpenAI format
Python SDK and proxy for Bedrock, HuggingFace, VertexAI, TogetherAI, Azure, OpenAI, Groq with cost tracking.
{
"mcpServers": {
"litellm-gateway": {
"mcpServers": {
"litellm": {
"env": {
"LITELLM_API_KEY": "YOUR_KEY"
},
"args": [
"litellm-mcp"
],
"command": "uvx"
}
}
}
}
}