Access Together AI inference platform for open-source models.
## Together AI MCP Server: Open Model Cloud Platform The **Together AI MCP Server** connects Google Antigravity to Together's cloud platform for open-source AI models. This platform offers fast, affordable inference for leading open models with easy fine-tuning capabilities. ### Why Together AI MCP? Together democratizes access to open AI: - **Open Models**: Llama, Mistral, and 100+ models - **Fast Inference**: Optimized for speed and cost - **Fine-Tuning**: Customize models easily - **Serverless**: No infrastructure management - **Antigravity Native**: Seamless integration ### Key Features #### 1. Chat Completions ```python from together import Together client = Together(api_key="your-key") response = client.chat.completions.create( model="meta-llama/Llama-3.1-70B-Instruct-Turbo", messages=[ {"role": "user", "content": "Explain quantum computing"} ], max_tokens=1000 ) print(response.choices[0].message.content) ``` #### 2. Embeddings ```python # Generate embeddings for semantic search response = client.embeddings.create( model="togethercomputer/m2-bert-80M-8k-retrieval", input=["Hello world", "Machine learning is fascinating"] ) embeddings = [e.embedding for e in response.data] ``` #### 3. Fine-Tuning ```python # Start fine-tuning job job = client.fine_tuning.create( training_file="file-abc123", model="meta-llama/Llama-3.1-8B-Instruct-Turbo", n_epochs=3, learning_rate=1e-5 ) # Check status status = client.fine_tuning.retrieve(job.id) print(f"Status: {status.status}") # Use fine-tuned model response = client.chat.completions.create( model=f"your-org/{job.output_name}", messages=[{"role": "user", "content": prompt}] ) ``` ### Configuration ```json { "mcpServers": { "together-ai": { "command": "npx", "args": ["-y", "@anthropic/mcp-together"], "env": { "TOGETHER_API_KEY": "your-api-key" } } } } ``` ### Use Cases **Cost-Effective Inference**: Run open models at lower cost than proprietary alternatives. **Model Fine-Tuning**: Customize open models on your data for specialized tasks. **Model Evaluation**: Compare different open models to find the best fit. The Together AI MCP Server provides affordable open model access for Antigravity.
{
"mcpServers": {
"together-ai": {}
}
}