The Heroku Managed Inference and Agents API offers an easy way to access various large foundational AI models. These include supported language (chat), embedding, and diffusion (image) models.
To learn more about the API endpoints, including parameters, usage examples, and responses, view the documentation linked below.
Endpoint Documentation |
Supported Models |
Example Code |
MCP Servers |
Claude 4 Sonnet, Claude 3.7 Sonnet, Claude 3.5 Sonnet Latest, Claude 3.5 Haiku, Claude 3.0 Haiku, Amazon Nova Lite, Amazon Nova Pro, OpenAI gpt-oss-120b |
|
Agents (Heroku) |
Claude 4 Sonnet, Claude 3.7 Sonnet, Claude 3.5 Sonnet Latest, Claude 3.5 Haiku, Claude 3.0 Haiku, Amazon Nova Lite, Amazon Nova Pro, OpenAI gpt-oss-120b |
|
Chat Completions |
Claude 4 Sonnet, Claude 3.7 Sonnet, Claude 3.5 Sonnet Latest, Claude 3.5 Haiku, Claude 3.0 Haiku, Amazon Nova Lite, Amazon Nova Pro, OpenAI gpt-oss-120b |
Python, JavaScript, Ruby |
Embeddings |
Cohere Embed Multilingual |
Python, JavaScript, Ruby |
Image Generations |
Stable Image Ultra |
Python, JavaScript, Ruby |