Supported LLM models and providers
Langbase supports a wide range of latest Large Language Models (LLMs) and providers. We are continuosly adding support for the latest models as they are released. Here are some of the models and providers supported by Langbase.
Supported LLM Providers
We currently support the following LLM providers.
- OpenAI
- Together
- Anthropic
- Groq
- Cohere
You can use any of these providers to build your Pipe, by adding your provider's key. Please feel free to request any specific provider you would like to use.
Supported LLM Models
We support the following LLM models from the above providers. Please feel free to request any specific model you would like to use.
OpenAI
| Model | ID | Provider | Owner | Context | Prompt Cost* | Completion Cost* |
|---|---|---|---|---|---|---|
| gpt-4o | gpt-4o | OpenAI | OpenAI | 128,000 | 5.0 | 15.0 |
| gpt-4-turbo | gpt-4-turbo | OpenAI | OpenAI | 128,000 | 10.0 | 30.0 |
| gpt-4-turbo-preview | gpt-4-turbo-preview | OpenAI | OpenAI | 128,000 | 10.0 | 30.0 |
| gpt-4-0125-preview | gpt-4-0125-preview | OpenAI | OpenAI | 128,000 | 10.0 | 30.0 |
| gpt-4-1106-preview | gpt-4-1106-preview | OpenAI | OpenAI | 128,000 | 10.0 | 30.0 |
| gpt-4 | gpt-4 | OpenAI | OpenAI | 8,192 | 30.0 | 60.0 |
| gpt-4-0613 | gpt-4-0613 | OpenAI | OpenAI | 8,192 | 30.0 | 60.0 |
| gpt-4-32k | gpt-4-32k | OpenAI | OpenAI | 32,768 | 60.0 | 120.0 |
| gpt-3.5-turbo-0125 | gpt-3.5-turbo-0125 | OpenAI | OpenAI | 16,385 | 0.5 | 1.5 |
| gpt-3.5-turbo-1106 | gpt-3.5-turbo-1106 | OpenAI | OpenAI | 16,385 | 1.0 | 2.0 |
| gpt-3.5-turbo | gpt-3.5-turbo | OpenAI | OpenAI | 4,096 | 1.5 | 2.0 |
| gpt-3.5-turbo-16k | gpt-3.5-turbo-16k | OpenAI | OpenAI | 16,385 | 3.0 | 4.0 |
Together AI
| Model | ID | Provider | Owner | Context | Prompt Cost* | Completion Cost* |
|---|---|---|---|---|---|---|
| Llama-3-70b-chat-hf | meta-llama/Llama-3-70b-chat-hf | Together | Meta | 8,192 | 0.9 | 0.9 |
| Llama-3-8b-chat-hf | meta-llama/Llama-3-8b-chat-hf | Together | Meta | 8,192 | 0.2 | 0.2 |
| Llama-2-7B-32K-Instruct | togethercomputer/Llama-2-7B-32K-Instruct | Together | Meta | 32,768 | 0.2 | 0.2 |
| Llama-2-13b-chat-hf | meta-llama/Llama-2-13b-chat-hf | Together | Meta | 4,096 | 0.225 | 0.225 |
| Llama-2-70b-chat-hf | meta-llama/Llama-2-70b-chat-hf | Together | Meta | 4,096 | 0.9 | 0.9 |
| 7B-Instruct-v0.1 | mistralai/Mistral-7B-Instruct-v0.1 | Together | Mistral | 4,096 | 0.2 | 0.2 |
| 7B-Instruct-v0.2 | mistralai/Mistral-7B-Instruct-v0.2 | Together | Mistral | 32,768 | 0.2 | 0.2 |
| Mixtral-8x7B-Instruct-v0.1 | mistralai/Mixtral-8x7B-Instruct-v0.1 | Together | Mistral | 32,768 | 0.6 | 0.6 |
| Mixtral-8x22B-Instruct-v0.1 | mistralai/Mixtral-8x22B-Instruct-v0.1 | Together | Mistral | 64,000 | 1.2 | 1.2 |
| DBRX-instruct | databricks/dbrx-instruct | Together | Databricks | 32,768 | 1.2 | 1.2 |
Anthropic
| Model | ID | Provider | Owner | Context | Prompt Cost* | Completion Cost* |
|---|---|---|---|---|---|---|
| claude-3.5-sonnet | claude-3-5-sonnet-20240620 | Anthropic | Anthropic | 200K | 3 | 15 |
| claude-3-opus | claude-3-opus-20240229 | Anthropic | Anthropic | 200K | 15 | 75 |
| claude-3-sonnet | claude-3-sonnet-20240229 | Anthropic | Anthropic | 200K | 3 | 15 |
| claude-3-haiku | claude-3-haiku-20240307 | Anthropic | Anthropic | 200K | 0.25 | 1.25 |
Google AI
| Model | ID | Provider | Owner | Context | Prompt Cost* | Completion Cost* |
|---|---|---|---|---|---|---|
| gemini-1.5-pro | gemini-1.5-pro-latest | upto 1M | 7 | 21 | ||
| gemini-1.5-flash | gemini-1.5-flash-latest | upto 1M | 0.35 | 0.53 | ||
| gemini-1.0-pro | gemini-pro | 30,720 | 0.5 | 1.5 |
Groq
| Model | ID | Provider | Owner | Context | Prompt Cost* | Completion Cost* |
|---|---|---|---|---|---|---|
| Llama-3-70b | llama3-70b-8192 | Groq | Meta | 8,192 | 0.59 | 0.79 |
| Llama-3-8b | llama3-8b-8192 | Groq | Meta | 8,192 | 0.05 | 0.1 |
| Mixtral-8x7B | mixtral-8x7b-32768 | Groq | Mistral | 32,768 | 0.27 | 0.27 |
| gemma-7b-it | gemma-7b-it | Groq | 8,192 | 0.1 | 0.1 |
Cohere
| Model | ID | Provider | Owner | Context | Prompt Cost* | Completion Cost* |
|---|---|---|---|---|---|---|
| command-r | command-r | Cohere | Cohere | 128K | 0.5 | 1.5 |
| command-r-plus | command-r-plus | Cohere | Cohere | 128K | 3 | 15 |
JSON Mode Support
See the list of models that support JSON mode and how to use it in your Pipe.