Supported Models and Providers

Langbase supports a wide range of latest Large Language Models (LLMs) and providers. We are continuously adding support for the latest models as they are released. Here are some of the models and providers supported by Langbase.

Supported LLM Providers

We currently support the following LLM providers.

OpenAI
Anthropic
Google AI
Together
Fireworks AI
Groq
Deepseek
Perplexity
Mistral AI
Cohere
xAI
Azure OpenAI
OpenRouter

You can use any of these providers to build your Pipe, by adding your provider's key. Please feel free to request any specific provider you would like to use.

Supported LLM Models

We support the following LLM models from the above providers. Please feel free to request any specific model you would like to use.

OpenAI

Model	Provider	Owner	Context	Cost*
gpt-5 ID: `openai:gpt-5-2025-08-07`	OpenAI	OpenAI	400,000	$1.25 prompt $10 completion
gpt-5-chat ID: `openai:gpt-5-chat-latest`	OpenAI	OpenAI	400,000	$1.25 prompt $10 completion
gpt-5-mini ID: `openai:gpt-5-mini-2025-08-07`	OpenAI	OpenAI	400,000	$0.25 prompt $2 completion
gpt-5-nano ID: `openai:gpt-5-nano-2025-08-07`	OpenAI	OpenAI	400,000	$0.05 prompt $0.4 completion
o3 ID: `openai:o3`	OpenAI	OpenAI	200,000	$2 prompt $8 completion
o4-mini ID: `openai:o4-mini`	OpenAI	OpenAI	200,000	$1.1 prompt $4.4 completion
o3-mini ID: `openai:o3-mini`	OpenAI	OpenAI	200,000	$1.1 prompt $4.4 completion
o1 ID: `openai:o1`	OpenAI	OpenAI	200,000	$15.0 prompt $60.0 completion
o1-preview ID: `openai:o1-preview`	OpenAI	OpenAI	128,000	$15.0 prompt $60.0 completion
o1-mini ID: `openai:o1-mini`	OpenAI	OpenAI	128,000	$3.0 prompt $12.0 completion
gpt-4.1 ID: `openai:gpt-4.1`	OpenAI	OpenAI	1M	$2 prompt $8.0 completion
gpt-4.1-mini ID: `openai:gpt-4.1-mini`	OpenAI	OpenAI	1M	$0.4 prompt $1.6 completion
gpt-4.1-nano ID: `openai:gpt-4.1-nano`	OpenAI	OpenAI	1M	$0.1 prompt $0.4 completion
gpt-4o ID: `openai:gpt-4o`	OpenAI	OpenAI	128,000	$2.5 prompt $10.0 completion
chatgpt-4o-latest ID: `openai:chatgpt-4o-latest`	OpenAI	OpenAI	128,000	$5 prompt $15.0 completion
gpt-4o-2024-08-06 ID: `openai:gpt-4o-2024-08-06`	OpenAI	OpenAI	128,000	$2.5 prompt $10.0 completion
gpt-4o-mini ID: `openai:gpt-4o-mini`	OpenAI	OpenAI	128,000	$0.15 prompt $0.6 completion
gpt-4-turbo ID: `openai:gpt-4-turbo`	OpenAI	OpenAI	128,000	$10.0 prompt $30.0 completion
gpt-4-turbo-preview ID: `openai:gpt-4-turbo-preview`	OpenAI	OpenAI	128,000	$10.0 prompt $30.0 completion
gpt-4-0125-preview ID: `openai:gpt-4-0125-preview`	OpenAI	OpenAI	128,000	$10.0 prompt $30.0 completion
gpt-4-1106-preview ID: `openai:gpt-4-1106-preview`	OpenAI	OpenAI	128,000	$10.0 prompt $30.0 completion
gpt-4 ID: `openai:gpt-4`	OpenAI	OpenAI	8,192	$30.0 prompt $60.0 completion
gpt-4-0613 ID: `openai:gpt-4-0613`	OpenAI	OpenAI	8,192	$30.0 prompt $60.0 completion
gpt-4-32k ID: `openai:gpt-4-32k`	OpenAI	OpenAI	32,768	$60.0 prompt $120.0 completion
gpt-3.5-turbo-0125 ID: `openai:gpt-3.5-turbo-0125`	OpenAI	OpenAI	16,385	$0.5 prompt $1.5 completion
gpt-3.5-turbo-1106 ID: `openai:gpt-3.5-turbo-1106`	OpenAI	OpenAI	16,385	$1.0 prompt $2.0 completion
gpt-3.5-turbo ID: `openai:gpt-3.5-turbo`	OpenAI	OpenAI	4,096	$1.5 prompt $2.0 completion
gpt-3.5-turbo-16k ID: `openai:gpt-3.5-turbo-16k`	OpenAI	OpenAI	16,385	$3.0 prompt $4.0 completion

* USD per Million tokens

Anthropic

Model	Provider	Owner	Context	Cost*
claude-haiku-4.5 ID: `anthropic:claude-haiku-4-5-20251001`	Anthropic	Anthropic	200K	$1 prompt $5 completion
claude-opus-4-20250514 ID: `anthropic:claude-opus-4-20250514`	Anthropic	Anthropic	200K	$15 prompt $75 completion
claude-sonnet-4-20250514 ID: `anthropic:claude-sonnet-4-20250514`	Anthropic	Anthropic	200K	$3 prompt $15 completion
claude-3.7-sonnet-latest ID: `anthropic:claude-3-7-sonnet-latest`	Anthropic	Anthropic	200K	$3 prompt $15 completion
claude-3.7-sonnet-20250219 ID: `anthropic:claude-3-7-sonnet-20250219`	Anthropic	Anthropic	200K	$3 prompt $15 completion
claude-3.5-sonnet-latest ID: `anthropic:claude-3-5-sonnet-latest`	Anthropic	Anthropic	200K	$3 prompt $15 completion
claude-3-5-haiku-20241022 ID: `anthropic:claude-3-5-haiku-20241022`	Anthropic	Anthropic	200K	$1 prompt $5 completion
claude-3.5-sonnet-20240620 ID: `anthropic:claude-3-5-sonnet-20240620`	Anthropic	Anthropic	200K	$3 prompt $15 completion
claude-3-opus ID: `anthropic:claude-3-opus-20240229`	Anthropic	Anthropic	200K	$15 prompt $75 completion
claude-3-sonnet ID: `anthropic:claude-3-sonnet-20240229`	Anthropic	Anthropic	200K	$3 prompt $15 completion
claude-3-haiku ID: `anthropic:claude-3-haiku-20240307`	Anthropic	Anthropic	200K	$0.25 prompt $1.25 completion

* USD per Million tokens

Google AI

Model	Provider	Owner	Context	Cost*
gemini-2.5-pro ID: `google:gemini-2.5-pro`	Google	Google	1M	$1.25 prompt $10 completion
gemini-2.5-flash ID: `google:gemini-2.5-flash`	Google	Google	1M	$0.3 prompt $2.5 completion
gemini-2.5-flash-lite-preview-06-17 ID: `google:gemini-2.5-flash-lite-preview-06-17`	Google	Google	1M	$0.1 prompt $0.4 completion
gemini-2.5-pro-preview-06-05 ID: `google:gemini-2.5-pro-preview-06-05`	Google	Google	1M	$1.25 prompt $10 completion
gemini-2.5-pro-preview-05-06 ID: `google:gemini-2.5-pro-preview-05-06`	Google	Google	1M	$1.25 prompt $10 completion
gemini-2.5-flash-preview-05-20 ID: `google:gemini-2.5-flash-preview-05-20`	Google	Google	1M	$0.15 prompt $3.50 completion
gemini-2.5-flash-preview-04-17 ID: `google:gemini-2.5-flash-preview-04-17`	Google	Google	1M	$0.15 prompt $3.50 completion
gemini-2.5-pro-preview-03-25 ID: `google:gemini-2.5-pro-preview-03-25`	Google	Google	1M	$1.25 prompt $10 completion
gemini-2.0-flash ID: `google:gemini-2.0-flash`	Google	Google	1M	$0.1 prompt $0.4 completion
gemini-2.0-flash-lite ID: `google:gemini-2.0-flash-lite`	Google	Google	1M	$0.075 prompt $0.3 completion
gemini-1.5-pro ID: `google:gemini-1.5-pro-latest`	Google	Google	up to 1M	$7 prompt $21 completion
gemini-1.5-flash ID: `google:gemini-1.5-flash-latest`	Google	Google	up to 1M	$0.075 prompt $0.3 completion
gemini-1.5-flash-8b ID: `google:gemini-1.5-flash-8b-latest`	Google	Google	up to 1M	$0.0375 prompt $0.15 completion
gemini-1.0-pro ID: `google:gemini-pro`	Google	Google	30,720	$0.5 prompt $1.5 completion

* USD per Million tokens

OpenRouter

Model	Provider	Owner	Context	Cost*
anthropic/claude-3.7-sonnet ID: `openrouter:anthropic/claude-3.7-sonnet`	OpenRouter	Anthropic	200,000	$3 prompt $5 completion
grok-4 ID: `openrouter:xai/grok-4`	OpenRouter	xAI	256,000	$3 prompt $15 completion
anthropic/claude-3.7-sonnet:thinking ID: `openrouter:anthropic/claude-3.7-sonnet:thinking`	OpenRouter	Anthropic	200,000	$3 prompt $15 completion
mistralai/magistral-medium-2506:thinking ID: `openrouter:mistralai/magistral-medium-2506:thinking`	OpenRouter	Mistral	40K	$2 prompt $5 completion
openai/o1-pro ID: `openrouter:openai/o1-pro`	OpenRouter	OpenAI	200,000	$150 prompt $600 completion
anthropic/claude-3.5-sonnet ID: `openrouter:anthropic/claude-3.5-sonnet`	OpenRouter	Anthropic	200,000	$3 prompt $15 completion
xai/grok-3-beta ID: `openrouter:xai/grok-3-beta`	xAI	xAI	131,072	$3 prompt $15 completion
xai/grok-3-mini-beta ID: `openrouter:xai/grok-3-mini-beta`	xAI	xAI	131,072	$0.3 prompt $0.5 completion
cohere/command-a ID: `openrouter:cohere/command-a`	OpenRouter	Cohere	256,000	$2.5 prompt $10 completion
perplexity/sonar-deep-research ID: `openrouter:perplexity/sonar-deep-research`	OpenRouter	Perplexity	200,000	$2 prompt $8 completion
deepseek/deepseek-r1:free ID: `openrouter:deepseek/deepseek-r1:free`	OpenRouter	DeepSeek	164,000	$0 prompt $0 completion
deepseek-chat-v3-0324:free ID: `openrouter:deepseek-chat-v3-0324:free`	OpenRouter	DeepSeek	131,000	$0 prompt $0 completion
deepseek-chat-v3-0324 ID: `openrouter:deepseek-chat-v3-0324`	OpenRouter	DeepSeek	131,000	$0.27 prompt $1.1 completion
google/gemini-2.0-flash-001 ID: `openrouter:google/gemini-2.0-flash-001`	OpenRouter	Google	1M	$0.1 prompt $0.4 completion
google/gemma-3-27b-it:free ID: `openrouter:google/gemma-3-27b-it:free`	OpenRouter	Google	96,000	$0 prompt $0 completion
mistralai/mistral-nemo ID: `openrouter:mistralai/mistral-nemo`	OpenRouter	Mistral	131K	$0.035 prompt $0.08 completion

* USD per Million tokens

Together

Model	Provider	Owner	Context	Cost*
Moonshot Kimi K2 ID: `together:moonshotai/Kimi-K2-Instruct`	Together	Moonshot	131,072	$1 prompt $3 completion
Llama-4-Maverick-17B-128E-Instruct-FP8 ID: `together:meta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8`	Together	Meta	500,000	$0.27 prompt $0.85 completion
Llama-4-Scout-17B-16E-Instruct ID: `together:meta-llama/Llama-4-Scout-17B-16E-Instruct`	Together	Meta	300,000	$0.18 prompt $0.59 completion
Llama-3.3-70B-Instruct-Turbo ID: `together:meta-llama/Llama-3.3-70B-Instruct-Turbo`	Together	Meta	131,072	$0.88 prompt $0.88 completion
Llama-3.2-90B-Vision-Instruct-Turbo ID: `together:meta-llama/Llama-3.2-90B-Vision-Instruct-Turbo`	Together	Meta	128,000	$1.2 prompt $1.2 completion
Llama-3.2-11B-Vision-Instruct-Turbo ID: `together:meta-llama/Llama-3.2-11B-Vision-Instruct-Turbo`	Together	Meta	128,000	$0.18 prompt $0.18 completion
Qwen2.5-VL-72B-Instruct ID: `together:Qwen/Qwen2.5-VL-72B-Instruct`	Together	Qwen	131,072	$1.95 prompt $8 completion
deepseek-v3 ID: `together:deepseek-ai/DeepSeek-V3`	Together	Deepseek	131,072	$1.25 prompt $1.25 completion
Llama-3.1-405B-Instruct-Turbo ID: `together:meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo`	Together	Meta	4,096	$5 prompt $5 completion
Qwen2.5-72b ID: `together:Qwen/Qwen2.5-72B-Instruct-Turbo`	Together	Qwen	32,768	$0.9 prompt $0.9 completion
Llama-3.1-70B-Instruct-Turbo ID: `together:meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo`	Together	Meta	8,192	$0.88 prompt $0.88 completion
Llama-3.1-8B-Instruct-Turbo ID: `together:meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo`	Together	Meta	8,192	$0.18 prompt $0.18 completion
Llama-3-70b-chat-hf ID: `together:meta-llama/Llama-3-70b-chat-hf`	Together	Meta	8,192	$0.9 prompt $0.9 completion
Llama-3-8b-chat-hf ID: `together:meta-llama/Llama-3-8b-chat-hf`	Together	Meta	8,192	$0.2 prompt $0.2 completion
Llama-2-13b-chat-hf ID: `together:meta-llama/Llama-2-13b-chat-hf`	Together	Meta	4,096	$0.225 prompt $0.225 completion
gemma-2b-it ID: `together:google/gemma-2b-it`	Together	Google	8,192	$0.1 prompt $0.1 completion
7B-Instruct-v0.1 ID: `together:mistralai/Mistral-7B-Instruct-v0.1`	Together	Mistral	4,096	$0.2 prompt $0.2 completion
7B-Instruct-v0.2 ID: `together:mistralai/Mistral-7B-Instruct-v0.2`	Together	Mistral	32,768	$0.2 prompt $0.2 completion
Mixtral-8x7B-Instruct-v0.1 ID: `together:mistralai/Mixtral-8x7B-Instruct-v0.1`	Together	Mistral	32,768	$0.6 prompt $0.6 completion
Mixtral-8x22B-Instruct-v0.1 ID: `together:mistralai/Mixtral-8x22B-Instruct-v0.1`	Together	Mistral	64,000	$1.2 prompt $1.2 completion
DBRX-instruct ID: `together:databricks/dbrx-instruct`	Together	Databricks	32,768	$1.2 prompt $1.2 completion

* USD per Million tokens

Fireworks AI

Model	Provider	Owner	Context	Cost*
Llama 4 Maverick Instruct (Basic) ID: `fireworks:llama4-maverick-instruct-basic`	Fireworks AI	Meta	1M	$0.22 prompt $0.88 completion
Llama 4 Scout Instruct (Basic) ID: `fireworks:llama4-scout-instruct-basic`	Fireworks AI	Meta	128,000	$0.15 prompt $0.60 completion
Llama 3.3 70B Instruct ID: `fireworks:llama-v3p3-70b-instruct`	Fireworks AI	Meta	131,072	$0.9 prompt $0.9 completion
deepseek-v3 ID: `fireworks:deepseek-v3`	Fireworks AI	Deepseek	131,072	$0.9 prompt $0.9 completion
Llama-3.2-3b ID: `fireworks:llama-v3p2-3b-instruct`	Fireworks AI	Meta	131,072	$0.1 prompt $0.1 completion
Llama-3.2-1b ID: `fireworks:llama-v3p2-1b-instruct`	Fireworks AI	Meta	131,072	$0.1 prompt $0.1 completion
Llama-3.1-405b ID: `fireworks:llama-v3p1-405b-instruct`	Fireworks AI	Meta	131,072	$3 prompt $3 completion
Qwen2.5-72b ID: `fireworks:qwen2p5-72b-instruct`	Fireworks AI	Qwen	32,768	$0.9 prompt $0.9 completion
Llama-3.1-70b ID: `fireworks:llama-v3p1-70b-instruct`	Fireworks AI	Meta	131,072	$0.9 prompt $0.9 completion
Llama-3.1-8b ID: `fireworks:llama-v3p1-8b-instruct`	Fireworks AI	Meta	131,072	$0.2 prompt $0.2 completion
yi-large ID: `fireworks:yi-large`	Fireworks AI	01.AI	32,768	$3 prompt $3 completion
Llama-3-70b ID: `fireworks:llama-v3-70b-instruct`	Fireworks AI	Meta	8,192	$0.9 prompt $0.9 completion

* USD per Million tokens

Groq

Model	Provider	Owner	Context	Cost*
Moonshot Kimi K2 ID: `groq:moonshotai/kimi-k2-instruct`	Groq	Moonshot	131,072	$1 prompt $3 completion
Llama-4-Maverick-17B-128E-Instruct ID: `groq:meta-llama/llama-4-maverick-17b-128e-instruct`	Groq	Meta	131,000	$0.11 prompt $0.34 completion
Llama-4-Scout-17B-16E-Instruct ID: `groq:meta-llama/llama-4-scout-17b-16e-instruct`	Groq	Meta	131,000	$0.50 prompt $0.77 completion
qwen3-32b ID: `groq:qwen/qwen3-32b`	Groq	Qwen	131,072	$0.29 prompt $0.59 completion
Llama-3.3-70b-versatile ID: `groq:llama-3.3-70b-versatile`	Groq	Meta	128,000	$0.59 prompt $0.79 completion
deepseek-r1-distill-llama-70b ID: `groq:deepseek-r1-distill-llama-70b`	Groq	DeepSeek	128,000	$0.75 prompt $0.99 completion
Llama-3.1-70b-versatile ID: `groq:llama-3.1-70b-versatile`	Groq	Meta	131,072	$0.59 prompt $0.79 completion
Llama-3.1-8b-instant ID: `groq:llama-3.1-8b-instant`	Groq	Meta	131,072	$0.59 prompt $0.79 completion
Llama-3-70b ID: `groq:llama3-70b-8192`	Groq	Meta	8,192	$0.59 prompt $0.79 completion
Llama-3-8b ID: `groq:llama3-8b-8192`	Groq	Meta	8,192	$0.05 prompt $0.1 completion
gemma2-9b-it ID: `groq:gemma2-9b-it`	Groq	Google	8,192	$0.2 prompt $0.2 completion

* USD per Million tokens

Perplexity

Model	Provider	Owner	Context	Cost*
sonar-pro ID: `perplexity:sonar-pro`	Perplexity	Perplexity	200,000	$3 prompt $15 completion
sonar ID: `perplexity:sonar`	Perplexity	Perplexity	127,072	$1 prompt $1 completion

* USD per Million tokens. Perplexity charges additional $5 per each request on its online models.

Mistral AI

Model	Provider	Owner	Context	Cost*
Magistral Medium 2506 ID: `mistralai:magistral-medium-2506`	OpenRouter	Mistral	40K	$2 prompt $5 completion
Mistral Large 2 ID: `mistral:mistral-large-latest`	Mistral AI	Mistral AI	128K	$3 prompt $9 completion
Pixtral Large ID: `mistral:pixtral-large-latest`	Mistral AI	Mistral AI	128K	$2 prompt $6 completion
Pixtral 12B ID: `mistral:pixtral-12b`	Mistral AI	Mistral AI	128K	$0.15 prompt $0.15 completion
Mistral Nemo ID: `mistral:open-mistral-nemo`	Mistral AI	Mistral AI	128K	$0.3 prompt $0.3 completion
Codestral ID: `mistral:codestral-latest`	Mistral AI	Mistral AI	32,768	$1 prompt $3 completion

* USD per Million tokens

Deepseek

Model	Provider	Owner	Context	Cost*
deepseek-reasoner ID: `deepseek:deepseek-reasoner`	Deepseek	Deepseek	64K	$0.55 prompt $2.19 completion
deepseek-chat ID: `deepseek:deepseek-chat`	Deepseek	Deepseek	64K	$0.14 prompt $0.28 completion

* USD per Million tokens

xAI

Model	Provider	Owner	Context	Cost*
grok-4 ID: `xai:grok-4`	xAI	xAI	256,000	$3 prompt $15 completion
grok-3-beta ID: `xai:grok-3-beta`	xAI	xAI	131,072	$3 prompt $15 completion
grok-3-fast-beta ID: `xai:grok-3-fast-beta`	xAI	xAI	131,072	$5 prompt $25 completion
grok-3-mini-beta ID: `xai:grok-3-mini-beta`	xAI	xAI	131,072	$0.3 prompt $0.5 completion
grok-3-mini-fast-beta ID: `xai:grok-3-mini-fast-beta`	xAI	xAI	131,072	$0.6 prompt $4 completion
grok-2-1212 ID: `xai:grok-2-1212`	xAI	xAI	131,072	$2 prompt $10 completion
grok-2-vision-1212 ID: `xai:grok-2-vision-1212`	xAI	xAI	32K	$2 prompt $10 completion
grok-beta ID: `xai:grok-beta`	xAI	xAI	131,072	$5 prompt $15 completion

* USD per Million tokens

Azure OpenAI

Model	Provider	Owner	Context	Cost*
o1 ID: `azureopenai:o1`	OpenAI	OpenAI	200,000	$16.5 prompt $66.0 completion
o3-mini ID: `azureopenai:o3-mini`	OpenAI	OpenAI	200,000	$1.21 prompt $4.84 completion
o1-preview ID: `azureopenai:o1-preview`	OpenAI	OpenAI	128,000	$16.5 prompt $66.0 completion
o1-mini ID: `azureopenai:o1-mini`	OpenAI	OpenAI	128,000	$3.3 prompt $13.2 completion
gpt-4.5-preview ID: `azureopenai:gpt-4.5-preview`	OpenAI	OpenAI	128,000	$75 prompt $150 completion
gpt-4o ID: `azureopenai:gpt-4o`	OpenAI	OpenAI	128,000	$2.75 prompt $11.0 completion
gpt-4o-mini ID: `azureopenai:gpt-4o-mini`	OpenAI	OpenAI	128,000	$0.165 prompt $0.66 completion

Learn how to use Azure OpenAI models in Langbase * USD per Million tokens

Cohere

Model	Provider	Owner	Context	Cost*
command-r ID: `cohere:command-r`	Cohere	Cohere	128K	$0.5 prompt $1.5 completion
command-r-plus ID: `cohere:command-r-plus`	Cohere	Cohere	128K	$3 prompt $15 completion

* USD per Million tokens

JSON Mode Support

See the list of models that support JSON mode and how to use it in your Pipe.

Note

Completion and Prompt costs are based on the provider's pricing. Langbase does not charge on top of the provider's costs.

Tool Support

The following models support tool calls on Langbase.

OpenAI

Model	Parallel Tool Call Support	Tool Choice Support
o3 ID: `openai:o3`	`true`	`true`
o4-mini ID: `openai:o4-mini`	`true`	`true`
gpt-4.1 ID: `openai:gpt-4.1`	`true`	`true`
gpt-4.1-mini ID: `openai:gpt-4.1-mini`	`true`	`true`
gpt-4.1-nano ID: `openai:gpt-4.1-nano`	`false`	`true`
gpt-4.5-preview ID: `openai:gpt-4.5-preview`	`true`	`true`
o1 ID: `openai:o1`	`true`	`true`
o3-mini ID: `openai:o3-mini`	`true`	`true`
o1-preview ID: `openai:o1-preview`	`true`	`true`
o1-mini ID: `openai:o1-mini`	`true`	`true`
gpt-4o ID: `openai:gpt-4o`	`true`	`true`
gpt-4o-2024-08-06 ID: `openai:gpt-4o-2024-08-06`	`true`	`true`
gpt-4o-mini ID: `openai:gpt-4o-mini`	`true`	`true`
gpt-4-turbo ID: `openai:gpt-4-turbo`	`true`	`true`
gpt-4-turbo-preview ID: `openai:gpt-4-turbo-preview`	`true`	`true`
gpt-4-0125-preview ID: `openai:gpt-4-0125-preview`	`true`	`true`
gpt-4-1106-preview ID: `openai:gpt-4-1106-preview`	`true`	`true`
gpt-4 ID: `openai:gpt-4`	`true`	`true`
gpt-4-0613 ID: `openai:gpt-4-0613`	`true`	`true`
gpt-4-32k ID: `openai:gpt-4-32k`	`true`	`true`
gpt-3.5-turbo-0125 ID: `openai:gpt-3.5-turbo-0125`	`true`	`true`
gpt-3.5-turbo-1106 ID: `openai:gpt-3.5-turbo-1106`	`true`	`true`
gpt-3.5-turbo ID: `openai:gpt-3.5-turbo`	`true`	`true`
gpt-3.5-turbo-16k ID: `openai:gpt-3.5-turbo-16k`	`true`	`true`

Google

Model	Parallel Tool Call Support	Tool Choice Support
gemini-2.5-flash-preview-04-17 ID: `google:gemini-2.5-flash-preview-04-17`	`true`	`true`
gemini-2.5-pro-exp-03-25 ID: `google:gemini-2.5-pro-exp-03-25`	`true`	`true`
gemini-2.5-pro-preview-03-25 ID: `google:gemini-2.5-pro-preview-03-25`	`true`	`true`
gemini-1.5-pro ID: `google:gemini-1.5-pro-latest`	`true`	`true`
gemini-2.0-flash-exp ID: `google:gemini-2.0-flash-exp`	`true`	`true`
gemini-1.5-flash ID: `google:gemini-1.5-flash-latest`	`true`	`true`
gemini-1.5-flash-8b ID: `google:gemini-1.5-flash-8b-latest`	`true`	`true`
gemini-1.0-pro ID: `google:gemini-pro`	`false`	`false`

Anthropic

Model	Parallel Tool Call Support	Tool Choice Support
claude-haiku-4.5 ID: `anthropic:claude-haiku-4-5-20251001`	`true`	`true`
claude-3.7-sonnet-latest ID: `anthropic:claude-3-7-sonnet-latest`	`true`	`true`
claude-3.7-sonnet-20250219 ID: `anthropic:claude-3-7-sonnet-20250219`	`true`	`true`
claude-3.5-sonnet-latest ID: `anthropic:claude-3-5-sonnet-latest`	`true`	`true`
claude-3.5-sonnet-20240620 ID: `anthropic:claude-3-5-sonnet-20240620`	`true`	`true`
claude-3-opus ID: `anthropic:claude-3-opus-20240229`	`true`	`true`
claude-3-sonnet ID: `anthropic:claude-3-sonnet-20240229`	`true`	`true`
claude-3-haiku ID: `anthropic:claude-3-haiku-20240307`	`true`	`true`

Together AI

Model	Parallel Tool Call Support	Tool Choice Support
Llama-3.1-405B-Instruct-Turbo ID: `together:meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo`	`false`	`true`
Llama-3.1-70B-Instruct-Turbo ID: `together:meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo`	`false`	`true`
Llama-3.1-8B-Instruct-Turbo ID: `together:meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo`	`false`	`true`
7B-Instruct-v0.1 ID: `together:mistralai/Mistral-7B-Instruct-v0.1`	`false`	`true`
Mixtral-8x7B-Instruct-v0.1 ID: `together:mistralai/Mixtral-8x7B-Instruct-v0.1`	`false`	`true`

Deepseek

Model	Parallel Tool Call Support	Tool Choice Support
deepseek-chat ID: `deepseek:deepseek-chat`	`false`	`true`

Deprecated Models

The following models are deprecated and no longer available for use in pipes. It is recommended to switch to a supported model.

Model	Provider	Owner	Deprecated on	Reason
Mixtral-8x7B	Groq	01-07-2025	Discontinued by Groq
gemini-2.5-pro-exp-03-25	Google	Google	15-06-2025	Discontinued by Perplexity
llama-3.1-sonar-huge-128k-online	Perplexity	Meta	21-02-2025	Discontinued by Perplexity
llama-3.1-sonar-large-128k-online	Perplexity	Meta	21-02-2025	Discontinued by Perplexity
llama-3.1-sonar-small-128k-online	Perplexity	Meta	21-02-2025	Discontinued by Perplexity
llama-3.1-sonar-large-128k-chat	Perplexity	Meta	23-01-2025	Discontinued by Perplexity
llama-3.1-sonar-small-128k-chat	Perplexity	Meta	23-01-2025	Discontinued by Perplexity
gemma-7b-it	Groq	Google	01-01-2025	Discontinued by Groq
qwen2-72b	Fireworks AI	QwenLM	13-08-2024	Discontinued by Fireworks AI
Llama-3-70b-chat-hf	Together AI	Meta	15-09-2024	Discontinued by Together AI
Llama-2-7B-32K-Instruct	Together AI	Meta	15-09-2024	Discontinued by Together AI
gemma-7b-it	Together AI	Meta	15-09-2024	Discontinued by Together AI

Documentation

Supported Models and Providers

OpenAI

Google

Anthropic

Together AI