Chat

Available Providers
ProviderModelVersionPriceBilling unit
openaio3-miniv1Beta4.4e-06 (per 1 token)1 token
openaigpt-4.1-2025-04-14v1Beta8e-06 (per 1 token)1 token
openaigpt-4.1-nano-2025-04-14v1Beta4e-07 (per 1 token)1 token
openaigpt-4o-miniv1Beta6e-07 (per 1 token)1 token
openai-v1Beta10.0 (per 1000000 token)1 token
openaio1-previewv1Beta6e-05 (per 1 token)1 token
openaio1-miniv1Beta4.4e-06 (per 1 token)1 token
openaigpt-4o-2024-05-13v1Beta1.5e-05 (per 1 token)1 token
openaigpt-5v1Beta1e-05 (per 1 token)1 token
openaigpt-5-chat-latestv1Beta1e-05 (per 1 token)1 token
openaigpt-5-miniv1Beta2e-06 (per 1 token)1 token
openaigpt-5-nanov1Beta4e-07 (per 1 token)1 token
openaigpt-4-turbov1Beta3e-05 (per 1 token)1 token
openaio1-2024-12-17v1Beta6e-05 (per 1 token)1 token
openaigpt-5.2v1Beta1.4e-05 (per 1 token)1 token
openaichatgpt-4o-latestv1Beta1.5e-05 (per 1 token)1 token
openaigpt-3.5-turbov1Beta1.5e-06 (per 1 token)1 token
openaigpt-3.5-turbo-0125v1Beta1.5e-06 (per 1 token)1 token
openaigpt-3.5-turbo-0301v1Beta2e-06 (per 1 token)1 token
openaigpt-3.5-turbo-0613v1Beta2e-06 (per 1 token)1 token
openaigpt-3.5-turbo-1106v1Beta2e-06 (per 1 token)1 token
openaigpt-3.5-turbo-16kv1Beta4e-06 (per 1 token)1 token
openaigpt-3.5-turbo-16k-0613v1Beta4e-06 (per 1 token)1 token
openaigpt-4v1Beta6e-05 (per 1 token)1 token
openaigpt-4-0125-previewv1Beta3e-05 (per 1 token)1 token
openaigpt-4-0314v1Beta6e-05 (per 1 token)1 token
openaigpt-4-0613v1Beta6e-05 (per 1 token)1 token
openaigpt-4-1106-previewv1Beta3e-05 (per 1 token)1 token
openaigpt-4-1106-vision-previewv1Beta3e-05 (per 1 token)1 token
openaigpt-4-32kv1Beta0.00012 (per 1 token)1 token
openaigpt-4-32k-0314v1Beta0.00012 (per 1 token)1 token
openaigpt-4-32k-0613v1Beta0.00012 (per 1 token)1 token
openaigpt-4-turbo-2024-04-09v1Beta3e-05 (per 1 token)1 token
openaigpt-4-turbo-previewv1Beta3e-05 (per 1 token)1 token
openaigpt-4-vision-previewv1Beta3e-05 (per 1 token)1 token
openaigpt-4.1v1Beta8e-06 (per 1 token)1 token
openaigpt-4.1-miniv1Beta1.6e-06 (per 1 token)1 token
openaigpt-4.1-mini-2025-04-14v1Beta1.6e-06 (per 1 token)1 token
openaigpt-4.1-nanov1Beta4e-07 (per 1 token)1 token
openaigpt-4.5-previewv1Beta0.00015 (per 1 token)1 token
openaigpt-4.5-preview-2025-02-27v1Beta0.00015 (per 1 token)1 token
openaigpt-4ov1Beta1e-05 (per 1 token)1 token
openaigpt-4o-2024-08-06v1Beta1e-05 (per 1 token)1 token
openaigpt-4o-2024-11-20v1Beta1e-05 (per 1 token)1 token
openaigpt-4o-audio-previewv1Beta1e-05 (per 1 token)1 token
openaigpt-4o-audio-preview-2024-10-01v1Beta1e-05 (per 1 token)1 token
openaigpt-4o-audio-preview-2024-12-17v1Beta1e-05 (per 1 token)1 token
openaigpt-4o-audio-preview-2025-06-03v1Beta1e-05 (per 1 token)1 token
openaigpt-4o-mini-2024-07-18v1Beta6e-07 (per 1 token)1 token
openaigpt-4o-mini-audio-previewv1Beta6e-07 (per 1 token)1 token
openaigpt-4o-mini-audio-preview-2024-12-17v1Beta6e-07 (per 1 token)1 token
openaigpt-4o-mini-realtime-previewv1Beta2.4e-06 (per 1 token)1 token
openaigpt-4o-mini-realtime-preview-2024-12-17v1Beta2.4e-06 (per 1 token)1 token
openaigpt-4o-mini-search-previewv1Beta6e-07 (per 1 token)1 token
openaigpt-4o-mini-search-preview-2025-03-11v1Beta6e-07 (per 1 token)1 token
openaigpt-4o-realtime-previewv1Beta2e-05 (per 1 token)1 token
openaigpt-4o-realtime-preview-2024-10-01v1Beta2e-05 (per 1 token)1 token
openaigpt-4o-realtime-preview-2024-12-17v1Beta2e-05 (per 1 token)1 token
openaigpt-4o-realtime-preview-2025-06-03v1Beta2e-05 (per 1 token)1 token
openaigpt-4o-search-previewv1Beta1e-05 (per 1 token)1 token
openaigpt-4o-search-preview-2025-03-11v1Beta1e-05 (per 1 token)1 token
openaigpt-5.1v1Beta1e-05 (per 1 token)1 token
openaigpt-5.1-2025-11-13v1Beta1e-05 (per 1 token)1 token
openaigpt-5.1-chat-latestv1Beta1e-05 (per 1 token)1 token
openaigpt-5.2-2025-12-11v1Beta1.4e-05 (per 1 token)1 token
openaigpt-5.2-chat-latestv1Beta1.4e-05 (per 1 token)1 token
openaigpt-5-2025-08-07v1Beta1e-05 (per 1 token)1 token
openaigpt-5-chatv1Beta1e-05 (per 1 token)1 token
openaigpt-5-mini-2025-08-07v1Beta2e-06 (per 1 token)1 token
openaigpt-5-nano-2025-08-07v1Beta4e-07 (per 1 token)1 token
openaigpt-realtimev1Beta1.6e-05 (per 1 token)1 token
openaigpt-realtime-miniv1Beta2.4e-06 (per 1 token)1 token
openaigpt-realtime-2025-08-28v1Beta1.6e-05 (per 1 token)1 token
openaio1v1Beta6e-05 (per 1 token)1 token
openaio1-mini-2024-09-12v1Beta1.2e-05 (per 1 token)1 token
openaio1-preview-2024-09-12v1Beta6e-05 (per 1 token)1 token
openaio3v1Beta8e-06 (per 1 token)1 token
openaio3-2025-04-16v1Beta8e-06 (per 1 token)1 token
openaio3-mini-2025-01-31v1Beta4.4e-06 (per 1 token)1 token
openaio4-miniv1Beta4.4e-06 (per 1 token)1 token
openaio4-mini-2025-04-16v1Beta4.4e-06 (per 1 token)1 token
openaicontainerv1Beta0.0 (per 1 seconde)1 seconde
googlegemini-1.5-flash-8b-latestv10.3 (per 1000000 token)1 token
google-v10.6 (per 1000000 token)1 token
googlegemini-3-pro-previewv11.2e-05 (per 1 token)1 token
googlegemini-2.5-prov11e-05 (per 1 token)1 token
googlegemini-2.0-flashv14e-07 (per 1 token)1 token
googlegemini-2.0-flash-lite-preview-02-05v13e-07 (per 1 token)1 token
googlegemini-2.5-pro-preview-03-25v11e-05 (per 1 token)1 token
googlegemini-2.5-pro-exp-03-25v10.0 (per 1 token)1 token
googlegemini-1.5-flashv13e-07 (per 1 token)1 token
googlegemini-1.5-prov11.05e-05 (per 1 token)1 token
googlegemini-1.5-pro-latestv11.05e-06 (per 1 token)1 token
googlegemini-1.5-flash-8bv10.0 (per 1 token)1 token
googlegemini-live-2.5-flash-preview-native-audio-09-2025v12e-06 (per 1 token)1 token
googlegemini-1.5-flash-001v13e-07 (per 1 token)1 token
googlegemini-1.5-flash-002v13e-07 (per 1 token)1 token
googlegemini-1.5-flash-8b-exp-0827v10.0 (per 1 token)1 token
googlegemini-1.5-flash-8b-exp-0924v10.0 (per 1 token)1 token
googlegemini-1.5-flash-exp-0827v10.0 (per 1 token)1 token
googlegemini-1.5-flash-latestv13e-07 (per 1 token)1 token
googlegemini-1.5-pro-001v11.05e-05 (per 1 token)1 token
googlegemini-1.5-pro-002v11.05e-05 (per 1 token)1 token
googlegemini-1.5-pro-exp-0801v11.05e-05 (per 1 token)1 token
googlegemini-1.5-pro-exp-0827v10.0 (per 1 token)1 token
googlegemini-2.0-flash-001v14e-07 (per 1 token)1 token
googlegemini-2.0-flash-expv10.0 (per 1 token)1 token
googlegemini-2.0-flash-litev13e-07 (per 1 token)1 token
googlegemini-2.0-flash-live-001v11.5e-06 (per 1 token)1 token
googlegemini-2.0-flash-preview-image-generationv14e-07 (per 1 token)1 token
googlegemini-2.0-flash-thinking-expv10.0 (per 1 token)1 token
googlegemini-2.0-flash-thinking-exp-01-21v10.0 (per 1 token)1 token
googlegemini-2.0-pro-exp-02-05v10.0 (per 1 token)1 token
googlegemini-2.5-flashv12.5e-06 (per 1 token)1 token
googlegemini-2.5-flash-litev14e-07 (per 1 token)1 token
googlegemini-2.5-flash-lite-preview-09-2025v14e-07 (per 1 token)1 token
googlegemini-2.5-flash-preview-09-2025v12.5e-06 (per 1 token)1 token
googlegemini-flash-latestv12.5e-06 (per 1 token)1 token
googlegemini-flash-lite-latestv14e-07 (per 1 token)1 token
googlegemini-2.5-flash-lite-preview-06-17v14e-07 (per 1 token)1 token
googlegemini-2.5-flash-preview-04-17v16e-07 (per 1 token)1 token
googlegemini-2.5-flash-preview-05-20v12.5e-06 (per 1 token)1 token
googlegemini-2.5-flash-preview-ttsv16e-07 (per 1 token)1 token
googlegemini-2.5-computer-use-preview-10-2025v11e-05 (per 1 token)1 token
googlegemini-3-flash-previewv13e-06 (per 1 token)1 token
googlegemini-2.5-pro-preview-05-06v11e-05 (per 1 token)1 token
googlegemini-2.5-pro-preview-06-05v11e-05 (per 1 token)1 token
googlegemini-2.5-pro-preview-ttsv11e-05 (per 1 token)1 token
googlegemini-exp-1114v10.0 (per 1 token)1 token
googlegemini-exp-1206v10.0 (per 1 token)1 token
googlegemini-gemma-2-27b-itv11.05e-06 (per 1 token)1 token
googlegemini-gemma-2-9b-itv11.05e-06 (per 1 token)1 token
googlegemini-prov11.05e-06 (per 1 token)1 token
googlegemini-pro-visionv11.05e-06 (per 1 token)1 token
googlegemma-3-27b-itv10.0 (per 1 token)1 token
googlelearnlm-1.5-pro-experimentalv10.0 (per 1 token)1 token
cohere-2022-12-062.0 (per 1000000 token)1 token
coherecommand-light2022-12-060.6 (per 1000000 token)1 token
coherecommand-nightly2022-12-062.0 (per 1000000 token)1 token
coherecommand2022-12-062.0 (per 1000000 token)1 token
coherecommand-light-nightly2022-12-060.6 (per 1000000 token)1 token
coherecommand-r2022-12-061.5 (per 1000000 token)1 token
coherecommand-r7b-12-20242022-12-060.15 (per 1000000 token)1 token
metallama3-1-405b-instruct-v1:0boto3 (v1.35.84)2.4 (per 1000000 token)1 token
metallama3-1-70b-instruct-v1:0boto3 (v1.35.84)0.72 (per 1000000 token)1 token
metallama3-1-8b-instruct-v1:0boto3 (v1.35.84)0.22 (per 1000000 token)1 token
meta-boto3 (v1.35.84)0.15 (per 1000000 token)1 token
mistral-v0.0.16.0 (per 1000000 token)1 token
mistralpixtral-large-latestv0.0.16e-06 (per 1 token)1 token
mistralmistral-saba-latestv0.0.10.6 (per 1000000 token)1 token
mistralmistral-small-latestv0.0.13e-07 (per 1 token)1 token
mistralmistral-large-latestv0.0.16e-06 (per 1 token)1 token
mistralcodestral-latestv0.0.13e-06 (per 1 token)1 token
mistralcodestral-2405v0.0.13e-06 (per 1 token)1 token
mistralcodestral-2508v0.0.19e-07 (per 1 token)1 token
mistralcodestral-mamba-latestv0.0.12.5e-07 (per 1 token)1 token
mistraldevstral-medium-2507v0.0.12e-06 (per 1 token)1 token
mistraldevstral-small-2505v0.0.13e-07 (per 1 token)1 token
mistraldevstral-small-2507v0.0.13e-07 (per 1 token)1 token
mistrallabs-devstral-small-2512v0.0.13e-07 (per 1 token)1 token
mistraldevstral-2512v0.0.12e-06 (per 1 token)1 token
mistralmagistral-medium-2506v0.0.15e-06 (per 1 token)1 token
mistralmagistral-medium-2509v0.0.15e-06 (per 1 token)1 token
mistralmagistral-medium-latestv0.0.15e-06 (per 1 token)1 token
mistralmagistral-small-2506v0.0.11.5e-06 (per 1 token)1 token
mistralmagistral-small-latestv0.0.11.5e-06 (per 1 token)1 token
mistralmistral-large-2402v0.0.11.2e-05 (per 1 token)1 token
mistralmistral-large-2407v0.0.19e-06 (per 1 token)1 token
mistralmistral-large-2411v0.0.16e-06 (per 1 token)1 token
mistralmistral-large-3v0.0.11.5e-06 (per 1 token)1 token
mistralmistral-mediumv0.0.18.1e-06 (per 1 token)1 token
mistralmistral-medium-2312v0.0.18.1e-06 (per 1 token)1 token
mistralmistral-medium-2505v0.0.12e-06 (per 1 token)1 token
mistralmistral-medium-latestv0.0.12e-06 (per 1 token)1 token
mistralmistral-smallv0.0.13e-07 (per 1 token)1 token
mistralmistral-tinyv0.0.12.5e-07 (per 1 token)1 token
mistralopen-codestral-mambav0.0.12.5e-07 (per 1 token)1 token
mistralopen-mistral-7bv0.0.12.5e-07 (per 1 token)1 token
mistralopen-mistral-nemov0.0.13e-07 (per 1 token)1 token
mistralopen-mistral-nemo-2407v0.0.13e-07 (per 1 token)1 token
mistralopen-mixtral-8x22bv0.0.16e-06 (per 1 token)1 token
mistralopen-mixtral-8x7bv0.0.17e-07 (per 1 token)1 token
mistralpixtral-12b-2409v0.0.11.5e-07 (per 1 token)1 token
mistralpixtral-large-2411v0.0.16e-06 (per 1 token)1 token
perplexityai-v1.02.0 (per 1000000 token)1 token
perplexityaisonar-prov1.030.0 (per 1000000 token)1 token
perplexityaisonarv1.02.0 (per 1000000 token)1 token
anthropic-bedrock-2023-05-3115.0 (per 1000000 token)1 token
anthropicclaude-3-5-haiku-20241022-v1:0bedrock-2023-05-314e-06 (per 1 token)1 token
anthropicclaude-3-5-sonnet-20240620-v1:0bedrock-2023-05-311.5e-05 (per 1 token)1 token
anthropicclaude-3-5-sonnet-20241022-v2:0bedrock-2023-05-311.5e-05 (per 1 token)1 token
anthropicclaude-3-7-sonnet-20240620-v1:0bedrock-2023-05-311.8e-05 (per 1 token)1 token
anthropicclaude-3-haiku-20240307-v1:0bedrock-2023-05-311.25e-06 (per 1 token)1 token
anthropicclaude-3-opus-20240229-v1:0bedrock-2023-05-317.5e-05 (per 1 token)1 token
anthropicclaude-3-sonnet-20240229-v1:0bedrock-2023-05-311.5e-05 (per 1 token)1 token
anthropicclaude-instant-v1bedrock-2023-05-312.4e-06 (per 1 token)1 token
anthropicclaude-v1bedrock-2023-05-312.4e-05 (per 1 token)1 token
anthropicclaude-v2:1bedrock-2023-05-312.4e-05 (per 1 token)1 token
anthropicclaude-3-5-haiku-20241022bedrock-2023-05-314e-06 (per 1 token)1 token
anthropicclaude-3-5-haiku-latestbedrock-2023-05-315e-06 (per 1 token)1 token
anthropicclaude-haiku-4-5-20251001bedrock-2023-05-315e-06 (per 1 token)1 token
anthropicclaude-haiku-4-5bedrock-2023-05-315e-06 (per 1 token)1 token
anthropicclaude-3-5-sonnet-20240620bedrock-2023-05-311.5e-05 (per 1 token)1 token
anthropicclaude-3-5-sonnet-20241022bedrock-2023-05-311.5e-05 (per 1 token)1 token
anthropicclaude-3-5-sonnet-latestbedrock-2023-05-311.5e-05 (per 1 token)1 token
anthropicclaude-3-7-sonnet-20250219bedrock-2023-05-311.5e-05 (per 1 token)1 token
anthropicclaude-3-7-sonnet-latestbedrock-2023-05-311.5e-05 (per 1 token)1 token
anthropicclaude-3-haiku-20240307bedrock-2023-05-311.25e-06 (per 1 token)1 token
anthropicclaude-3-opus-20240229bedrock-2023-05-317.5e-05 (per 1 token)1 token
anthropicclaude-3-opus-latestbedrock-2023-05-317.5e-05 (per 1 token)1 token
anthropicclaude-4-opus-20250514bedrock-2023-05-317.5e-05 (per 1 token)1 token
anthropicclaude-4-sonnet-20250514bedrock-2023-05-311.5e-05 (per 1 token)1 token
anthropicclaude-sonnet-4-5bedrock-2023-05-311.5e-05 (per 1 token)1 token
anthropicclaude-sonnet-4-5-20250929bedrock-2023-05-311.5e-05 (per 1 token)1 token
anthropicclaude-opus-4-1bedrock-2023-05-317.5e-05 (per 1 token)1 token
anthropicclaude-opus-4-1-20250805bedrock-2023-05-317.5e-05 (per 1 token)1 token
anthropicclaude-opus-4-20250514bedrock-2023-05-317.5e-05 (per 1 token)1 token
anthropicclaude-opus-4-5-20251101bedrock-2023-05-312.5e-05 (per 1 token)1 token
anthropicclaude-opus-4-5bedrock-2023-05-312.5e-05 (per 1 token)1 token
anthropicclaude-sonnet-4-20250514bedrock-2023-05-311.5e-05 (per 1 token)1 token
xai-v110.0 (per 1000000 token)1 token
xaigrok-2-latestv11e-05 (per 1 token)1 token
xaigrok-2v11e-05 (per 1 token)1 token
xaigrok-2-vision-1212v11e-05 (per 1 token)1 token
xaigrok-2-1212v11e-05 (per 1 token)1 token
xaigrok-2-visionv11e-05 (per 1 token)1 token
xaigrok-2-vision-latestv11e-05 (per 1 token)1 token
xaigrok-3v11.5e-05 (per 1 token)1 token
xaigrok-3-betav11.5e-05 (per 1 token)1 token
xaigrok-3-fast-betav12.5e-05 (per 1 token)1 token
xaigrok-3-fast-latestv12.5e-05 (per 1 token)1 token
xaigrok-3-latestv11.5e-05 (per 1 token)1 token
xaigrok-3-miniv15e-07 (per 1 token)1 token
xaigrok-3-mini-betav15e-07 (per 1 token)1 token
xaigrok-3-mini-fastv14e-06 (per 1 token)1 token
xaigrok-3-mini-fast-betav14e-06 (per 1 token)1 token
xaigrok-3-mini-fast-latestv14e-06 (per 1 token)1 token
xaigrok-3-mini-latestv15e-07 (per 1 token)1 token
xaigrok-4v11.5e-05 (per 1 token)1 token
xaigrok-4-fast-reasoningv15e-07 (per 1 token)1 token
xaigrok-4-fast-non-reasoningv15e-07 (per 1 token)1 token
xaigrok-4-0709v11.5e-05 (per 1 token)1 token
xaigrok-4-latestv11.5e-05 (per 1 token)1 token
xaigrok-4-1-fastv15e-07 (per 1 token)1 token
xaigrok-4-1-fast-reasoningv15e-07 (per 1 token)1 token
xaigrok-4-1-fast-reasoning-latestv15e-07 (per 1 token)1 token
xaigrok-4-1-fast-non-reasoningv15e-07 (per 1 token)1 token
xaigrok-4-1-fast-non-reasoning-latestv15e-07 (per 1 token)1 token
xaigrok-betav11.5e-05 (per 1 token)1 token
xaigrok-code-fastv11.5e-06 (per 1 token)1 token
xaigrok-code-fast-1v11.5e-06 (per 1 token)1 token
xaigrok-code-fast-1-0825v11.5e-06 (per 1 token)1 token
xaigrok-vision-betav11.5e-05 (per 1 token)1 token
deepseekdeepseek-v3v11.1e-06 (per 1 token)1 token
deepseek-v11.25 (per 1000000 token)1 token
deepseekdeepseek-reasonerv12.19e-06 (per 1 token)1 token
deepseekdeepseek-chatv11.1e-06 (per 1 token)1 token
deepseekdeepseek-coderv12.8e-07 (per 1 token)1 token
deepseekdeepseek-r1v12.19e-06 (per 1 token)1 token
deepseekdeepseek-v3.2v14e-07 (per 1 token)1 token
amazon-boto3 (v1.29.6)0.24 (per 1000000 token)1 token
amazonamazon.nova-lite-v1:0boto3 (v1.29.6)0.24 (per 1000000 token)1 token
amazonamazon.nova-pro-v1:0boto3 (v1.29.6)3.2 (per 1000000 token)1 token
amazonamazon.nova-micro-v1:0boto3 (v1.29.6)0.14 (per 1000000 token)1 token
together_ai-v11.2 (per 1000000 token)1 token
together_aiQwen/Qwen2.5-72B-Instruct-Turbov10.0 (per 1 seconde)1 seconde
together_aimeta-llama/Llama-3.3-70B-Instruct-Turbov18.8e-07 (per 1 token)1 token
together_aitogether-ai-21.1b-41bv18e-07 (per 1 token)1 token
together_aitogether-ai-4.1b-8bv12e-07 (per 1 token)1 token
together_aitogether-ai-41.1b-80bv19e-07 (per 1 token)1 token
together_aitogether-ai-8.1b-21bv13e-07 (per 1 token)1 token
together_aitogether-ai-81.1b-110bv11.8e-06 (per 1 token)1 token
together_aitogether-ai-up-to-4bv11e-07 (per 1 token)1 token
together_aiQwen/Qwen2.5-7B-Instruct-Turbov10.0 (per 1 seconde)1 seconde
together_aiQwen/Qwen3-235B-A22B-Instruct-2507-tputv16e-06 (per 1 token)1 token
together_aiQwen/Qwen3-235B-A22B-Thinking-2507v13e-06 (per 1 token)1 token
together_aiQwen/Qwen3-235B-A22B-fp8-tputv16e-07 (per 1 token)1 token
together_aiQwen/Qwen3-Coder-480B-A35B-Instruct-FP8v12e-06 (per 1 token)1 token
together_aideepseek-ai/DeepSeek-R1v17e-06 (per 1 token)1 token
together_aideepseek-ai/DeepSeek-R1-0528-tputv12.19e-06 (per 1 token)1 token
together_aideepseek-ai/DeepSeek-V3v11.25e-06 (per 1 token)1 token
together_aideepseek-ai/DeepSeek-V3.1v11.7e-06 (per 1 token)1 token
together_aimeta-llama/Llama-3.2-3B-Instruct-Turbov10.0 (per 1 seconde)1 seconde
together_aimeta-llama/Llama-3.3-70B-Instruct-Turbo-Freev10.0 (per 1 token)1 token
together_aimeta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8v18.5e-07 (per 1 token)1 token
together_aimeta-llama/Llama-4-Scout-17B-16E-Instructv15.9e-07 (per 1 token)1 token
together_aimeta-llama/Meta-Llama-3.1-405B-Instruct-Turbov13.5e-06 (per 1 token)1 token
together_aimeta-llama/Meta-Llama-3.1-70B-Instruct-Turbov18.8e-07 (per 1 token)1 token
together_aimeta-llama/Meta-Llama-3.1-8B-Instruct-Turbov11.8e-07 (per 1 token)1 token
together_aimistralai/Mistral-7B-Instruct-v0.1v10.0 (per 1 seconde)1 seconde
together_aimistralai/Mistral-Small-24B-Instruct-2501v10.0 (per 1 seconde)1 seconde
together_aimistralai/Mixtral-8x7B-Instruct-v0.1v16e-07 (per 1 token)1 token
together_aimoonshotai/Kimi-K2-Instructv13e-06 (per 1 token)1 token
together_aiopenai/gpt-oss-120bv16e-07 (per 1 token)1 token
together_aiopenai/gpt-oss-20bv12e-07 (per 1 token)1 token
together_aitogethercomputer/CodeLlama-34b-Instructv10.0 (per 1 seconde)1 seconde
together_aizai-org/GLM-4.5-Air-FP8v11.1e-06 (per 1 token)1 token
together_aizai-org/GLM-4.6v12.2e-06 (per 1 token)1 token
together_aimoonshotai/Kimi-K2-Instruct-0905v13e-06 (per 1 token)1 token
together_aiQwen/Qwen3-Next-80B-A3B-Instructv11.5e-06 (per 1 token)1 token
together_aiQwen/Qwen3-Next-80B-A3B-Thinkingv11.5e-06 (per 1 token)1 token
microsoftgpt-4oAzure AI Foundry15.0 (per 1000000 token)1 token
groqllama3-70b-8192v10.59 (per 1000000 token)1 token
groqllama-3.1-8b-instantv18e-08 (per 1 token)1 token
groqllama-3.3-70b-versatilev17.9e-07 (per 1 token)1 token
groqgemma-7b-itv18e-08 (per 1 token)1 token
groqmeta-llama/llama-guard-4-12bv12e-07 (per 1 token)1 token
groqmeta-llama/llama-4-maverick-17b-128e-instructv16e-07 (per 1 token)1 token
groqmeta-llama/llama-4-scout-17b-16e-instructv13.4e-07 (per 1 token)1 token
groqmoonshotai/kimi-k2-instruct-0905v13e-06 (per 1 token)1 token
groqopenai/gpt-oss-120bv17.5e-07 (per 1 token)1 token
groqopenai/gpt-oss-20bv15e-07 (per 1 token)1 token
groqqwen/qwen3-32bv15.9e-07 (per 1 token)1 token
Supported Detailed Languages
NameValue
Auto detectionauto-detect

Supported Models

Default Models
NameValue
openaigpt-4o
googlegemini-2.5-flash
coherecommand
metallama3-1-8b-instruct-v1:0
mistralmistral-large-latest
perplexityaisonar
anthropicclaude-3-5-sonnet-latest
xaigrok-2-latest
deepseekdeepseek-chat
amazonamazon.nova-lite-v1:0
together_aiQwen/Qwen2.5-72B-Instruct-Turbo
microsoftgpt-4o
groqllama3-70b-8192
Recent Requests
Log in to see full request history
TimeStatusUser Agent
Retrieving recent requests…
LoadingLoading…
Body Params
string
Defaults to [object Object]

A dictionnary or a json object to specify specific models to use for some providers.
It can be in the following format: {"google" : "google_model", "ibm": "ibm_model"...}.

providers
array of strings
required

It can be one (ex: 'amazon' or 'google') or multiple provider(s) (ex: 'amazon,microsoft,google') that the data will be redirected to in order to get the processed results.
Providers can also be invoked with specific models (ex: providers: 'amazon/model1, amazon/model2, google/model3')

providers*
fallback_providers
array of strings
length ≤ 5
Defaults to

Providers in this list will be used as fallback if the call to provider in providers parameter fails. To use this feature, you must input only one provider in the providers parameter. but you can put up to 5 fallbacks.

They will be tried in the same order they are input, and it will stop to the first provider who doesn't fail.

Doesn't work with async subfeatures.

fallback_providers
boolean
Defaults to true

Optional : When set to true (default), the response is an object of responses with providers names as keys :
{"google" : { "status": "success", ... }, }
When set to false the response structure is a list of response objects :
[{"status": "success", "provider": "google" ... }, ].

boolean
Defaults to false

Optional : When set to false (default) the structure of the extracted items is list of objects having different attributes :
{'items': [{"attribute_1": "x1","attribute_2": "y2"}, ... ]}
When it is set to true, the response contains an object with each attribute as a list :
{ "attribute_1": ["x1","x2", ...], "attribute_2": [y1, y2, ...]}

boolean
Defaults to true
boolean
Defaults to false

Optional : Shows the original response of the provider.
When set to true, a new attribute original_response will appear in the response object.

string | null

Start your conversation here...

string | null

A system message that helps set the behavior of the assistant. For example, 'You are a helpful assistant'.

previous_history
array of objects

A list containing all the previous conversations between the user and the chatbot AI. Each item in the list should be a dictionary with two keys: 'role' and 'message'. The 'role' key specifies the role of the speaker and can have the values 'user' or 'assistant'. The 'message' key contains the text of the conversation from the respective role. For example: [{'role': 'user', 'message': 'Hello'}, {'role': 'assistant', 'message': 'Hi, how can I help you?'}, ...]. This format allows easy identification of the speaker's role and their corresponding message.

previous_history
double
0 to 2
Defaults to 0

Higher values mean the model will take more risks and value 0 (argmax sampling) works better for scenarios with a well-defined answer.

integer
≥ 1
Defaults to 4096

The maximum number of tokens to generate in the completion. The token count of your prompt plus max_tokens cannot exceed the model's context length.

string
enum
Defaults to auto
  • auto - auto
  • required - required
  • none - none
Allowed:
available_tools
array of objects

A list of tools the model may generate the right arguments for.

available_tools
tool_results
array of objects

List of results obtained from applying the tool_call arguments to your own tool.

tool_results
string
enum

Choices:

  • 'low': Minimal reasoning, quick responses
  • 'medium': Balanced reasoning approach
  • 'high': In-depth, comprehensive reasoning

Example: 'high' for complex problem-solving tasks

  • low - low
  • medium - medium
  • high - high
Allowed:
Responses

Language
Credentials
Bearer
JWT
LoadingLoading…
Response
Click Try It! to start a request and see the response here! Or choose an example:
application/json