Model
Context
Max Output
Latency
Throughput
Input
Output
Cache
Image Gen
Video Gen
Web Search
Capabilities
Providers
256K32K
2.2s
76tps
$0.03/M$1.20/M
Read:$0.06/M
Write:
novita logo
streamlake logo
1000K64K
0.8s
77tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
1000K65K
0.9s
156tps
$0.50/M$3.00/M
Read:$0.05/M
Write:
$14.00/K
+ input costs
google logo
vertex logo
1049K66K
0.3s
264tps
$0.10/M$0.40/M
Read:$0.01/M
Write:
$35.00/K
+ input costs
google logo
vertex logo
1000K128K
1.2s
67tps
$5.00/M$25.00/M
Read:$0.50/M
Write:$6.25/M
$10/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
262K262K
0.4s
152tps
$0.50/M$2.80/M
Read:$0.10/M
Write:
fireworks logo
moonshotai logo
novita logo
+1
400K128K
0.9s
59tps
$1.75/M$14.00/M
Read:$0.17/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
200K64K
0.5s
112tps
$1.00/M$5.00/M
Read:$0.10/M
Write:$1.25/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
205K200K
0.6s
188tps
$0.30/M$1.20/M
Read:$0.03/M
Write:$0.38/M
bedrock logo
deepinfra logo
fireworks logo
+2
200K64K
0.5s
55tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
anthropic logo
bedrock logo
vertexAnthropic logo
203K131K
13.2s
43tps
$1.00/M$3.20/M
Read:$0.20/M
Write:
novita logo
zai logo
1000K64K
3.5s
131tps
$2.00/M$12.00/M
Read:$0.20/M
Write:
$14.00/K
+ input costs
google logo
vertex logo
200K64K
0.8s
51tps
$5.00/M$25.00/M
Read:$0.50/M
Write:$6.25/M
anthropic logo
bedrock logo
vertexAnthropic logo
128K16K
0.5s
122tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/M
$10.00/K
+ input costs
+1
openai logo
1000K64K
0.7s
77tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
256K256K
0.3s
169tps
$0.20/M$1.50/M
Read:$0.02/M
Write:
xai logo
164K66K
1.0s
35tps
$0.26/M$0.38/M
Read:$0.13/M
Write:
deepinfra logo
deepseek logo
novita logo
1000K66K
0.4s
305tps
$0.30/M$2.50/M
Read:$0.03/M
Write:
$35.00/K
+ input costs
deepinfra logo
google logo
vertex logo
400K128K
3.0s
291tps
$0.25/M$2.00/M
Read:$0.03/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
205K131K
0.3s
430tps
$2.25/M$2.75/M
Read:$2.25/M
Write:
cerebras logo
deepinfra logo
novita logo
+1
128K16K
0.6s
100tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
2000K30K
3.9s
245tps
$0.20/M$0.50/M
Read:$0.05/M
Write:
xai logo
400K128K
5.4s
321tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/M
$10.00/K
+ input costs
azure logo
openai logo
400K128K
3.4s
124tps
$1.75/M$14.00/M
Read:$0.17/M
Write:
$10/K
+ input costs
openai logo
256K256K
1.8s
76tps
mistral logo
400K128K
5.9s
150tps
$0.05/M$0.40/M
Read:$0.01/M
Write:
$0.40/M
$10.00/K
+ input costs
azure logo
openai logo
131K131K
0.1s
1574tps
$0.25/M$0.69/M
Read:$0.25/M
Write:
baseten logo
bedrock logo
cerebras logo
+5
400K128K
0.8s
123tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/M
$10.00/K
+ input costs
+1
azure logo
openai logo
128K16K
0.5s
52tps
$0.15/M$0.60/M
Read:$0.07/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
1049K66K
2.1s
186tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$35.00/K
+ input costs
deepinfra logo
google logo
vertex logo
1048K33K
0.7s
65tps
$0.40/M$1.60/M
Read:$0.10/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
2000K30K
0.7s
128tps
$0.20/M$0.50/M
Read:$0.05/M
Write:
xai logo
2000K256K
0.7s
81tps
$0.20/M$0.50/M
Read:$0.05/M
Write:
xai logo
1049K8K
0.4s
137tps
$0.15/M$0.60/M
Read:$0.03/M
Write:
$35.00/K
+ input costs
google logo
vertex logo
128K16K
0.6s
88tps
$2.50/M$10.00/M
Read:$1.25/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
$0.02/M
azure logo
openai logo
1048K33K
0.6s
32tps
$2.00/M$8.00/M
Read:$0.50/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
2000K256K
1.0s
155tps
$0.20/M$0.50/M
Read:$0.05/M
Write:
xai logo
33K66K
0.5s
159tps
$0.30/M$2.50/M$0.04/img
google logo
vertex logo
131K66K
0.1s
$0.07/M$0.30/M
Read:$0.04/M
Write:
groq logo
131K128K
0.2s
161tps
$0.07/M$0.30/M
Read:$0.04/M
Write:
bedrock logo
fireworks logo
groq logo
128K4K
0.2s
$0.04/M$0.04/M
mistral logo
200K100K
1.6s
234tps
$1.10/M$4.40/M
Read:$0.28/M
Write:
azure logo
openai logo
205K131K
4.8s
65tps
$0.30/M$1.20/M
Read:$0.03/M
Write:$0.38/M
minimax logo
128K33K
0.2s
179tps
$0.85/M$1.20/M
Read:$0.85/M
Write:
bedrock logo
cerebras logo
groq logo
400K128K
0.6s
136tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
128K64K
1.7s
44tps
$0.28/M$0.42/M
Read:$0.03/M
Write:
deepseek logo
400K128K
0.5s
$0.25/M$2.00/M
Read:$0.03/M
Write:
$10.00/K
+ input costs
openai logo
205K203K
0.4s
172tps
$0.45/M$1.80/M
Read:$0.11/M
Write:
baseten logo
deepinfra logo
fireworks logo
+2
262K128K
0.1s
444tps
$1.00/M$3.00/M
Read:$0.50/M
Write:
baseten logo
fireworks logo
groq logo
+1
128K8K
0.3s
$0.04/M$0.14/M
bedrock logo
131K8K
0.2s
161tps
$0.17/M$0.66/M
bedrock logo
deepinfra logo
groq logo
400K128K
0.5s
294tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
$0.10/M
mistral logo
1048K33K
0.3s
$0.10/M$0.40/M
Read:$0.03/M
Write:
$10.00/K
+ input costs
azure logo
openai logo
1000K66K
0.3s
232tps
$0.30/M$2.50/M
Read:$0.03/M
Write:
$35.00/K
+ input costs
google logo
vertex logo
1049K8K
0.4s
141tps
$0.07/M$0.30/M
$35.00/K
+ input costs
google logo
vertex logo
82K16K
0.3s
$0.80/M$1.20/M
morph logo
$0.13/M
azure logo
openai logo
66K33K
12.6s
244tps
$2.00/M$120.00/M$120.00/M
$14.00/K
+ input costs
google logo
vertex logo
1049K66K
0.2s
310tps
$0.10/M$0.40/M
Read:$0.01/M
Write:
$35/K
+ input costs
google logo
vertex logo
164K16K
0.3s
156tps
$1.35/M$5.40/M
Read:$0.40/M
Write:
bedrock logo
deepinfra logo
parasail logo
400K128K
1.5s
133tps
$1.25/M$10.00/M
Read:$0.13/M
Write:
$10.00/K
+ input costs
openai logo
200K100K
3.2s
64tps
$2.00/M$8.00/M
Read:$0.50/M
Write:
openai logo
$0.15/M
google logo
vertex logo
131K131K
0.1s
83tps
$0.10/M$0.10/M
bedrock logo
cerebras logo
deepinfra logo
+2
128K16K
0.8s
72tps
$1.75/M$14.00/M
Read:$0.17/M
Write:
$10.00/K
+ input costs
openai logo
256K256K
1.1s
79tps
$0.22/M$0.88/M
alibaba logo
fireworks logo
novita logo
200K8K
1.3s
131tps
$3.00/M$15.00/M
perplexity logo
524K8K
0.2s
46tps
$0.24/M$0.97/M
bedrock logo
deepinfra logo
vertex logo
164K164K
0.6s
39tps
$0.77/M$0.77/M
baseten logo
novita logo
$0.06/M
voyage logo
262K66K
1.6s
33tps
$1.20/M$6.00/M
Read:$0.24/M
Write:
alibaba logo
novita logo
127K8K
1.6s
89tps
$1.00/M$1.00/M
perplexity logo
131K131K
0.7s
31tps
$0.25/M$1.00/M
arcee-ai logo
32K4K
0.3s
126tps
$0.10/M$0.30/M
mistral logo
200K8K
0.4s
54tps
$0.80/M$4.00/M
Read:$0.08/M
Write:$1.00/M
$10/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
131K131K
0.4s
85tps
$0.15/M$0.15/M
deepinfra logo
mistral logo
novita logo
$0.03/M
vertex logo
262K32K
2.4s
60tps
$0.10/M$0.30/M
Read:$0.02/M
Write:
chutes logo
novita logo
128K64K
0.3s
101tps
$0.40/M$2.00/M
mistral logo
205K131K
1.1s
112tps
$0.30/M$2.40/M
Read:$0.03/M
Write:$0.38/M
minimax logo
256K256K
4.2s
63tps
$3.00/M$15.00/M
xai logo
205K205K
2.3s
50tps
$0.30/M$1.20/M
Read:$0.03/M
Write:$0.38/M
minimax logo
novita logo
164K164K
0.3s
269tps
$0.50/M$1.50/M
baseten logo
deepinfra logo
fireworks logo
+3
256K256K
0.3s
mistral logo
$0.15/M
mistral logo
400K128K
$21.00/M$168.00/M
$10.00/K
+ input costs
openai logo
200K32K
1.2s
42tps
$15.00/M$75.00/M
Read:$1.50/M
Write:$18.75/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
262K67K
1.0s
89tps
$0.40/M$1.60/M
Read:$0.30/M
Write:
alibaba logo
deepinfra logo
fireworks logo
+1
262K262K
0.4s
187tps
$0.60/M$2.50/M
Read:$0.15/M
Write:
baseten logo
deepinfra logo
fireworks logo
+2
128K64K
0.3s
138tps
$0.50/M$1.50/M
mistral logo
128K4K
0.3s
71tps
$2.00/M$6.00/M
mistral logo
300K8K
0.4s
112tps
$0.06/M$0.24/M
bedrock logo
256K256K
0.5s
61tps
$0.50/M$1.50/M
mistral logo
200K8K
0.5s
72tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
bedrock logo
vertexAnthropic logo
131K131K
0.6s
40tps
$0.50/M$2.00/M
deepinfra logo
fireworks logo
moonshotai logo
+2
131K66K
1.1s
280tps
$0.15/M$1.50/M
alibaba logo
novita logo
200K32K
1.1s
44tps
$15.00/M$75.00/M
Read:$1.50/M
Write:$18.75/M
$10.00/K
+ input costs
anthropic logo
bedrock logo
vertexAnthropic logo
131K131K
0.4s
77tps
$0.60/M$4.00/M
xai logo
262K262K
1.2s
75tps
$1.15/M$8.00/M
Read:$0.15/M
Write:
moonshotai logo
131K66K
1.2s
35tps
$0.27/M$1.00/M
novita logo
$0.03/M
vertex logo
200K4K
0.3s
134tps
$0.25/M$1.25/M
Read:$0.03/M
Write:$0.30/M
anthropic logo
bedrock logo
vertexAnthropic logo
256K256K
1.7s
$0.50/M$1.20/M
togetherai logo
200K131K
2.7s
51tps
zai logo
256K16K
0.8s
$2.40/M$10.00/M
moonshotai logo
262K262K
0.5s
54tps
$0.20/M$1.20/M
Read:$0.11/M
Write:
alibaba logo
deepinfra logo
fireworks logo
+1
131K131K
0.3s
198tps
$0.20/M$0.60/M
bedrock logo
deepinfra logo
256K66K
1.8s
33tps
$1.20/M$6.00/M
Read:$0.24/M
Write:
alibaba logo
128K4K
0.3s
142tps
$0.10/M$0.10/M
mistral logo
$0.10/M
azure logo
openai logo
131K131K
0.7s
78tps
$0.60/M$2.20/M
Read:$0.11/M
Write:
novita logo
zai logo
256K256K
0.3s
123tps
$0.20/M$0.20/M
mistral logo
$0.12/M
cohere logo
262K66K
0.4s
178tps
$0.09/M$1.10/M
alibaba logo
deepinfra logo
novita logo
131K41K
0.2s
636tps
$0.40/M$0.80/M
alibaba logo
bedrock logo
cerebras logo
+2
200K128K
6.1s
56tps
$0.06/M$0.40/M
Read:$0.01/M
Write:
zai logo
128K100K
3.7s
126tps
chutes logo
meituan logo
33K33K
$0.05/M
deepinfra logo
$0.18/M
voyage logo
131K33K
0.8s
24tps
$0.07/M$0.46/M
Read:$0.11/M
Write:
deepinfra logo
fireworks logo
novita logo
33K33K
$0.01/M
deepinfra logo
33K33K
$0.02/M
deepinfra logo
128K4K
0.2s
376tps
$0.30/M$0.90/M
mistral logo
128K16K
1.4s
82tps
$0.15/M$0.60/M
$10.00/K
+ input costs
openai logo
1000K1000K
0.4s
173tps
$0.30/M$2.50/M
bedrock logo
131K131K
0.4s
77tps
$0.30/M$0.50/M
xai logo
262K33K
0.7s
130tps
$0.15/M$0.60/M
bedrock logo
novita logo
16K4K
0.4s
$0.50/M$1.50/M
openai logo
41K16K
0.2s
80tps
$0.06/M$0.24/M
deepinfra logo
128K4K
0.9s
34tps
$10.00/M$30.00/M
openai logo
200K100K
2.9s
$1.10/M$4.40/M
Read:$0.55/M
Write:
azure logo
openai logo
128K4K
0.2s
125tps
$0.15/M$0.15/M
mistral logo
128K33K
4.2s
58tps
$3.00/M$15.00/M
vercel logo
400K272K
$15.00/M$120.00/M$120.00/M
$10.00/K
+ input costs
+1
openai logo
128K24K
2.7s
78tps
$0.30/M$0.90/M
Read:$0.05/M
Write:
zai logo
131K131K
0.4s
70tps
$3.00/M$15.00/M
xai logo
262K262K
0.5s
60tps
$0.30/M$2.90/M
deepinfra logo
novita logo
$0.18/M
voyage logo
128K24K
1.5s
135tps
zai logo
128K32K
4.3s
59tps
$3.00/M$15.00/M
vercel logo
128K8K
0.3s
53tps
$0.15/M$0.15/M
bedrock logo
127K8K
2.7s
104tps
$2.00/M$8.00/M
perplexity logo
128K96K
2.3s
57tps
$0.20/M$1.10/M
Read:$0.03/M
Write:
zai logo
131K131K
0.4s
75tps
$0.20/M$1.10/M
parasail logo
256K32K
1.5s
63tps
$0.25/M$2.00/M
Read:$0.05/M
Write:
bytedance logo
131K131K
0.2s
153tps
$0.06/M$0.23/M
bedrock logo
deepinfra logo
41K16K
0.5s
48tps
$0.08/M$0.29/M
deepinfra logo
66K16K
1.1s
72tps
$0.60/M$1.80/M
Read:$0.11/M
Write:
novita logo
zai logo
33K33K
0.6s
102tps
$2.00/M$10.00/M
xai logo
256K64K
1.2s
79tps
$0.25/M$2.00/M
Read:$0.05/M
Write:
bytedance logo
33K33K
3.3s
121tps
meituan logo
131K131K
0.3s
68tps
$5.00/M$25.00/M
xai logo
256K8K
1.1s
47tps
$2.50/M$10.00/M
cohere logo
200K100K
3.1s
$15.00/M$60.00/M
Read:$7.50/M
Write:
azure logo
openai logo
131K16K
0.3s
48tps
$0.72/M$0.72/M
bedrock logo
deepinfra logo
131K131K
0.6s
227tps
$0.04/M$0.15/M
arcee-ai logo
128K64K
0.3s
58tps
$2.00/M$5.00/M
mistral logo
200K100K
$20.00/M$80.00/M
openai logo
300K8K
0.4s
138tps
$0.80/M$3.20/M
bedrock logo
200K8K
0.5s
80tps
$3.00/M$15.00/M
Read:$0.30/M
Write:$3.75/M
bedrock logo
vertexAnthropic logo
128K8K
0.3s
63tps
$0.72/M$0.72/M
bedrock logo
128K8K
0.2s
160tps
$0.16/M$0.16/M
bedrock logo
128K8K
0.3s
90tps
$0.10/M$0.10/M
bedrock logo
262K33K
1.7s
67tps
$1.20/M$6.00/M
Read:$0.24/M
Write:
alibaba logo
66K2K
0.3s
$1.20/M$1.20/M
fireworks logo
1000K66K
1.5s
42tps
$1.00/M$5.00/M
Read:$0.20/M
Write:
alibaba logo
200K8K
0.9s
15tps
$15.00/M$75.00/M
bedrock logo
128K64K
0.3s
$0.10/M$0.30/M
mistral logo
200K100K
$1.50/M$6.00/M
Read:$0.38/M
Write:
openai logo
262K262K
0.3s
$0.06/M$0.24/M
deepinfra logo
82K16K
0.3s
$0.90/M$1.90/M
morph logo
$0.02/M
voyage logo
$0.12/M
voyage logo
$0.02/M
bedrock logo
32K16K
0.7s
$0.25/M$1.00/M
inception logo
$0.014/MP
bfl logo
67K67K
$0.07/MP
bfl logo
200K100K
$10.00/M$40.00/M
Read:$2.50/M
Write:
$10.00/K
+ input costs
openai logo
$0.06/img
bfl logo
512
$0.04/img
bfl logo
prodia logo
$0.02/img
recraft logo
128K8K
$0.15/M$1.50/M
chutes logo
480
$0.02/img
vertex logo
$0.04/img
bfl logo
127K8K
$1.00/M$5.00/M
perplexity logo
$0.015/MP
bfl logo
$0.12/M
voyage logo
8K4K
$1.50/M$2.00/M
openai logo
480
$0.04/img
vertex logo
$0.05/img
bfl logo
512
$0.08/img
bfl logo
$0.06/MP
bfl logo
67K67K
$0.03/MP
bfl logo
$0.04/img
recraft logo
480
$0.06/img
vertex logo
$0.12/M
voyage logo