Model Status
Last tested: 2026-07-16 12:00:01 UTC
318 of 319 models passed. Chat/completion: 296/297. Embeddings: 22/22.
Chat and Completion Models
| Model | Underlying Model | Status | Tokens (p/r/m/t) | Time | Cost |
|---|---|---|---|---|---|
gpt-4o | openai/gpt-4o | ✅ | p=16 r=0 t=17 | 2.1s | $0.00005 |
gpt-4o-mini | openai/gpt-4o-mini | ✅ | p=16 r=0 t=17 | 1.3s | $0.000003 |
gpt-4.1 | openai/gpt-4.1 | ✅ | p=16 r=0 t=17 | 572ms | $0.00004 |
gpt-4.1-mini | openai/gpt-4.1-mini | ✅ | p=16 r=0 t=17 | 926ms | $0.000008 |
gpt-4.1-nano | openai/gpt-4.1-nano | ✅ | p=16 r=0 t=17 | 469ms | $0.000002 |
gpt-5 | openai/gpt-5 | ✅ | p=15 r=64 t=89 | 2.3s | $0.000759 |
gpt-5-chat | openai/gpt-5-chat-latest | ✅ | p=16 r=0 t=17 | 750ms | $0.00003 |
gpt-5-mini | openai/gpt-5-mini | ✅ | p=15 r=64 t=89 | 1.8s | $0.000152 |
gpt-5-mini-high | openai/gpt-5-mini | ✅ | p=15 r=128 t=153 | 3.0s | $0.00028 |
gpt-5-nano | openai/gpt-5-nano | ✅ | p=15 r=64 t=89 | 1.2s | $0.00003 |
gpt-5-nano-high | openai/gpt-5-nano | ✅ | p=15 r=256 t=281 | 2.1s | $0.000107 |
gpt-5-codex | openai/gpt-5-codex | ✅ | p=15 r=0 t=30 | 1.4s | $0.000169 |
gpt-5-high | openai/gpt-5 | ✅ | p=15 r=0 t=25 | 1.2s | $0.000119 |
gpt-5.1 | openai/gpt-5.1 | ✅ | p=15 r=0 t=25 | 887ms | $0.000119 |
gpt-5.1-chat | openai/gpt-5.1-chat-latest | ✅ | p=15 r=0 t=25 | 1.3s | $0.000119 |
gpt-5.1-codex | openai/gpt-5.1-codex | ✅ | p=15 r=0 t=31 | 815ms | $0.000179 |
gpt-5.1-codex-mini | openai/gpt-5.1-codex-mini | ✅ | p=15 r=0 t=34 | 865ms | $0.000042 |
gpt-5.1-codex-max | openai/gpt-5.1-codex-max | ✅ | p=15 r=64 t=121 | 1.3s | $0.001079 |
gpt-5.1-high | openai/gpt-5.1 | ✅ | p=15 r=8 t=33 | 1.2s | $0.000199 |
gpt-5.2 | openai/gpt-5.2 | ✅ | p=15 r=0 t=19 | 838ms | $0.000082 |
gpt-5.2-chat | openai/gpt-5.2-chat-latest | ✅ | p=15 r=0 t=25 | 1.2s | $0.000166 |
gpt-5.2-codex | openai/gpt-5.2-codex | ✅ | p=15 r=0 t=31 | 1.0s | $0.00025 |
gpt-5.2-high | openai/gpt-5.2 | ✅ | p=15 r=0 t=19 | 896ms | $0.000082 |
gpt-5.2-pro | openai/gpt-5.2 | ✅ | p=15 r=0 t=19 | 956ms | $0.000082 |
gpt-5.3-codex | openai/gpt-5.3-codex | ✅ | p=15 r=0 t=20 | 733ms | $0.000096 |
gpt-5.3-codex-high | openai/gpt-5.3-codex | ✅ | p=15 r=13 t=35 | 947ms | $0.000306 |
gpt-5.3-codex-xhigh | openai/gpt-5.3-codex | ✅ | p=15 r=0 t=20 | 133ms | $0.000096 |
gpt-5.4 | openai/gpt-5.4 | ✅ | p=15 r=0 t=19 | 877ms | $0.000098 |
gpt-5.4-mini | openai/gpt-5.4-mini | ✅ | p=15 r=0 t=19 | 787ms | $0.000029 |
gpt-5.4-nano | openai/gpt-5.4-nano | ✅ | p=15 r=0 t=19 | 775ms | $0.000008 |
gpt-5.4-high | openai/gpt-5.4 | ✅ | p=15 r=9 t=34 | 887ms | $0.000322 |
gpt-5.4-xhigh | openai/gpt-5.4 | ✅ | p=15 r=16 t=41 | 821ms | $0.000428 |
gpt-5.4-mini-high | openai/gpt-5.4-mini | ✅ | p=15 r=0 t=19 | 588ms | $0.000029 |
gpt-5.4-mini-xhigh | openai/gpt-5.4-mini | ✅ | p=15 r=14 t=39 | 601ms | $0.000119 |
gpt-5.4-nano-high | openai/gpt-5.4-nano | ✅ | p=15 r=0 t=19 | 659ms | $0.000008 |
gpt-5.4-nano-xhigh | openai/gpt-5.4-nano | ✅ | p=15 r=10 t=35 | 837ms | $0.000028 |
gpt-5.4-pro | openai/gpt-5.4 | ✅ | p=15 r=0 t=19 | 838ms | $0.000098 |
openai/gpt-5.5 | openai/gpt-5.5 | ✅ | p=15 r=0 t=19 | 998ms | $0.000195 |
openai/gpt-5.5-low | openai/gpt-5.5 | ✅ | p=15 r=4 t=29 | 1.6s | $0.000495 |
openai/gpt-5.5-medium | openai/gpt-5.5 | ✅ | p=15 r=7 t=32 | 1.4s | $0.000585 |
openai/gpt-5.5-high | openai/gpt-5.5 | ✅ | p=15 r=6 t=31 | 1.4s | $0.000555 |
openai/gpt-5.5-xhigh | openai/gpt-5.5 | ✅ | p=15 r=8 t=33 | 1.0s | $0.000615 |
openai/gpt-5.5-pro | openai/gpt-5.5-pro | ✅ | p=15 r=10 t=32 | 15.9s | $0.00351 |
gpt-5.6-sol | openai/gpt-5.6-sol | ✅ | p=15 r=0 t=19 | 1.1s | $0.000195 |
gpt-5.6-sol-low | openai/gpt-5.6-sol | ✅ | p=15 r=0 t=19 | 1.3s | $0.000195 |
gpt-5.6-sol-medium | openai/gpt-5.6-sol | ✅ | p=15 r=0 t=19 | 1.1s | $0.000195 |
gpt-5.6-sol-high | openai/gpt-5.6-sol | ✅ | p=15 r=0 t=19 | 1.2s | $0.000195 |
gpt-5.6-sol-xhigh | openai/gpt-5.6-sol | ✅ | p=15 r=0 t=19 | 1.3s | $0.000195 |
gpt-5.6-terra | openai/gpt-5.6-terra | ✅ | p=15 r=0 t=19 | 778ms | $0.000098 |
gpt-5.6-terra-low | openai/gpt-5.6-terra | ✅ | p=15 r=0 t=19 | 708ms | $0.000098 |
gpt-5.6-terra-medium | openai/gpt-5.6-terra | ✅ | p=15 r=0 t=19 | 1.5s | $0.000098 |
gpt-5.6-terra-high | openai/gpt-5.6-terra | ✅ | p=15 r=0 t=19 | 643ms | $0.000098 |
gpt-5.6-terra-xhigh | openai/gpt-5.6-terra | ✅ | p=15 r=0 t=19 | 698ms | $0.000098 |
gpt-5.6-luna | openai/gpt-5.6-luna | ✅ | p=15 r=0 t=19 | 888ms | $0.000039 |
gpt-5.6-luna-low | openai/gpt-5.6-luna | ✅ | p=15 r=0 t=19 | 926ms | $0.000039 |
gpt-5.6-luna-medium | openai/gpt-5.6-luna | ✅ | p=15 r=0 t=19 | 740ms | $0.000039 |
gpt-5.6-luna-high | openai/gpt-5.6-luna | ✅ | p=15 r=0 t=19 | 759ms | $0.000039 |
gpt-5.6-luna-xhigh | openai/gpt-5.6-luna | ✅ | p=15 r=0 t=19 | 817ms | $0.000039 |
o1 | openai/o1 | ✅ | p=15 r=0 t=30 | 1.4s | $0.001125 |
o1-high | openai/o1 | ✅ | p=15 r=128 t=157 | 2.3s | $0.008745 |
google/claude-haiku-4-5 | vertex_ai/claude-haiku-4-5@20251001 | ✅ | p=17 r=0 m=4 t=21 | 924ms | $0.000037 |
google/claude-haiku-4-5-high | vertex_ai/claude-haiku-4-5@20251001 | ✅ | p=46 r=33 m=16 t=95 | 928ms | $0.000291 |
google/claude-sonnet-4 | vertex_ai/claude-sonnet-4@20250514 | ✅ | p=17 r=0 m=4 t=21 | 1.6s | $0.000111 |
google/claude-sonnet-4-high | vertex_ai/claude-sonnet-4@20250514 | ✅ | p=46 r=40 m=15 t=101 | 1.8s | $0.000963 |
google/claude-sonnet-4-5 | vertex_ai/claude-sonnet-4-5@20250929 | ✅ | p=17 r=0 m=4 t=21 | 1.0s | $0.000111 |
google/claude-sonnet-4-5-high | vertex_ai/claude-sonnet-4-5@20250929 | ✅ | p=46 r=42 m=16 t=104 | 1.7s | $0.001008 |
google/claude-sonnet-4-6 | vertex_ai/claude-sonnet-4-6@default | ✅ | p=17 r=0 m=4 t=21 | 1.0s | $0.000111 |
google/claude-sonnet-4-6-high | vertex_ai/claude-sonnet-4-6@default | ✅ | p=17 r=0 m=4 t=21 | 5.4s | $0.000111 |
google/claude-sonnet-5 | vertex_ai/claude-sonnet-5 | ✅ | p=22 r=0 m=4 t=26 | 884ms | $0.000084 |
google/claude-sonnet-5-low | vertex_ai/claude-sonnet-5 | ✅ | p=22 r=0 m=4 t=26 | 739ms | $0.000084 |
google/claude-sonnet-5-medium | vertex_ai/claude-sonnet-5 | ✅ | p=22 r=0 m=4 t=26 | 887ms | $0.000084 |
google/claude-sonnet-5-high | vertex_ai/claude-sonnet-5 | ✅ | p=22 r=0 m=4 t=26 | 828ms | $0.000084 |
google/claude-sonnet-5-xhigh | vertex_ai/claude-sonnet-5 | ✅ | p=22 r=0 m=4 t=26 | 722ms | $0.000084 |
google/claude-sonnet-5-max | vertex_ai/claude-sonnet-5 | ✅ | p=22 r=0 m=4 t=26 | 784ms | $0.000084 |
google/claude-opus-4 | vertex_ai/claude-opus-4@20250514 | ✅ | p=17 r=0 m=4 t=21 | 1.5s | $0.000555 |
google/claude-opus-4-high | vertex_ai/claude-opus-4@20250514 | ✅ | p=46 r=39 m=15 t=100 | 2.8s | $0.00474 |
google/claude-opus-4-1 | vertex_ai/claude-opus-4-1@20250805 | ✅ | p=17 r=0 m=4 t=21 | 1.8s | $0.000555 |
google/claude-opus-4-1-high | vertex_ai/claude-opus-4-1@20250805 | ✅ | p=17 r=0 m=4 t=21 | 1.6s | $0.000555 |
google/claude-opus-4-5 | vertex_ai/claude-opus-4-5@20251101 | ✅ | p=17 r=0 m=4 t=21 | 1.7s | $0.000185 |
google/claude-opus-4-5-high | vertex_ai/claude-opus-4-5@20251101 | ✅ | p=46 r=15 m=12 t=73 | 885ms | $0.000905 |
google/claude-opus-4-6 | vertex_ai/claude-opus-4-6@default | ✅ | p=17 r=0 m=4 t=21 | 1.6s | $0.000185 |
google/claude-opus-4-6-high | vertex_ai/claude-opus-4-6@default | ✅ | p=17 r=0 m=5 t=22 | 2.0s | $0.00021 |
google/claude-opus-4-7 | vertex_ai/claude-opus-4-7 | ✅ | p=27 r=0 m=6 t=33 | 901ms | $0.000285 |
google/claude-opus-4-7-low | vertex_ai/claude-opus-4-7 | ✅ | p=27 r=0 m=6 t=33 | 818ms | $0.000285 |
google/claude-opus-4-7-medium | vertex_ai/claude-opus-4-7 | ✅ | p=27 r=0 m=6 t=33 | 2.5s | $0.000285 |
google/claude-opus-4-7-high | vertex_ai/claude-opus-4-7 | ✅ | p=27 r=0 m=6 t=33 | 872ms | $0.000285 |
google/claude-opus-4-7-xhigh | vertex_ai/claude-opus-4-7 | ✅ | p=27 r=0 m=6 t=33 | 956ms | $0.000285 |
google/claude-opus-4-7-max | vertex_ai/claude-opus-4-7 | ✅ | p=27 r=0 m=6 t=33 | 980ms | $0.000285 |
google/claude-opus-4-8 | vertex_ai/claude-opus-4-8 | ✅ | p=22 r=0 m=4 t=26 | 881ms | $0.00021 |
google/claude-opus-4-8-low | vertex_ai/claude-opus-4-8 | ✅ | p=22 r=0 m=4 t=26 | 822ms | $0.00021 |
google/claude-opus-4-8-medium | vertex_ai/claude-opus-4-8 | ✅ | p=22 r=0 m=4 t=26 | 883ms | $0.00021 |
google/claude-opus-4-8-high | vertex_ai/claude-opus-4-8 | ✅ | p=22 r=0 m=4 t=26 | 815ms | $0.00021 |
google/claude-opus-4-8-xhigh | vertex_ai/claude-opus-4-8 | ✅ | p=22 r=0 m=4 t=26 | 3.3s | $0.00021 |
google/claude-opus-4-8-max | vertex_ai/claude-opus-4-8 | ✅ | p=22 r=0 m=4 t=26 | 899ms | $0.00021 |
google/claude-fable-5 | vertex_ai/claude-fable-5 | ✅ | p=22 r=0 m=13 t=35 | 2.3s | $0.00087 |
google/claude-fable-5-low | vertex_ai/claude-fable-5 | ✅ | p=22 r=0 m=4 t=26 | 1.4s | $0.00042 |
google/claude-fable-5-medium | vertex_ai/claude-fable-5 | ✅ | p=22 r=0 m=4 t=26 | 1.2s | $0.00042 |
google/claude-fable-5-high | vertex_ai/claude-fable-5 | ✅ | p=22 r=0 m=15 t=37 | 3.0s | $0.00097 |
google/claude-fable-5-xhigh | vertex_ai/claude-fable-5 | ✅ | p=22 r=0 m=27 t=49 | 3.0s | $0.00157 |
google/claude-fable-5-ultra | vertex_ai/claude-fable-5 | ✅ | p=22 r=0 m=65 t=87 | 1.9s | $0.00347 |
amazon/claude-haiku-4-5 | bedrock/us.anthropic.claude-haiku-4-5-20251001-v1:0 | ✅ | p=17 r=0 m=4 t=21 | 1.4s | $0.000041 |
amazon/claude-haiku-4-5-high | bedrock/us.anthropic.claude-haiku-4-5-20251001-v1:0 | ✅ | p=46 r=26 m=14 t=86 | 1.3s | $0.000271 |
amazon/claude-sonnet-4 | bedrock/us.anthropic.claude-sonnet-4-20250514-v1:0 | ✅ | p=17 r=0 m=4 t=21 | 861ms | $0.000111 |
amazon/claude-sonnet-4-high | bedrock/us.anthropic.claude-sonnet-4-20250514-v1:0 | ✅ | p=46 r=27 m=13 t=86 | 1.3s | $0.000738 |
amazon/claude-sonnet-4-5 | bedrock/us.anthropic.claude-sonnet-4-5-20250929-v1:0 | ✅ | p=17 r=0 m=4 t=21 | 1.3s | $0.000122 |
amazon/claude-sonnet-4-5-high | bedrock/us.anthropic.claude-sonnet-4-5-20250929-v1:0 | ✅ | p=46 r=27 m=13 t=86 | 2.1s | $0.000812 |
amazon/claude-sonnet-4-6 | bedrock/us.anthropic.claude-sonnet-4-6 | ✅ | p=17 r=0 m=4 t=21 | 2.4s | $0.000122 |
amazon/claude-sonnet-4-6-high | bedrock/us.anthropic.claude-sonnet-4-6 | ✅ | p=17 r=0 m=4 t=21 | 1.0s | $0.000122 |
amazon/claude-opus-4-1 | bedrock/us.anthropic.claude-opus-4-1-20250805-v1:0 | ✅ | p=17 r=0 m=4 t=21 | 3.1s | $0.000555 |
amazon/claude-opus-4-1-high | bedrock/us.anthropic.claude-opus-4-1-20250805-v1:0 | ✅ | p=46 r=29 m=13 t=88 | 5.2s | $0.00384 |
amazon/claude-opus-4-5 | bedrock/us.anthropic.claude-opus-4-5-20251101-v1:0 | ✅ | p=17 r=0 m=4 t=21 | 1.5s | $0.000204 |
amazon/claude-opus-4-5-high | bedrock/us.anthropic.claude-opus-4-5-20251101-v1:0 | ✅ | p=46 r=15 m=12 t=73 | 1.8s | $0.000995 |
amazon/claude-opus-4-6 | bedrock/us.anthropic.claude-opus-4-6-v1 | ✅ | p=17 r=0 m=4 t=21 | 1.7s | $0.000204 |
amazon/claude-opus-4-6-high | bedrock/us.anthropic.claude-opus-4-6-v1 | ✅ | p=17 r=15 m=21 t=53 | 1.8s | $0.001084 |
amazon/claude-opus-4-7 | bedrock/us.anthropic.claude-opus-4-7 | ✅ | p=27 r=0 m=6 t=33 | 1.2s | $0.000313 |
amazon/claude-opus-4-7-low | bedrock/us.anthropic.claude-opus-4-7 | ✅ | p=27 r=0 m=6 t=33 | 1.1s | $0.000313 |
amazon/claude-opus-4-7-medium | bedrock/us.anthropic.claude-opus-4-7 | ✅ | p=27 r=0 m=6 t=33 | 1.0s | $0.000313 |
amazon/claude-opus-4-7-high | bedrock/us.anthropic.claude-opus-4-7 | ✅ | p=27 r=0 m=6 t=33 | 1.1s | $0.000313 |
amazon/claude-opus-4-7-xhigh | bedrock/us.anthropic.claude-opus-4-7 | ✅ | p=27 r=0 m=6 t=33 | 975ms | $0.000313 |
amazon/claude-opus-4-7-max | bedrock/us.anthropic.claude-opus-4-7 | ✅ | p=27 r=0 m=6 t=33 | 1.1s | $0.000313 |
amazon/claude-opus-4-8 | bedrock/us.anthropic.claude-opus-4-8 | ✅ | p=22 r=0 m=4 t=26 | 1.0s | $0.000231 |
amazon/claude-opus-4-8-low | bedrock/us.anthropic.claude-opus-4-8 | ✅ | p=22 r=0 m=4 t=26 | 1.2s | $0.000231 |
amazon/claude-opus-4-8-medium | bedrock/us.anthropic.claude-opus-4-8 | ✅ | p=22 r=0 m=4 t=26 | 1.3s | $0.000231 |
amazon/claude-opus-4-8-high | bedrock/us.anthropic.claude-opus-4-8 | ✅ | p=22 r=0 m=4 t=26 | 1.2s | $0.000231 |
amazon/claude-opus-4-8-xhigh | bedrock/us.anthropic.claude-opus-4-8 | ✅ | p=22 r=0 m=4 t=26 | 1.2s | $0.000231 |
amazon/claude-opus-4-8-max | bedrock/us.anthropic.claude-opus-4-8 | ✅ | p=22 r=0 m=4 t=26 | 1.1s | $0.000231 |
devstral-2 | bedrock/mistral.devstral-2-123b | ✅ | p=12 r=0 m=2 t=14 | 638ms | $0.000009 |
mistral-large-3 | bedrock/mistral.mistral-large-3-675b-instruct | ✅ | p=12 r=0 m=3 t=15 | 576ms | $0.000011 |
nemotron-super-3 | bedrock/nvidia.nemotron-super-3-120b | ✅ | p=25 r=0 m=2 t=27 | 525ms | $0.000005 |
nemotron-nano-3 | bedrock/nvidia.nemotron-nano-3-30b | ✅ | p=25 r=0 m=3 t=28 | 436ms | $0.000002 |
nemotron-nano-vl | bedrock/nvidia.nemotron-nano-12b-v2 | ✅ | p=24 r=0 m=3 t=27 | 464ms | $0.000007 |
nova-pro-1 | bedrock/amazon.nova-pro-v1:0 | ✅ | p=10 r=0 m=3 t=13 | 654ms | $0.000018 |
nova-micro-1 | bedrock/amazon.nova-micro-v1:0 | ✅ | p=10 r=0 m=3 t=13 | 613ms | $0.000001 |
gemini-2.5-flash | vertex_ai/gemini-2.5-flash | ✅ | p=9 r=22 m=1 t=32 | 1.1s | $0.00006 |
gemini-2.5-flash-high | vertex_ai/gemini-2.5-flash | ✅ | p=9 r=18 m=1 t=28 | 1.6s | $0.00005 |
gemini-2.5-flash-lite | vertex_ai/gemini-2.5-flash-lite | ✅ | p=9 m=1 t=10 | 552ms | $0.000001 |
gemini-2.5-pro | vertex_ai/gemini-2.5-pro | ✅ | p=9 r=241 m=1 t=251 | 3.3s | $0.002431 |
gemini-2.5-pro-high | vertex_ai/gemini-2.5-pro | ✅ | p=9 r=146 m=1 t=156 | 2.8s | $0.001481 |
gemini-3-flash | vertex_ai/gemini-3-flash-preview | ✅ | p=9 r=47 m=2 t=58 | 2.4s | $0.000152 |
gemini-3-flash-high | vertex_ai/gemini-3-flash-preview | ✅ | p=9 r=28 m=1 t=38 | 2.7s | $0.000092 |
gemini-3-flash-priority | vertex_ai/gemini-3-flash-preview | ✅ | p=9 r=44 m=1 t=54 | 2.5s | $0.00014 |
gemini-3-flash-high-priority | vertex_ai/gemini-3-flash-preview | ✅ | p=9 r=26 m=1 t=36 | 2.5s | $0.000086 |
gemini-3.1-flash-lite | vertex_ai/gemini-3.1-flash-lite | ✅ | p=9 m=1 t=10 | 973ms | $0.000004 |
gemini-3.1-flash-lite-high | vertex_ai/gemini-3.1-flash-lite | ✅ | p=9 r=113 m=1 t=123 | 2.7s | $0.000173 |
gemini-3.1-flash-lite-priority | vertex_ai/gemini-3.1-flash-lite | ✅ | p=9 m=1 t=10 | 1.1s | $0.000004 |
gemini-3.1-flash-lite-high-priority | vertex_ai/gemini-3.1-flash-lite | ✅ | p=9 r=86 m=1 t=96 | 2.7s | $0.000133 |
gemini-3.1-pro | vertex_ai/gemini-3.1-pro-preview | ✅ | p=9 r=116 m=1 t=126 | 2.7s | $0.001422 |
gemini-3.1-pro-high | vertex_ai/gemini-3.1-pro-preview | ✅ | p=9 r=133 m=1 t=143 | 4.9s | $0.001626 |
gemini-3.1-pro-priority | vertex_ai/gemini-3.1-pro-preview | ✅ | p=9 r=69 m=1 t=79 | 2.2s | $0.000858 |
gemini-3.1-pro-high-priority | vertex_ai/gemini-3.1-pro-preview | ✅ | p=9 r=123 m=1 t=133 | 4.4s | $0.001506 |
gemini-3.5-flash | vertex_ai/gemini-3.5-flash | ✅ | p=9 m=1 t=10 | 1.2s | $0.000022 |
gemini-3.5-flash-high | vertex_ai/gemini-3.5-flash | ✅ | p=9 r=124 m=1 t=134 | 3.2s | $0.001138 |
gemini-3.5-flash-priority | vertex_ai/gemini-3.5-flash | ✅ | p=9 m=1 t=10 | 913ms | $0.000022 |
gemini-3.5-flash-high-priority | vertex_ai/gemini-3.5-flash | ✅ | p=9 r=122 m=1 t=132 | 3.5s | $0.00112 |
google/gpt-oss-120b | vertex_ai/openai/gpt-oss-120b-maas | ✅ | p=76 t=106 | 966ms | $0.00002 |
google/gpt-oss-20b | vertex_ai/openai/gpt-oss-20b-maas | ✅ | p=76 t=126 | 827ms | $0.000021 |
google/gpt-oss-120b-high | vertex_ai/openai/gpt-oss-120b-maas | ✅ | p=76 t=164 | 1.7s | $0.000055 |
google/gpt-oss-20b-high | vertex_ai/openai/gpt-oss-20b-maas | ✅ | p=76 t=110 | 576ms | $0.000016 |
google/deepseek-r1 | vertex_ai/deepseek-ai/deepseek-r1-0528-maas | ✅ | p=14 t=46 | 1.1s | $0.000192 |
google/qwen-3-coder | vertex_ai/qwen/qwen3-coder-480b-a35b-instruct-maas | ✅ | p=17 t=19 | 1.2s | $0.000023 |
google/qwen-3 | vertex_ai/qwen/qwen3-235b-a22b-instruct-2507-maas | ✅ | p=17 t=19 | 1.1s | $0.000006 |
google/gemma-4 | vertex_ai/google/gemma-4-26b-a4b-it-maas | ✅ | p=22 t=24 | 467ms | $0.000004 |
google/glm-5 | vertex_ai/zai-org/glm-5-maas | ✅ | p=14 t=137 | 2.7s | $0.000408 |
google/glm-4.7 | vertex_ai/zai-org/glm-4.7-maas | ✅ | p=14 t=56 | 1.1s | $0.000101 |
google/deepseek-3.2 | vertex_ai/deepseek-ai/deepseek-v3.2-maas | ✅ | p=13 t=15 | 951ms | $0.000011 |
google/kimi-k2-thinking | vertex_ai/moonshotai/kimi-k2-thinking-maas | ✅ | p=16 t=61 | 1.0s | $0.000122 |
google/minimax-m2 | vertex_ai/minimaxai/minimax-m2-maas | ✅ | p=31 t=246 | 2.6s | $0.000262 |
google/grok-4.20-reasoning | vertex_ai/xai/grok-4.20-reasoning | ✅ | p=338 r=302 t=641 | 1.8s | $0.002488 |
google/grok-4.1-non-reasoning | vertex_ai/xai/grok-4.1-fast-non-reasoning | ✅ | p=680 r=0 t=681 | 733ms | $0.000037 |
google/grok-4.1-reasoning | vertex_ai/xai/grok-4.1-fast-reasoning | ✅ | p=668 r=159 t=828 | 1.7s | $0.000115 |
google/grok-4.3 | vertex_ai/xai/grok-4.3 | ✅ | p=344 r=331 t=676 | 2.1s | – |
amazon/llama-4-maverick | bedrock/us.meta.llama4-maverick-17b-instruct-v1:0 | ✅ | p=44 r=0 m=2 t=46 | 345ms | $0.000012 |
amazon/llama-4-scout | bedrock/us.meta.llama4-scout-17b-instruct-v1:0 | ✅ | p=44 r=0 m=2 t=46 | 372ms | $0.000009 |
amazon/gpt-oss-120b | bedrock/openai.gpt-oss-120b-1:0 | ✅ | p=76 r=16 m=11 t=103 | 537ms | $0.000028 |
amazon/gpt-oss-20b | bedrock/openai.gpt-oss-20b-1:0 | ✅ | p=76 r=30 m=11 t=117 | 494ms | $0.000018 |
amazon/gpt-5.5 | bedrock_mantle/openai.gpt-5.5 | ✅ | p=15 r=10 t=32 | 1.4s | $0.000644 |
amazon/gpt-5.5-low | bedrock_mantle/openai.gpt-5.5 | ✅ | p=15 r=0 t=20 | 1.6s | $0.000247 |
amazon/gpt-5.5-medium | bedrock_mantle/openai.gpt-5.5 | ✅ | p=15 r=10 t=32 | 767ms | $0.000644 |
amazon/gpt-5.5-high | bedrock_mantle/openai.gpt-5.5 | ✅ | p=15 r=10 t=32 | 2.8s | $0.000644 |
amazon/gpt-5.5-xhigh | bedrock_mantle/openai.gpt-5.5 | ✅ | p=15 r=10 t=32 | 5.0s | $0.000644 |
amazon/glm-5 | bedrock_mantle/zai.glm-5 | ✅ | p=14 t=16 | 402ms | $0.00002 |
lbl/gemma-4 | hosted_vllm/gemma-4-h100 | ✅ | p=22 t=24 | 775ms | – |
lbl/gemma-4-thinking | hosted_vllm/gemma-4-thinking-h100 | ✅ | p=25 t=84 | 3.6s | – |
lbl/gemma-4-mini | hosted_vllm/gemma-4-mini | ✅ | p=22 t=47 | 386ms | – |
lbl/gemma-4-mini-thinking | hosted_vllm/gemma-4-mini-thinking | ✅ | p=25 t=27 | 193ms | – |
lbl/gpt-oss-20b | hosted_vllm/gpt-oss-20b | ✅ | p=76 t=106 | 435ms | – |
lbl/gpt-oss-20b-low | hosted_vllm/gpt-oss-20b | ✅ | p=76 t=106 | 142ms | – |
lbl/gpt-oss-20b-medium | hosted_vllm/gpt-oss-20b | ✅ | p=76 t=106 | 129ms | – |
lbl/gpt-oss-20b-high | hosted_vllm/gpt-oss-20b-high | ✅ | p=76 t=107 | 421ms | – |
lbl/gpt-oss-120b | hosted_vllm/gpt-oss-120b | ✅ | p=76 t=113 | 391ms | – |
lbl/gpt-oss-120b-low | hosted_vllm/gpt-oss-120b-low | ✅ | p=76 t=106 | 335ms | – |
lbl/gpt-oss-120b-medium | hosted_vllm/gpt-oss-120b-medium | ✅ | p=76 t=126 | 441ms | – |
lbl/gpt-oss-120b-high | hosted_vllm/gpt-oss-120b-high | ✅ | p=76 t=106 | 345ms | – |
lbl/cborg-chat | openai/lbl/cborg-chat | ✅ | p=25 t=27 | 194ms | – |
lbl/cborg-deepthought | openai/lbl/cborg-deepthought | ✅ | p=25 t=90 | 4.0s | – |
lbl/cborg-coder | openai/lbl/cborg-coder | ✅ | p=25 t=75 | 2.8s | – |
lbl/cborg-coder-fast | openai/lbl/cborg-coder-fast | ✅ | p=22 t=24 | 599ms | – |
lbl/cborg-coder-max | openai/nemotron-3-ultra | ✅ | p=25 t=50 | 424ms | – |
lbl/cborg-mini | openai/lbl/cborg-mini | ✅ | p=25 t=27 | 206ms | – |
lbl/cborg-mini-fast | openai/lbl/cborg-mini-fast | ✅ | p=22 t=52 | 363ms | – |
lbl/cborg-privacy-filter | openai/lbl/cborg-privacy-filter | ✅ | p=6 t=12 | 282ms | – |
lbl/cborg-instant | openai/lbl/cborg-instant | ✅ | p=26 t=79 | 651ms | – |
lbl/cborg-instant-short | openai/lbl/cborg-instant-short | ✅ | p=26 t=77 | 742ms | – |
lbl/cborg-safeguard | openai/lbl/cborg-safeguard | ✅ | p=76 t=127 | 476ms | – |
lbl/cborg-safeguard-high | openai/lbl/cborg-safeguard-high | ✅ | p=76 t=151 | 577ms | – |
lbl/cborg-ocr | openai/lbl/cborg-ocr | ✅ | p=22 t=24 | 527ms | – |
lbl/cborg-vision | openai/lbl/cborg-vision | ✅ | p=25 t=68 | 2.1s | – |
lbl/cborg-vision-fast | openai/lbl/cborg-vision-fast | ✅ | p=25 t=27 | 231ms | – |
lbl/cborg-ocr-fast | openai/lbl/cborg-ocr-fast | ✅ | p=22 t=51 | 413ms | – |
claude-haiku | vertex_ai/claude-haiku-4-5@20251001 | ✅ | p=17 r=0 m=4 t=21 | 1.0s | $0.000037 |
claude-haiku-high | vertex_ai/claude-haiku-4-5@20251001 | ✅ | p=46 r=27 m=14 t=87 | 924ms | $0.000251 |
claude-sonnet | vertex_ai/claude-sonnet-5 | ✅ | p=22 r=0 m=4 t=26 | 977ms | $0.000084 |
claude-sonnet-high | vertex_ai/claude-sonnet-5 | ✅ | p=22 r=0 m=4 t=26 | 1.1s | $0.000084 |
claude-opus | vertex_ai/claude-opus-4-8 | ✅ | p=22 r=0 m=4 t=26 | 862ms | $0.00021 |
claude-opus-high | vertex_ai/claude-opus-4-8 | ✅ | p=22 r=0 m=4 t=26 | 876ms | $0.00021 |
anthropic/claude-haiku | vertex_ai/claude-haiku-4-5@20251001 | ✅ | p=17 r=0 m=4 t=21 | 820ms | $0.000037 |
anthropic/claude-haiku-high | vertex_ai/claude-haiku-4-5@20251001 | ✅ | p=46 r=27 m=14 t=87 | 663ms | $0.000251 |
anthropic/claude-sonnet | vertex_ai/claude-sonnet-5 | ✅ | p=22 r=0 m=4 t=26 | 907ms | $0.000084 |
anthropic/claude-sonnet-high | vertex_ai/claude-sonnet-5 | ✅ | p=22 r=0 m=4 t=26 | 923ms | $0.000084 |
anthropic/claude-opus | vertex_ai/claude-opus-4-8 | ✅ | p=22 r=0 m=4 t=26 | 833ms | $0.00021 |
anthropic/claude-opus-high | vertex_ai/claude-opus-4-8 | ✅ | p=22 r=0 m=4 t=26 | 1.0s | $0.00021 |
gemini-pro | vertex_ai/gemini-3.1-pro-preview | ✅ | p=9 r=86 m=1 t=96 | 2.7s | $0.001062 |
gemini-pro-high | vertex_ai/gemini-3.1-pro-preview | ✅ | p=9 r=105 m=1 t=115 | 3.7s | $0.00129 |
gemini-pro-priority | vertex_ai/gemini-3.1-pro-preview | ✅ | p=9 r=121 m=1 t=131 | 2.6s | $0.001482 |
gemini-pro-high-priority | vertex_ai/gemini-3.1-pro-preview | ✅ | p=9 r=84 m=1 t=94 | 3.7s | $0.001038 |
gemini-flash | vertex_ai/gemini-3.5-flash | ✅ | p=9 m=1 t=10 | 850ms | $0.000022 |
gemini-flash-high | vertex_ai/gemini-3.5-flash | ✅ | p=9 r=110 m=1 t=120 | 3.2s | $0.001012 |
gemini-flash-priority | vertex_ai/gemini-3.5-flash | ✅ | p=9 m=1 t=10 | 964ms | $0.000022 |
gemini-flash-high-priority | vertex_ai/gemini-3.5-flash | ✅ | p=9 r=121 m=1 t=131 | 3.5s | $0.001112 |
gemini-flash-lite | vertex_ai/gemini-3.1-flash-lite | ✅ | p=9 m=1 t=10 | 954ms | $0.000004 |
gemini-flash-lite-high | vertex_ai/gemini-3.1-flash-lite | ✅ | p=9 r=82 m=1 t=92 | 2.1s | $0.000127 |
gemini-flash-lite-priority | vertex_ai/gemini-3.1-flash-lite | ✅ | p=9 m=1 t=10 | 945ms | $0.000004 |
gemini-flash-lite-high-priority | vertex_ai/gemini-3.1-flash-lite | ✅ | p=9 r=79 m=1 t=89 | 2.5s | $0.000122 |
meta/llama-4-scout | bedrock/us.meta.llama4-scout-17b-instruct-v1:0 | ✅ | p=44 r=0 m=2 t=46 | 351ms | $0.000009 |
Llama-4-Scout-17B-16E-Instruct | bedrock/us.meta.llama4-scout-17b-instruct-v1:0 | ✅ | p=44 r=0 m=2 t=46 | 348ms | $0.000009 |
gpt-oss-20b | hosted_vllm/gpt-oss-20b | ✅ | p=76 t=106 | 150ms | – |
gpt-oss-120b | – | ❌ | – | – | – |
gpt-oss-20b-high | hosted_vllm/gpt-oss-20b-high | ✅ | p=76 t=107 | 140ms | – |
gpt-oss-120b-high | vertex_ai/openai/gpt-oss-120b-maas | ✅ | p=76 t=163 | 3.8s | $0.000054 |
gemma-4 | hosted_vllm/gemma-4-h100 | ✅ | p=22 t=24 | 165ms | – |
gemma-4-thinking | hosted_vllm/gemma-4-thinking-h100 | ✅ | p=25 t=84 | 149ms | – |
gemma-4-mini | hosted_vllm/gemma-4-mini | ✅ | p=22 t=47 | 140ms | – |
gemma-4-mini-thinking | hosted_vllm/gemma-4-mini-thinking | ✅ | p=25 t=27 | 137ms | – |
gpt | openai/gpt-5.6-sol | ✅ | p=15 r=0 t=19 | 1.2s | $0.000195 |
gpt-high | openai/gpt-5.6-sol | ✅ | p=15 r=0 t=19 | 1.3s | $0.000195 |
gpt-codex | openai/gpt-5.3-codex | ✅ | p=15 r=0 t=20 | 957ms | $0.000096 |
gpt-chat | openai/gpt-5.2-chat-latest | ✅ | p=15 r=0 t=25 | 1.3s | $0.000166 |
gpt-pro | openai/gpt-5.5-pro | ✅ | p=15 r=10 t=32 | 10.2s | $0.00351 |
gpt-mini | openai/gpt-5.6-terra | ✅ | p=15 r=0 t=19 | 691ms | $0.000098 |
gpt-mini-high | openai/gpt-5.6-terra | ✅ | p=15 r=0 t=19 | 1.0s | $0.000098 |
gpt-nano | openai/gpt-5.6-luna | ✅ | p=15 r=0 t=19 | 732ms | $0.000039 |
gpt-nano-high | openai/gpt-5.6-luna | ✅ | p=15 r=0 t=19 | 941ms | $0.000039 |
gpt-5.5 | bedrock_mantle/openai.gpt-5.5 | ✅ | p=15 r=9 t=31 | 3.4s | $0.000611 |
gpt-5.5-low | bedrock_mantle/openai.gpt-5.5 | ✅ | p=15 r=9 t=31 | 3.0s | $0.000611 |
gpt-5.5-medium | bedrock_mantle/openai.gpt-5.5 | ✅ | p=15 r=10 t=32 | 145ms | $0.000644 |
gpt-5.5-high | bedrock_mantle/openai.gpt-5.5 | ✅ | p=15 r=10 t=32 | 126ms | $0.000644 |
gpt-5.5-xhigh | bedrock_mantle/openai.gpt-5.5 | ✅ | p=15 r=10 t=32 | 135ms | $0.000644 |
gpt-5.5-pro | openai/gpt-5.5-pro | ✅ | p=15 r=10 t=32 | 131ms | $0.00351 |
xai/grok-4.20-reasoning | vertex_ai/xai/grok-4.20-reasoning | ✅ | p=338 r=163 t=502 | 1.1s | $0.001654 |
xai/grok-4.1-fast-reasoning | vertex_ai/xai/grok-4.1-fast-reasoning | ✅ | p=668 r=85 t=754 | 1.1s | $0.000078 |
xai/grok-4.1-fast-non-reasoning | vertex_ai/xai/grok-4.1-fast-non-reasoning | ✅ | p=680 r=0 t=681 | 629ms | $0.000037 |
xai/grok-4.3 | vertex_ai/xai/grok-4.3 | ✅ | p=344 r=346 t=691 | 2.1s | – |
xai/grok-reasoning | vertex_ai/xai/grok-4.20-reasoning | ✅ | p=338 r=352 t=691 | 1.6s | $0.002212 |
xai/grok-fast-reasoning | vertex_ai/xai/grok-4.1-fast-reasoning | ✅ | p=668 r=87 t=756 | 1.0s | $0.000077 |
xai/grok-fast-non-reasoning | vertex_ai/xai/grok-4.1-fast-non-reasoning | ✅ | p=680 r=0 t=681 | 620ms | $0.000037 |
xai/grok | vertex_ai/xai/grok-4.3 | ✅ | p=344 r=468 t=813 | 2.6s | – |
cborg-chat | openai/lbl/cborg-chat | ✅ | p=25 t=27 | 145ms | – |
cborg-deepthought | openai/lbl/cborg-deepthought | ✅ | p=25 t=90 | 139ms | – |
cborg-coder | openai/lbl/cborg-coder | ✅ | p=25 t=75 | 147ms | – |
cborg-coder-fast | openai/lbl/cborg-coder-fast | ✅ | p=22 t=24 | 145ms | – |
cborg-coder-max | openai/nemotron-3-ultra | ✅ | p=25 t=44 | 625ms | – |
cborg-mini | openai/lbl/cborg-mini | ✅ | p=25 t=27 | 147ms | – |
cborg-mini-fast | openai/lbl/cborg-mini-fast | ✅ | p=22 t=52 | 147ms | – |
cborg-ocr | openai/lbl/cborg-ocr | ✅ | p=22 t=24 | 141ms | – |
cborg-vision | openai/lbl/cborg-vision | ✅ | p=25 t=68 | 144ms | – |
cborg-vision-fast | openai/lbl/cborg-vision-fast | ✅ | p=25 t=27 | 147ms | – |
cborg-ocr-fast | openai/lbl/cborg-ocr-fast | ✅ | p=22 t=51 | 136ms | – |
cborg-safeguard | openai/lbl/cborg-safeguard | ✅ | p=76 t=127 | 150ms | – |
cborg-safeguard-high | openai/lbl/cborg-safeguard-high | ✅ | p=76 t=151 | 157ms | – |
cborg-privacy-filter | openai/lbl/cborg-privacy-filter | ✅ | p=6 t=12 | 150ms | – |
cborg-instant | openai/lbl/cborg-instant | ✅ | p=26 t=79 | 145ms | – |
cborg-instant-short | openai/lbl/cborg-instant-short | ✅ | p=26 t=77 | 179ms | – |
claude-haiku-4-5 | vertex_ai/claude-haiku-4-5@20251001 | ✅ | p=17 r=0 m=4 t=21 | 971ms | $0.000037 |
claude-sonnet-4-0 | vertex_ai/claude-sonnet-4@20250514 | ✅ | p=17 r=0 m=4 t=21 | 829ms | $0.000111 |
claude-sonnet-4-5 | vertex_ai/claude-sonnet-4-5@20250929 | ✅ | p=17 r=0 m=4 t=21 | 1.3s | $0.000111 |
claude-sonnet-4-6 | vertex_ai/claude-sonnet-4-6@default | ✅ | p=17 r=0 m=4 t=21 | 1.1s | $0.000111 |
claude-sonnet-5-0 | vertex_ai/claude-sonnet-5 | ✅ | p=22 r=0 m=4 t=26 | 1.0s | $0.000084 |
claude-opus-4-0 | vertex_ai/claude-opus-4@20250514 | ✅ | p=17 r=0 m=4 t=21 | 1.6s | $0.000555 |
claude-opus-4-1 | vertex_ai/claude-opus-4-1@20250805 | ✅ | p=17 r=0 m=4 t=21 | 1.6s | $0.000555 |
claude-opus-4-5 | vertex_ai/claude-opus-4-5@20251101 | ✅ | p=17 r=0 m=4 t=21 | 1.3s | $0.000185 |
claude-opus-4-6 | vertex_ai/claude-opus-4-6@default | ✅ | p=17 r=0 m=4 t=21 | 1.6s | $0.000185 |
claude-opus-4-7 | vertex_ai/claude-opus-4-7 | ✅ | p=27 r=0 m=6 t=33 | 1.0s | $0.000285 |
claude-opus-4-8 | vertex_ai/claude-opus-4-8 | ✅ | p=22 r=0 m=4 t=26 | 1.9s | $0.00021 |
devstral | bedrock/mistral.devstral-2-123b | ✅ | p=12 r=0 m=2 t=14 | 603ms | $0.000009 |
mistral-large | bedrock/mistral.mistral-large-3-675b-instruct | ✅ | p=12 r=0 m=3 t=15 | 565ms | $0.000011 |
nova-pro | bedrock/amazon.nova-pro-v1:0 | ✅ | p=10 r=0 m=18 t=28 | 709ms | $0.000066 |
nova-micro | bedrock/amazon.nova-micro-v1:0 | ✅ | p=10 r=0 m=2 t=12 | 482ms | $0.000001 |
Embedding Models
| Model | Underlying Model | Status | Dimensions | Time | Cost |
|---|---|---|---|---|---|
text-embedding-ada-002 | openai/text-embedding-ada-002 | ✅ | 1536 | 586ms | $0.000001 |
nova-2-embed-multimodal | bedrock/amazon.nova-2-multimodal-embeddings-v1:0 | ✅ | 3072 | 513ms | $0.000104 |
titan-embed-text-v1 | bedrock/amazon.titan-embed-text-v1 | ✅ | 1536 | 465ms | $0.000001 |
titan-embed-image-v1 | bedrock/amazon.titan-embed-image-v1 | ✅ | 1024 | 364ms | $0.000009 |
titan-embed-text-v2 | bedrock/amazon.titan-embed-text-v2:0 | ✅ | 1024 | 327ms | $0 |
cohere-embed-multilingual-v3 | bedrock/cohere.embed-multilingual-v3 | ✅ | 1024 | 513ms | $0.000001 |
cohere-embed-english-v3 | bedrock/cohere.embed-english-v3 | ✅ | 1024 | 316ms | $0.000001 |
cohere-embed-v4 | bedrock/cohere.embed-v4:0 | ✅ | 1536 | 354ms | $0.000001 |
gemini-embedding-001 | vertex_ai/gemini-embedding-001 | ✅ | 3072 | 10.8s | $0.000001 |
text-embedding-004 | vertex_ai/text-embedding-004 | ✅ | 768 | 406ms | $0.000001 |
lbl/nomic-embed-text | openai/nomic-embed-text | ✅ | 768 | 215ms | – |
lbl/nomic-embed-vision | openai/nomic-embed-vision | ✅ | 768 | 207ms | – |
lbl/nomic-embed-code | openai/nomic-embed-code | ✅ | 3584 | 335ms | – |
lbl/nomic-embed-text-test | openai/nomic-embed-text | ✅ | 768 | 143ms | – |
lbl/nomic-embed-vision-test | openai/nomic-embed-vision | ✅ | 768 | 153ms | – |
lbl/nomic-embed-code-test | openai/nomic-embed-code | ✅ | 3584 | 231ms | – |
nomic-embed-text | openai/nomic-embed-text | ✅ | 768 | 157ms | – |
nomic-embed-vision | openai/nomic-embed-vision | ✅ | 768 | 159ms | – |
nomic-embed-code | openai/nomic-embed-code | ✅ | 3584 | 192ms | – |
nomic-embed-text-test | openai/nomic-embed-text | ✅ | 768 | 141ms | – |
nomic-embed-vision-test | openai/nomic-embed-vision | ✅ | 768 | 142ms | – |
nomic-embed-code-test | openai/nomic-embed-code | ✅ | 3584 | 204ms | – |