Model Status

Model Status

Last tested: 2026-06-17 07:58:13 UTC

268 of 281 models passed. Chat/completion: 246/259. Embeddings: 22/22.

Chat and Completion Models

ModelUnderlying ModelStatusTokens (p/r/m/t)TimeCost
gpt-4oopenai/gpt-4o✅p=16 r=0 t=172.5s$0.00005
gpt-4o-miniopenai/gpt-4o-mini✅p=16 r=0 t=17988ms$0.000003
gpt-4.1openai/gpt-4.1✅p=16 r=0 t=171.3s$0.00004
gpt-4.1-miniopenai/gpt-4.1-mini✅p=16 r=0 t=17880ms$0.000008
gpt-4.1-nanoopenai/gpt-4.1-nano✅p=16 r=0 t=17686ms$0.000002
gpt-5openai/gpt-5✅p=15 r=192 t=2176.7s$0.002039
gpt-5-chatopenai/gpt-5-chat-latest✅p=16 r=0 t=17646ms$0.00003
gpt-5-miniopenai/gpt-5-mini✅p=15 r=64 t=892.5s$0.000152
gpt-5-mini-highopenai/gpt-5-mini✅p=15 r=128 t=1532.6s$0.00028
gpt-5-nanoopenai/gpt-5-nano✅p=15 r=0 t=251.4s$0.000005
gpt-5-nano-highopenai/gpt-5-nano✅p=15 r=256 t=2813.0s$0.000107
gpt-5-codexopenai/gpt-5-codex✅p=15 r=0 t=371.5s$0.000239
gpt-5-highopenai/gpt-5✅p=15 r=128 t=1533.5s$0.001399
gpt-5.1openai/gpt-5.1✅p=15 r=0 t=25811ms$0.000119
gpt-5.1-chatopenai/gpt-5.1-chat-latest✅p=15 r=0 t=251.2s$0.000119
gpt-5.1-codexopenai/gpt-5.1-codex✅p=15 r=0 t=292.0s$0.000159
gpt-5.1-codex-miniopenai/gpt-5.1-codex-mini✅p=15 r=0 t=511.1s$0.000076
gpt-5.1-codex-maxopenai/gpt-5.1-codex-max✅p=15 r=64 t=1221.6s$0.001089
gpt-5.1-highopenai/gpt-5.1✅p=15 r=3 t=28828ms$0.000149
gpt-5.2openai/gpt-5.2✅p=15 r=0 t=19779ms$0.000082
gpt-5.2-chatopenai/gpt-5.2-chat-latest✅p=15 r=0 t=253.9s$0.000166
gpt-5.2-codexopenai/gpt-5.2-codex✅p=15 r=0 t=311.0s$0.00025
gpt-5.2-highopenai/gpt-5.2✅p=15 r=5 t=30965ms$0.000236
gpt-5.2-proopenai/gpt-5.2✅p=15 r=0 t=192.6s$0.000082
gpt-5.3-codexopenai/gpt-5.3-codex✅p=15 r=0 t=20933ms$0.000096
gpt-5.3-codex-highopenai/gpt-5.3-codex✅p=15 r=0 t=201.2s$0.000096
gpt-5.3-codex-xhighopenai/gpt-5.3-codex✅p=15 r=0 t=20924ms$0.000096
gpt-5.4openai/gpt-5.4✅p=15 r=0 t=19917ms$0.000098
gpt-5.4-miniopenai/gpt-5.4-mini✅p=15 r=0 t=194.9s$0.000029
gpt-5.4-nanoopenai/gpt-5.4-nano✅p=15 r=0 t=19733ms$0.000008
gpt-5.4-highopenai/gpt-5.4✅p=15 r=9 t=341.4s$0.000322
gpt-5.4-xhighopenai/gpt-5.4✅p=15 r=17 t=421.5s$0.000443
gpt-5.4-mini-highopenai/gpt-5.4-mini✅p=15 r=0 t=191.3s$0.000029
gpt-5.4-mini-xhighopenai/gpt-5.4-mini✅p=15 r=11 t=36946ms$0.000106
gpt-5.4-nano-highopenai/gpt-5.4-nano✅p=15 r=0 t=19815ms$0.000008
gpt-5.4-nano-xhighopenai/gpt-5.4-nano✅p=15 r=23 t=48937ms$0.000044
gpt-5.4-proopenai/gpt-5.4✅p=15 r=0 t=19941ms$0.000098
gpt-5.5openai/gpt-5.5✅p=15 r=4 t=291.3s$0.000495
gpt-5.5-lowopenai/gpt-5.5✅p=15 r=0 t=191.1s$0.000195
gpt-5.5-mediumopenai/gpt-5.5✅p=15 r=0 t=191.8s$0.000195
gpt-5.5-highopenai/gpt-5.5✅p=15 r=6 t=311.2s$0.000555
gpt-5.5-xhighopenai/gpt-5.5✅p=15 r=6 t=311.4s$0.000555
gpt-5.5-proopenai/gpt-5.5-pro✅p=15 r=10 t=322.6s$0.00351
o1openai/o1✅p=15 r=64 t=931.7s$0.004905
o1-highopenai/o1✅p=15 r=128 t=1585.4s$0.008805
google/claude-haiku-4-5vertex_ai/claude-haiku-4-5@20251001✅p=17 r=0 m=4 t=21952ms$0.000037
google/claude-haiku-4-5-highvertex_ai/claude-haiku-4-5@20251001✅p=46 r=30 m=15 t=91929ms$0.000271
google/claude-sonnet-4vertex_ai/claude-sonnet-4@20250514✅p=17 r=0 m=4 t=21918ms$0.000111
google/claude-sonnet-4-highvertex_ai/claude-sonnet-4@20250514✅p=46 r=42 m=15 t=1032.0s$0.000993
google/claude-sonnet-4-5vertex_ai/claude-sonnet-4-5@20250929✅p=17 r=0 m=4 t=212.3s$0.000111
google/claude-sonnet-4-5-highvertex_ai/claude-sonnet-4-5@20250929✅p=46 r=42 m=16 t=1042.7s$0.001008
google/claude-sonnet-4-6vertex_ai/claude-sonnet-4-6@default✅p=17 r=0 m=4 t=211.2s$0.000111
google/claude-sonnet-4-6-highvertex_ai/claude-sonnet-4-6@default✅p=17 r=0 m=4 t=21977ms$0.000111
google/claude-opus-4vertex_ai/claude-opus-4@20250514✅p=17 r=0 m=4 t=211.6s$0.000555
google/claude-opus-4-highvertex_ai/claude-opus-4@20250514✅p=46 r=27 m=13 t=862.7s$0.00369
google/claude-opus-4-1vertex_ai/claude-opus-4-1@20250805✅p=17 r=0 m=4 t=219.0s$0.000555
google/claude-opus-4-1-highvertex_ai/claude-opus-4-1@20250805✅p=17 r=0 m=4 t=211.6s$0.000555
google/claude-opus-4-5vertex_ai/claude-opus-4-5@20251101✅p=17 r=0 m=4 t=211.8s$0.000185
google/claude-opus-4-5-highvertex_ai/claude-opus-4-5@20251101✅p=46 r=15 m=12 t=731.1s$0.000905
google/claude-opus-4-6vertex_ai/claude-opus-4-6@default✅p=17 r=0 m=4 t=215.5s$0.000185
google/claude-opus-4-6-high–❌–––
google/claude-opus-4-7vertex_ai/claude-opus-4-7✅p=27 r=0 m=6 t=331.2s$0.000285
google/claude-opus-4-7-lowvertex_ai/claude-opus-4-7✅p=27 r=0 m=6 t=331.2s$0.000285
google/claude-opus-4-7-mediumvertex_ai/claude-opus-4-7✅p=27 r=0 m=6 t=332.4s$0.000285
google/claude-opus-4-7-highvertex_ai/claude-opus-4-7✅p=27 r=0 m=6 t=331.7s$0.000285
google/claude-opus-4-7-xhighvertex_ai/claude-opus-4-7✅p=27 r=0 m=6 t=331.1s$0.000285
google/claude-opus-4-7-maxvertex_ai/claude-opus-4-7✅p=27 r=0 m=6 t=331.7s$0.000285
google/claude-opus-4-8vertex_ai/claude-opus-4-8✅p=22 r=0 m=4 t=261.2s$0.00021
google/claude-opus-4-8-lowvertex_ai/claude-opus-4-8✅p=22 r=0 m=4 t=261.3s$0.00021
google/claude-opus-4-8-mediumvertex_ai/claude-opus-4-8✅p=22 r=0 m=4 t=261.2s$0.00021
google/claude-opus-4-8-highvertex_ai/claude-opus-4-8✅p=22 r=0 m=4 t=262.5s$0.00021
google/claude-opus-4-8-xhighvertex_ai/claude-opus-4-8✅p=22 r=0 m=4 t=262.5s$0.00021
google/claude-opus-4-8-maxvertex_ai/claude-opus-4-8✅p=22 r=0 m=4 t=262.8s$0.00021
amazon/claude-haiku-3-5bedrock/us.anthropic.claude-3-5-haiku-20241022-v1:0✅p=20 r=0 m=96 t=1163.1s$0.0004
amazon/claude-haiku-4-5bedrock/us.anthropic.claude-haiku-4-5-20251001-v1:0✅p=17 r=0 m=4 t=211.2s$0.000041
amazon/claude-haiku-4-5-highbedrock/us.anthropic.claude-haiku-4-5-20251001-v1:0✅p=46 r=27 m=14 t=871.1s$0.000276
amazon/claude-sonnet-4bedrock/us.anthropic.claude-sonnet-4-20250514-v1:0✅p=17 r=0 m=4 t=21968ms$0.000111
amazon/claude-sonnet-4-highbedrock/us.anthropic.claude-sonnet-4-20250514-v1:0✅p=46 r=42 m=14 t=1021.5s$0.000978
amazon/claude-sonnet-4-5bedrock/us.anthropic.claude-sonnet-4-5-20250929-v1:0✅p=17 r=0 m=4 t=211.5s$0.000122
amazon/claude-sonnet-4-5-highbedrock/us.anthropic.claude-sonnet-4-5-20250929-v1:0✅p=46 r=26 m=13 t=852.5s$0.000795
amazon/claude-sonnet-4-6bedrock/us.anthropic.claude-sonnet-4-6✅p=17 r=0 m=4 t=211.2s$0.000122
amazon/claude-sonnet-4-6-highbedrock/us.anthropic.claude-sonnet-4-6✅p=17 r=0 m=4 t=211.5s$0.000122
amazon/claude-opus-4-1bedrock/us.anthropic.claude-opus-4-1-20250805-v1:0✅p=17 r=0 m=4 t=213.3s$0.000555
amazon/claude-opus-4-1-highbedrock/us.anthropic.claude-opus-4-1-20250805-v1:0✅p=46 r=30 m=14 t=905.9s$0.00399
amazon/claude-opus-4-5bedrock/us.anthropic.claude-opus-4-5-20251101-v1:0✅p=17 r=0 m=4 t=211.7s$0.000204
amazon/claude-opus-4-5-highbedrock/us.anthropic.claude-opus-4-5-20251101-v1:0✅p=46 r=15 m=12 t=732.2s$0.000995
amazon/claude-opus-4-6bedrock/us.anthropic.claude-opus-4-6-v1✅p=17 r=0 m=4 t=212.5s$0.000204
amazon/claude-opus-4-6-highbedrock/us.anthropic.claude-opus-4-6-v1✅p=17 r=16 m=20 t=532.5s$0.001084
amazon/claude-opus-4-7bedrock/us.anthropic.claude-opus-4-7✅p=27 r=0 m=6 t=331.2s$0.000313
amazon/claude-opus-4-7-lowbedrock/us.anthropic.claude-opus-4-7✅p=27 r=0 m=6 t=331.0s$0.000313
amazon/claude-opus-4-7-mediumbedrock/us.anthropic.claude-opus-4-7✅p=27 r=0 m=6 t=333.0s$0.000313
amazon/claude-opus-4-7-highbedrock/us.anthropic.claude-opus-4-7✅p=27 r=0 m=6 t=331.3s$0.000313
amazon/claude-opus-4-7-xhighbedrock/us.anthropic.claude-opus-4-7✅p=27 r=0 m=6 t=331.2s$0.000313
amazon/claude-opus-4-7-maxbedrock/us.anthropic.claude-opus-4-7✅p=27 r=0 m=6 t=331.2s$0.000313
amazon/claude-opus-4-8–❌–––
amazon/claude-opus-4-8-low–❌–––
amazon/claude-opus-4-8-medium–❌–––
amazon/claude-opus-4-8-high–❌–––
amazon/claude-opus-4-8-xhigh–❌–––
amazon/claude-opus-4-8-max–❌–––
devstral-2bedrock/mistral.devstral-2-123b✅p=12 r=0 m=2 t=14810ms$0.000009
mistral-large-3bedrock/mistral.mistral-large-3-675b-instruct✅p=12 r=0 m=2 t=14553ms$0.000009
nemotron-super-3bedrock/nvidia.nemotron-super-3-120b✅p=25 r=0 m=2 t=271.2s$0.000005
nemotron-nano-3bedrock/nvidia.nemotron-nano-3-30b✅p=25 r=0 m=2 t=27620ms$0.000002
nemotron-nano-vlbedrock/nvidia.nemotron-nano-12b-v2✅p=24 r=0 m=3 t=27623ms$0.000007
nova-premier-1–❌–––
nova-pro-1bedrock/amazon.nova-pro-v1:0✅p=10 r=0 m=2 t=12648ms$0.000014
nova-micro-1bedrock/amazon.nova-micro-v1:0✅p=10 r=0 m=2 t=12623ms$0.000001
gemini-2.5-flashvertex_ai/gemini-2.5-flash✅p=9 r=23 m=1 t=331.3s$0.000063
gemini-2.5-flash-highvertex_ai/gemini-2.5-flash✅p=9 r=22 m=1 t=321.6s$0.00006
gemini-2.5-flash-litevertex_ai/gemini-2.5-flash-lite✅p=9 m=1 t=10751ms$0.000001
gemini-2.5-provertex_ai/gemini-2.5-pro✅p=9 r=220 m=1 t=2303.8s$0.002221
gemini-2.5-pro-highvertex_ai/gemini-2.5-pro✅p=9 r=104 m=1 t=1143.5s$0.001061
gemini-3-flashvertex_ai/gemini-3-flash-preview✅p=9 r=103 m=0 t=1123.1s$0.000314
gemini-3-flash-highvertex_ai/gemini-3-flash-preview✅p=9 r=43 m=1 t=532.7s$0.000136
gemini-3-flash-priorityvertex_ai/gemini-3-flash-preview✅p=9 r=41 m=1 t=513.6s$0.000131
gemini-3-flash-high-priorityvertex_ai/gemini-3-flash-preview✅p=9 r=43 m=1 t=533.9s$0.000136
gemini-3.1-flash-litevertex_ai/gemini-3.1-flash-lite-preview✅p=9 m=1 t=10920ms$0.000004
gemini-3.1-flash-lite-highvertex_ai/gemini-3.1-flash-lite-preview✅p=9 r=69 m=1 t=793.1s$0.000107
gemini-3.1-flash-lite-priorityvertex_ai/gemini-3.1-flash-lite-preview✅p=9 m=1 t=10936ms$0.000004
gemini-3.1-flash-lite-high-priorityvertex_ai/gemini-3.1-flash-lite-preview✅p=9 r=80 m=1 t=902.8s$0.000124
gemini-3.1-provertex_ai/gemini-3.1-pro-preview✅p=9 r=133 m=1 t=1432.9s$0.001626
gemini-3.1-pro-highvertex_ai/gemini-3.1-pro-preview✅p=9 r=119 m=1 t=1295.0s$0.001458
gemini-3.1-pro-priorityvertex_ai/gemini-3.1-pro-preview✅p=9 r=104 m=1 t=1142.7s$0.001278
gemini-3.1-pro-high-priorityvertex_ai/gemini-3.1-pro-preview✅p=9 r=135 m=1 t=1454.8s$0.00165
gemini-3.5-flashvertex_ai/gemini-3.5-flash✅p=9 r=62 m=1 t=721.4s$0.00058
gemini-3.5-flash-highvertex_ai/gemini-3.5-flash✅p=9 r=95 m=1 t=1052.9s$0.000878
gemini-3.5-flash-priorityvertex_ai/gemini-3.5-flash✅p=9 r=112 m=1 t=1221.8s$0.00103
gemini-3.5-flash-high-priorityvertex_ai/gemini-3.5-flash✅p=9 r=129 m=1 t=1392.9s$0.001183
google/gpt-oss-120bvertex_ai/openai/gpt-oss-120b-maas✅p=76 t=1331.1s$0.000036
google/gpt-oss-20bvertex_ai/openai/gpt-oss-20b-maas✅p=76 t=123793ms$0.000015
google/gpt-oss-120b-highvertex_ai/openai/gpt-oss-120b-maas✅p=76 t=1941.1s$0.000073
google/gpt-oss-20b-highvertex_ai/openai/gpt-oss-20b-maas✅p=76 t=119785ms$0.000014
google/deepseek-r1vertex_ai/deepseek-ai/deepseek-r1-0528-maas✅p=14 t=39736ms$0.000154
google/qwen-3-codervertex_ai/qwen/qwen3-coder-480b-a35b-instruct-maas✅p=17 t=191.2s$0.000023
google/qwen-3vertex_ai/qwen/qwen3-235b-a22b-instruct-2507-maas✅p=17 t=19908ms$0.000006
google/gemma-4vertex_ai/google/gemma-4-26b-a4b-it-maas✅p=22 t=24520ms$0.000004
google/codestral–❌–––
google/glm-5vertex_ai/zai-org/glm-5-maas✅p=14 t=1643.1s$0.000494
google/glm-4.7vertex_ai/zai-org/glm-4.7-maas✅p=14 t=971.7s$0.000191
google/deepseek-3.2vertex_ai/deepseek-ai/deepseek-v3.2-maas✅p=13 t=151.6s$0.000011
google/kimi-k2-thinkingvertex_ai/moonshotai/kimi-k2-thinking-maas✅p=16 t=65902ms$0.000132
google/minimax-m2vertex_ai/minimaxai/minimax-m2-maas✅p=31 t=861.1s$0.00007
google/grok-4.20-reasoningvertex_ai/xai/grok-4.20-reasoning✅p=338 r=465 t=8042.1s$0.003466
google/grok-4.1-non-reasoningvertex_ai/xai/grok-4.1-fast-non-reasoning✅p=680 r=0 t=681547ms$0.000037
google/grok-4.1-reasoningvertex_ai/xai/grok-4.1-fast-reasoning✅p=668 r=101 t=7701.1s$0.000086
google/grok-4.3–❌–––
amazon/llama-4-maverickbedrock/us.meta.llama4-maverick-17b-instruct-v1:0✅p=44 r=0 m=2 t=46500ms$0.000012
amazon/llama-4-scoutbedrock/us.meta.llama4-scout-17b-instruct-v1:0✅p=44 r=0 m=2 t=46535ms$0.000009
amazon/gpt-oss-120bbedrock/openai.gpt-oss-120b-1:0✅p=76 r=20 m=11 t=107676ms$0.00003
amazon/gpt-oss-20bbedrock/openai.gpt-oss-20b-1:0✅p=76 r=21 m=11 t=108664ms$0.000015
lbl/gemma-4hosted_vllm/gemma-4✅p=22 t=249.4s–
lbl/gemma-4-thinkinghosted_vllm/gemma-4-thinking✅p=25 t=11912.8s–
lbl/gemma-4-minihosted_vllm/gemma-4-mini✅p=22 t=45571ms–
lbl/gemma-4-mini-thinkinghosted_vllm/gemma-4-mini-thinking✅p=25 t=27299ms–
lbl/gpt-oss-20bhosted_vllm/gpt-oss-20b✅p=76 t=109470ms–
lbl/gpt-oss-20b-lowhosted_vllm/gpt-oss-20b✅p=76 t=107447ms–
lbl/gpt-oss-20b-mediumhosted_vllm/gpt-oss-20b✅p=76 t=112484ms–
lbl/gpt-oss-20b-highhosted_vllm/gpt-oss-20b-high✅p=76 t=109462ms–
lbl/gpt-oss-120bhosted_vllm/gpt-oss-120b✅p=76 t=129470ms–
lbl/gpt-oss-120b-lowhosted_vllm/gpt-oss-120b-low✅p=76 t=108390ms–
lbl/gpt-oss-120b-mediumhosted_vllm/gpt-oss-120b-medium✅p=76 t=129573ms–
lbl/gpt-oss-120b-highhosted_vllm/gpt-oss-120b-high✅p=76 t=122452ms–
lbl/cborg-chatopenai/lbl/cborg-chat✅p=76 t=109465ms–
lbl/cborg-deepthoughtopenai/lbl/cborg-deepthought✅p=25 t=58732ms–
lbl/cborg-coderopenai/lbl/cborg-coder✅p=25 t=661.1s–
lbl/cborg-coder-fastopenai/lbl/cborg-coder-fast✅p=76 t=130560ms–
lbl/cborg-miniopenai/lbl/cborg-mini✅p=25 t=27320ms–
lbl/cborg-mini-fastopenai/lbl/cborg-mini-fast✅p=22 t=47546ms–
lbl/cborg-privacy-filteropenai/lbl/cborg-privacy-filter✅p=6 t=12501ms–
lbl/cborg-instantopenai/lbl/cborg-instant✅p=26 t=282911ms–
lbl/cborg-instant-shortopenai/lbl/cborg-instant-short✅p=26 t=2821.1s–
lbl/cborg-safeguardopenai/lbl/cborg-safeguard✅p=76 t=121434ms–
lbl/cborg-safeguard-highopenai/lbl/cborg-safeguard-high✅p=76 t=118572ms–
lbl/cborg-ocropenai/lbl/cborg-ocr✅p=22 t=24560ms–
lbl/cborg-visionopenai/lbl/cborg-vision✅p=25 t=92975ms–
lbl/cborg-vision-fastopenai/lbl/cborg-vision-fast✅p=25 t=27319ms–
lbl/cborg-ocr-fastopenai/lbl/cborg-ocr-fast✅p=25 t=27333ms–
claude-haikuvertex_ai/claude-haiku-4-5@20251001✅p=17 r=0 m=4 t=21715ms$0.000037
claude-haiku-highvertex_ai/claude-haiku-4-5@20251001✅p=46 r=27 m=14 t=87944ms$0.000251
claude-sonnetvertex_ai/claude-sonnet-4-6@default✅p=17 r=0 m=4 t=211.0s$0.000111
claude-sonnet-highvertex_ai/claude-sonnet-4-6@default✅p=17 r=0 m=4 t=211.4s$0.000111
claude-opusvertex_ai/claude-opus-4-8✅p=22 r=0 m=4 t=261.6s$0.00021
claude-opus-highvertex_ai/claude-opus-4-8✅p=22 r=0 m=4 t=261.6s$0.00021
anthropic/claude-haikuvertex_ai/claude-haiku-4-5@20251001✅p=17 r=0 m=4 t=21761ms$0.000037
anthropic/claude-haiku-highvertex_ai/claude-haiku-4-5@20251001✅p=46 r=28 m=14 t=881.3s$0.000256
anthropic/claude-sonnetvertex_ai/claude-sonnet-4-6@default✅p=17 r=0 m=4 t=214.2s$0.000111
anthropic/claude-sonnet-highvertex_ai/claude-sonnet-4-6@default✅p=17 r=0 m=4 t=211.3s$0.000111
anthropic/claude-opusvertex_ai/claude-opus-4-8✅p=22 r=0 m=4 t=261.1s$0.00021
anthropic/claude-opus-highvertex_ai/claude-opus-4-8✅p=22 r=0 m=4 t=262.4s$0.00021
gemini-provertex_ai/gemini-3.1-pro-preview✅p=9 r=101 m=1 t=1113.2s$0.001242
gemini-pro-highvertex_ai/gemini-3.1-pro-preview✅p=9 r=101 m=1 t=1114.9s$0.001242
gemini-pro-priorityvertex_ai/gemini-3.1-pro-preview✅p=9 r=78 m=1 t=883.6s$0.000966
gemini-pro-high-priorityvertex_ai/gemini-3.1-pro-preview✅p=9 r=121 m=1 t=1314.2s$0.001482
gemini-flashvertex_ai/gemini-3.5-flash✅p=9 r=122 m=1 t=1321.9s$0.00112
gemini-flash-highvertex_ai/gemini-3.5-flash✅p=9 r=134 m=1 t=1443.6s$0.001228
gemini-flash-priorityvertex_ai/gemini-3.5-flash✅p=9 r=103 m=0 t=1121.8s$0.00094
gemini-flash-high-priorityvertex_ai/gemini-3.5-flash✅p=9 r=139 m=1 t=1491.6s$0.001273
gemini-flash-litevertex_ai/gemini-3.1-flash-lite-preview✅p=9 m=1 t=10756ms$0.000004
gemini-flash-lite-highvertex_ai/gemini-3.1-flash-lite-preview✅p=9 r=96 m=1 t=1062.8s$0.000148
gemini-flash-lite-priorityvertex_ai/gemini-3.1-flash-lite-preview✅p=9 m=1 t=10808ms$0.000004
gemini-flash-lite-high-priorityvertex_ai/gemini-3.1-flash-lite-preview✅p=9 r=92 m=1 t=1022.4s$0.000142
meta/llama-4-scoutbedrock/us.meta.llama4-scout-17b-instruct-v1:0✅p=44 r=0 m=2 t=46486ms$0.000009
Llama-4-Scout-17B-16E-Instructbedrock/us.meta.llama4-scout-17b-instruct-v1:0✅p=44 r=0 m=2 t=46484ms$0.000009
gpt-oss-20bhosted_vllm/gpt-oss-20b✅p=76 t=98424ms–
gpt-oss-120bvertex_ai/openai/gpt-oss-120b-maas✅p=76 t=100665ms$0.000015
gpt-oss-20b-highhosted_vllm/gpt-oss-20b-high✅p=76 t=107440ms–
gpt-oss-120b-highvertex_ai/openai/gpt-oss-120b-maas✅p=76 t=160954ms$0.000052
gemma-4hosted_vllm/gemma-4✅p=22 t=24511ms–
gemma-4-thinkinghosted_vllm/gemma-4-thinking✅p=25 t=1202.4s–
gemma-4-minihosted_vllm/gemma-4-mini✅p=22 t=57650ms–
gemma-4-mini-thinkinghosted_vllm/gemma-4-mini-thinking✅p=25 t=27328ms–
gptopenai/gpt-5.5✅p=15 r=4 t=291.4s$0.000495
gpt-highopenai/gpt-5.5✅p=15 r=6 t=311.5s$0.000555
gpt-codexopenai/gpt-5.3-codex✅p=15 r=0 t=201.0s$0.000096
gpt-chatopenai/gpt-5.2-chat-latest✅p=15 r=0 t=251.2s$0.000166
gpt-proopenai/gpt-5.5-pro✅p=15 r=10 t=323.2s$0.00351
gpt-miniopenai/gpt-5.4-mini✅p=15 r=0 t=19867ms$0.000029
gpt-mini-highopenai/gpt-5.4-mini✅p=15 r=11 t=36732ms$0.000106
gpt-nanoopenai/gpt-5.4-nano✅p=15 r=0 t=19779ms$0.000008
gpt-nano-highopenai/gpt-5.4-nano✅p=15 r=0 t=19959ms$0.000008
xai/grok-4.20-reasoningvertex_ai/xai/grok-4.20-reasoning✅p=338 r=416 t=7551.8s$0.002596
xai/grok-4.1-fast-reasoningvertex_ai/xai/grok-4.1-fast-reasoning✅p=668 r=107 t=776913ms$0.000089
xai/grok-4.1-fast-non-reasoningvertex_ai/xai/grok-4.1-fast-non-reasoning✅p=680 r=0 t=681528ms$0.000037
xai/grok-4.3–❌–––
xai/grok-reasoningvertex_ai/xai/grok-4.20-reasoning✅p=338 r=493 t=8322.2s$0.003058
xai/grok-fast-reasoningvertex_ai/xai/grok-4.1-fast-reasoning✅p=668 r=122 t=7911.2s$0.000095
xai/grok-fast-non-reasoningvertex_ai/xai/grok-4.1-fast-non-reasoning✅p=680 r=0 t=681554ms$0.000037
xai/grok–❌–––
cborg-chatopenai/lbl/cborg-chat✅p=76 t=99379ms–
cborg-deepthoughtopenai/lbl/cborg-deepthought✅p=25 t=1451.8s–
cborg-coderopenai/lbl/cborg-coder✅p=25 t=9849.1s–
cborg-coder-fastopenai/lbl/cborg-coder-fast✅p=76 t=107430ms–
cborg-miniopenai/lbl/cborg-mini✅p=25 t=27318ms–
cborg-mini-fastopenai/lbl/cborg-mini-fast✅p=22 t=52672ms–
cborg-ocropenai/lbl/cborg-ocr✅p=22 t=24573ms–
cborg-visionopenai/lbl/cborg-vision✅p=25 t=942.3s–
cborg-vision-fastopenai/lbl/cborg-vision-fast✅p=25 t=128739ms–
cborg-ocr-fastopenai/lbl/cborg-ocr-fast✅p=25 t=27281ms–
cborg-safeguardopenai/lbl/cborg-safeguard✅p=76 t=136553ms–
cborg-safeguard-highopenai/lbl/cborg-safeguard-high✅p=76 t=120465ms–
cborg-privacy-filteropenai/lbl/cborg-privacy-filter✅p=6 t=12364ms–
cborg-instantopenai/lbl/cborg-instant✅p=26 t=282970ms–
cborg-instant-shortopenai/lbl/cborg-instant-short✅p=22 t=278559ms–
claude-haiku-4-5vertex_ai/claude-haiku-4-5@20251001✅p=17 r=0 m=4 t=21954ms$0.000037
claude-sonnet-4-0vertex_ai/claude-sonnet-4@20250514✅p=17 r=0 m=4 t=21956ms$0.000111
claude-sonnet-4-5vertex_ai/claude-sonnet-4-5@20250929✅p=17 r=0 m=4 t=211.1s$0.000111
claude-sonnet-4-6vertex_ai/claude-sonnet-4-6@default✅p=17 r=0 m=4 t=211.2s$0.000111
claude-opus-4-0vertex_ai/claude-opus-4@20250514✅p=17 r=0 m=4 t=211.9s$0.000555
claude-opus-4-1vertex_ai/claude-opus-4-1@20250805✅p=17 r=0 m=4 t=211.9s$0.000555
claude-opus-4-5vertex_ai/claude-opus-4-5@20251101✅p=17 r=0 m=4 t=21866ms$0.000185
claude-opus-4-6vertex_ai/claude-opus-4-6@default✅p=17 r=0 m=4 t=213.3s$0.000185
claude-opus-4-7vertex_ai/claude-opus-4-7✅p=27 r=0 m=6 t=331.2s$0.000285
claude-opus-4-8vertex_ai/claude-opus-4-8✅p=22 r=0 m=4 t=261.3s$0.00021
devstralbedrock/mistral.devstral-2-123b✅p=12 r=0 m=2 t=14717ms$0.000009
mistral-largebedrock/mistral.mistral-large-3-675b-instruct✅p=12 r=0 m=2 t=14930ms$0.000009
nova-premier–❌–––
nova-probedrock/amazon.nova-pro-v1:0✅p=10 r=0 m=3 t=13643ms$0.000018
nova-microbedrock/amazon.nova-micro-v1:0✅p=10 r=0 m=3 t=13608ms$0.000001

Embedding Models

ModelUnderlying ModelStatusDimensionsTimeCost
text-embedding-ada-002openai/text-embedding-ada-002✅1536554ms$0.000001
nova-2-embed-multimodalbedrock/amazon.nova-2-multimodal-embeddings-v1:0✅3072597ms$0.000104
titan-embed-text-v1bedrock/amazon.titan-embed-text-v1✅1536441ms$0.000001
titan-embed-image-v1bedrock/amazon.titan-embed-image-v1✅1024486ms$0.000009
titan-embed-text-v2bedrock/amazon.titan-embed-text-v2:0✅1024528ms$0.000002
cohere-embed-multilingual-v3bedrock/cohere.embed-multilingual-v3✅1024588ms$0.000001
cohere-embed-english-v3bedrock/cohere.embed-english-v3✅1024423ms$0.000001
cohere-embed-v4bedrock/cohere.embed-v4:0✅1536485ms$0.000001
gemini-embedding-001vertex_ai/gemini-embedding-001✅307210.9s$0.000001
text-embedding-004vertex_ai/text-embedding-004✅768538ms$0.000001
lbl/nomic-embed-textopenai/nomic-embed-text✅7681.9s–
lbl/nomic-embed-visionopenai/nomic-embed-vision✅768299ms–
lbl/nomic-embed-codeopenai/nomic-embed-code✅3584456ms–
lbl/nomic-embed-text-testopenai/nomic-embed-text✅768359ms–
lbl/nomic-embed-vision-testopenai/nomic-embed-vision✅768272ms–
lbl/nomic-embed-code-testopenai/nomic-embed-code✅3584427ms–
nomic-embed-textopenai/nomic-embed-text✅768305ms–
nomic-embed-visionopenai/nomic-embed-vision✅768308ms–
nomic-embed-codeopenai/nomic-embed-code✅3584416ms–
nomic-embed-text-testopenai/nomic-embed-text✅768310ms–
nomic-embed-vision-testopenai/nomic-embed-vision✅768318ms–
nomic-embed-code-testopenai/nomic-embed-code✅3584395ms–

Auto-generated by cborg-etc/bin/test-all-models.sh. Run the script and publish to update.