| Rank | Model | Elo Rating | Description |
| --- | --- | --- | --- |
| 1 | 🥇 [DeepSeek V3](https://github.com/deepseek-ai/DeepSeek-V3) | 1154 | An advanced language model by DeepSeek |
| 2 | 🥈 [gpt-4o-2024-11-20](https://openai.com/index/hello-gpt-4o/) | 1147 | The most advanced OpenAI language model |
| 3 | 🥉 [Google: Gemini Pro 1.5](https://blog.google/technology/ai/google-gemini-pro-imagen-duet-ai-update/) | 1120 | Gemini by Google |
| 4 |  [gpt-4o-2024-05-13](https://openai.com/index/hello-gpt-4o/) | 1088 | The most advanced OpenAI language model |
| 5 |  [claude-3-5-sonnet-20241022](https://docs.anthropic.com/en/docs/about-claude/models) | 1075 | Claude by Anthropic |
| 6 |  [Qwen2.5 72B Instruct](https://huggingface.co/Qwen) | 1065 | LLM family built by Alibaba Cloud |
| 7 |  [claude-3-5-sonnet-20240620](https://docs.anthropic.com/en/docs/about-claude/models) | 1065 | Claude by Anthropic |
| 8 |  [Google: Gemini Flash 1.5](https://blog.google/technology/ai/google-gemini-pro-imagen-duet-ai-update/) | 1057 | Gemini by Google |
| 9 |  [GigaChat-Max-preview 4.0.26.20](https://developers.sber.ru/gigachat/) | 1053 | GigaChat — русскоязычная нейросеть от Сбера |
| 10 |  [gpt-4-turbo-2024-04-09](https://platform.openai.com/docs/models/gpt-4-and-gpt-4-turbo) | 1048 | GPT-4-Turbo by OpenAI |
| 11 |  [Llama 3.1 405B Instruct Turbo](https://ai.meta.com/blog/meta-llama-3-1/) | 1043 | Meta's Llama-3.1 most capable models to date |
| 12 |  [Vikhrmodels/Vikhr-Nemo-12B-Instruct-R-21-09-24](https://huggingface.co/Vikhrmodels) | 1041 | Open Source модели семейства Vikhr |
| 13 |  [Gemma 2 27B](https://blog.google/technology/developers/google-gemma-2/) | 1041 | Gemma is a family of open models from Google |
| 14 |  [Llama 3.3 70B Instruct]() | 1040 | Register the description at fastchat/model/model_registry.py |
| 15 |  [Cohere: Command R+ (08-2024)](https://docs.cohere.com/v2/docs/command-r-plus) | 1037 | Command R+ 08 2024 is Cohere’s newest large language model, optimized for conversational interaction and long-context tasks. |
| 16 |  [gpt-4o-mini-2024-07-18](https://openai.com/index/gpt-4o-mini-advancing-cost-efficient-intelligence/) | 1027 | The most most cost-efficient small OpenAI language model |
| 17 |  [GigaChat-Pro 4.0.26.20](https://developers.sber.ru/gigachat/) | 1026 | GigaChat — русскоязычная нейросеть от Сбера |
| 18 |  [T-lite-instruct-0.1](https://huggingface.co/AnatoliiPotapov/T-lite-instruct-0.1) | 1024 | Open Source модель T-Lite от T-Bank AI |
| 19 |  [YandexGPT Experimental](https://ya.ru/ai/gpt-3) | 1018 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 20 |  [saiga_llama3_70b](https://huggingface.co/IlyaGusev) | 1017 | Saiga - семейство Open Source русскоязычных моделей |
| 21 |  [claude-3-5-haiku-20241022](https://docs.anthropic.com/en/docs/about-claude/models) | 1014 | Claude by Anthropic |
| 22 |  [Llama 3.1 70B Instruct Turbo](https://ai.meta.com/blog/meta-llama-3-1/) | 1012 | Meta's Llama-3.1 most capable models to date |
| 23 |  [LLaMA-3 Chat (70B)](https://llama.meta.com/llama3/) | 1005 | Meta's Llama-3 chat models |
| 24 |  [claude-3-haiku-20240307](https://docs.anthropic.com/en/docs/about-claude/models) | 1003 | Claude by Anthropic |
| 25 |  [GigaChat 4.0.26.20](https://developers.sber.ru/gigachat/) | 994 | GigaChat — русскоязычная нейросеть от Сбера |
| 26 |  [GigaChat-Pro 4.0.26.15](https://developers.sber.ru/gigachat/) | 991 | GigaChat — русскоязычная нейросеть от Сбера |
| 27 |  [saiga_llama3_8b_v7](https://huggingface.co/IlyaGusev) | 991 | Saiga - семейство Open Source русскоязычных моделей |
| 28 |  [GigaChat-Plus 4.0.26.15](https://developers.sber.ru/gigachat/) | 987 | GigaChat — русскоязычная нейросеть от Сбера |
| 29 |  [GigaChat 4.0.26.15](https://developers.sber.ru/gigachat/) | 986 | GigaChat — русскоязычная нейросеть от Сбера |
| 30 |  [Qwen2.5 Coder 32B Instruct](https://huggingface.co/Qwen) | 986 | LLM family built by Alibaba Cloud |
| 31 |  [RefalMachine/ruadapt_llama3_instruct_lep_saiga_kto_ablitirated](https://huggingface.co/RefalMachine/ruadapt_llama3_instruct_lep_saiga_kto_ablitirated) | 975 | Model was ablitirated and then trained with KTO on IlyaGusev/saiga_preferences. |
| 32 |  [YandexGPT 4 Pro](https://ya.ru/ai/gpt-3) | 973 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 33 |  [gpt-4-0613](https://openai.com/research/gpt-4) | 967 | GPT-4 by OpenAI |
| 34 |  [saiga_phi3_medium](https://huggingface.co/IlyaGusev) | 966 | Saiga - семейство Open Source русскоязычных моделей |
| 35 |  [Qwen 2 Instruct (72B)](https://huggingface.co/Qwen) | 966 | LLM family built by Alibaba Cloud |
| 36 |  [Vikhrmodels/it-5.2-fp16-cp](https://huggingface.co/Vikhrmodels) | 961 | Open Source модели семейства Vikhr |
| 37 |  [saiga_llama3_8b_v6](https://huggingface.co/IlyaGusev) | 961 | Saiga - семейство Open Source русскоязычных моделей |
| 38 |  [LLaMA-3 Chat (8B)](https://llama.meta.com/llama3/) | 960 | Meta's Llama-3 chat models |
| 39 |  [YandexGPT 3 Pro](https://ya.ru/ai/gpt-3) | 950 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 40 |  [YandexGPT 3 Lite](https://ya.ru/ai/gpt-3) | 945 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 41 |  [Llama 3.1 8B Instruct Turbo](https://ai.meta.com/blog/meta-llama-3-1/) | 933 | Meta's Llama-3.1 most capable models to date |
| 42 |  [Llama 3.2 11B Instruct](https://ai.meta.com/blog/llama-3-2-connect-2024-vision-edge-mobile-devices/) | 929 | Meta's Llama-3.2 most capable models to date |
| 43 |  [GigaChat-Pro 2.2.25.3](https://developers.sber.ru/gigachat/) | 911 | GigaChat — русскоязычная нейросеть от Сбера |
| 44 |  [GigaChat-Pro 4.0.26.8](https://developers.sber.ru/gigachat/) | 908 | GigaChat — русскоязычная нейросеть от Сбера |
| 45 |  [GigaChat 4.0.26.8](https://developers.sber.ru/gigachat/) | 895 | GigaChat — русскоязычная нейросеть от Сбера |
| 46 |  [gpt-3.5-turbo-0125](https://platform.openai.com/docs/models/gpt-3-5) | 892 | GPT-3.5-Turbo by OpenAI |
| 47 |  [GigaChat 3.1.25.3](https://developers.sber.ru/gigachat/) | 881 | GigaChat — русскоязычная нейросеть от Сбера |
| 48 |  [GigaChat-Plus 3.1.25.3](https://developers.sber.ru/gigachat/) | 868 | GigaChat — русскоязычная нейросеть от Сбера |

Model A: %{y}<br>Model B: %{x}<br>Fraction of A Wins: %{z}<extra></extra>

| 1 | 🥇 [gpt-4o-2024-11-20](https://openai.com/index/hello-gpt-4o/) | 1157 | The most advanced OpenAI language model |
| 2 | 🥈 [Google: Gemini Pro 1.5](https://blog.google/technology/ai/google-gemini-pro-imagen-duet-ai-update/) | 1137 | Gemini by Google |
| 3 | 🥉 [gpt-4o-2024-05-13](https://openai.com/index/hello-gpt-4o/) | 1105 | The most advanced OpenAI language model |
| 4 |  [claude-3-5-sonnet-20241022](https://docs.anthropic.com/en/docs/about-claude/models) | 1104 | Claude by Anthropic |
| 5 |  [claude-3-5-sonnet-20240620](https://docs.anthropic.com/en/docs/about-claude/models) | 1091 | Claude by Anthropic |
| 6 |  [Qwen2.5 72B Instruct](https://huggingface.co/Qwen) | 1081 | LLM family built by Alibaba Cloud |
| 7 |  [Google: Gemini Flash 1.5](https://blog.google/technology/ai/google-gemini-pro-imagen-duet-ai-update/) | 1076 | Gemini by Google |
| 8 |  [gpt-4-turbo-2024-04-09](https://platform.openai.com/docs/models/gpt-4-and-gpt-4-turbo) | 1070 | GPT-4-Turbo by OpenAI |
| 9 |  [gpt-4o-mini-2024-07-18](https://openai.com/index/gpt-4o-mini-advancing-cost-efficient-intelligence/) | 1054 | The most most cost-efficient small OpenAI language model |
| 10 |  [Llama 3.3 70B Instruct]() | 1053 | Register the description at fastchat/model/model_registry.py |
| 11 |  [Llama 3.1 405B Instruct Turbo](https://ai.meta.com/blog/meta-llama-3-1/) | 1052 | Meta's Llama-3.1 most capable models to date |
| 12 |  [GigaChat-Max-preview 4.0.26.20](https://developers.sber.ru/gigachat/) | 1050 | GigaChat — русскоязычная нейросеть от Сбера |
| 13 |  [claude-3-5-haiku-20241022](https://docs.anthropic.com/en/docs/about-claude/models) | 1048 | Claude by Anthropic |
| 14 |  [Gemma 2 27B](https://blog.google/technology/developers/google-gemma-2/) | 1046 | Gemma is a family of open models from Google |
| 15 |  [Vikhrmodels/Vikhr-Nemo-12B-Instruct-R-21-09-24](https://huggingface.co/Vikhrmodels) | 1041 | Open Source модели семейства Vikhr |
| 16 |  [Cohere: Command R+ (08-2024)](https://docs.cohere.com/v2/docs/command-r-plus) | 1030 | Command R+ 08 2024 is Cohere’s newest large language model, optimized for conversational interaction and long-context tasks. |
| 17 |  [Qwen2.5 Coder 32B Instruct](https://huggingface.co/Qwen) | 1029 | LLM family built by Alibaba Cloud |
| 18 |  [Llama 3.1 70B Instruct Turbo](https://ai.meta.com/blog/meta-llama-3-1/) | 1018 | Meta's Llama-3.1 most capable models to date |
| 19 |  [YandexGPT Experimental](https://ya.ru/ai/gpt-3) | 1017 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 20 |  [GigaChat-Pro 4.0.26.20](https://developers.sber.ru/gigachat/) | 1016 | GigaChat — русскоязычная нейросеть от Сбера |
| 21 |  [saiga_llama3_70b](https://huggingface.co/IlyaGusev) | 1014 | Saiga - семейство Open Source русскоязычных моделей |
| 22 |  [claude-3-haiku-20240307](https://docs.anthropic.com/en/docs/about-claude/models) | 1012 | Claude by Anthropic |
| 23 |  [gpt-4-0613](https://openai.com/research/gpt-4) | 1009 | GPT-4 by OpenAI |
| 24 |  [T-lite-instruct-0.1](https://huggingface.co/AnatoliiPotapov/T-lite-instruct-0.1) | 1008 | Open Source модель T-Lite от T-Bank AI |
| 25 |  [LLaMA-3 Chat (70B)](https://llama.meta.com/llama3/) | 1004 | Meta's Llama-3 chat models |
| 26 |  [Qwen 2 Instruct (72B)](https://huggingface.co/Qwen) | 996 | LLM family built by Alibaba Cloud |
| 27 |  [YandexGPT 4 Pro](https://ya.ru/ai/gpt-3) | 984 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 28 |  [GigaChat-Pro 4.0.26.15](https://developers.sber.ru/gigachat/) | 982 | GigaChat — русскоязычная нейросеть от Сбера |
| 29 |  [GigaChat 4.0.26.20](https://developers.sber.ru/gigachat/) | 981 | GigaChat — русскоязычная нейросеть от Сбера |
| 30 |  [saiga_llama3_8b_v7](https://huggingface.co/IlyaGusev) | 974 | Saiga - семейство Open Source русскоязычных моделей |
| 31 |  [GigaChat 4.0.26.15](https://developers.sber.ru/gigachat/) | 968 | GigaChat — русскоязычная нейросеть от Сбера |
| 32 |  [GigaChat-Plus 4.0.26.15](https://developers.sber.ru/gigachat/) | 966 | GigaChat — русскоязычная нейросеть от Сбера |
| 33 |  [saiga_phi3_medium](https://huggingface.co/IlyaGusev) | 959 | Saiga - семейство Open Source русскоязычных моделей |
| 34 |  [YandexGPT 3 Pro](https://ya.ru/ai/gpt-3) | 958 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 35 |  [RefalMachine/ruadapt_llama3_instruct_lep_saiga_kto_ablitirated](https://huggingface.co/RefalMachine/ruadapt_llama3_instruct_lep_saiga_kto_ablitirated) | 956 | Model was ablitirated and then trained with KTO on IlyaGusev/saiga_preferences. |
| 36 |  [LLaMA-3 Chat (8B)](https://llama.meta.com/llama3/) | 943 | Meta's Llama-3 chat models |
| 37 |  [YandexGPT 3 Lite](https://ya.ru/ai/gpt-3) | 939 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 38 |  [Llama 3.2 11B Instruct](https://ai.meta.com/blog/llama-3-2-connect-2024-vision-edge-mobile-devices/) | 938 | Meta's Llama-3.2 most capable models to date |
| 39 |  [Vikhrmodels/it-5.2-fp16-cp](https://huggingface.co/Vikhrmodels) | 936 | Open Source модели семейства Vikhr |
| 40 |  [gpt-3.5-turbo-0125](https://platform.openai.com/docs/models/gpt-3-5) | 934 | GPT-3.5-Turbo by OpenAI |
| 41 |  [Llama 3.1 8B Instruct Turbo](https://ai.meta.com/blog/meta-llama-3-1/) | 930 | Meta's Llama-3.1 most capable models to date |
| 42 |  [saiga_llama3_8b_v6](https://huggingface.co/IlyaGusev) | 914 | Saiga - семейство Open Source русскоязычных моделей |
| 43 |  [GigaChat-Pro 4.0.26.8](https://developers.sber.ru/gigachat/) | 907 | GigaChat — русскоязычная нейросеть от Сбера |
| 44 |  [GigaChat-Pro 2.2.25.3](https://developers.sber.ru/gigachat/) | 903 | GigaChat — русскоязычная нейросеть от Сбера |
| 45 |  [GigaChat 4.0.26.8](https://developers.sber.ru/gigachat/) | 896 | GigaChat — русскоязычная нейросеть от Сбера |
| 46 |  [GigaChat 3.1.25.3](https://developers.sber.ru/gigachat/) | 866 | GigaChat — русскоязычная нейросеть от Сбера |
| 47 |  [GigaChat-Plus 3.1.25.3](https://developers.sber.ru/gigachat/) | 851 | GigaChat — русскоязычная нейросеть от Сбера |

| 1 | 🥇 [gpt-4o-2024-11-20](https://openai.com/index/hello-gpt-4o/) | 1125 | The most advanced OpenAI language model |
| 2 | 🥈 [Google: Gemini Pro 1.5](https://blog.google/technology/ai/google-gemini-pro-imagen-duet-ai-update/) | 1123 | Gemini by Google |
| 3 | 🥉 [claude-3-5-sonnet-20241022](https://docs.anthropic.com/en/docs/about-claude/models) | 1108 | Claude by Anthropic |
| 4 |  [claude-3-5-sonnet-20240620](https://docs.anthropic.com/en/docs/about-claude/models) | 1090 | Claude by Anthropic |
| 5 |  [gpt-4o-2024-05-13](https://openai.com/index/hello-gpt-4o/) | 1087 | The most advanced OpenAI language model |
| 6 |  [Google: Gemini Flash 1.5](https://blog.google/technology/ai/google-gemini-pro-imagen-duet-ai-update/) | 1066 | Gemini by Google |
| 7 |  [gpt-4-turbo-2024-04-09](https://platform.openai.com/docs/models/gpt-4-and-gpt-4-turbo) | 1064 | GPT-4-Turbo by OpenAI |
| 8 |  [claude-3-5-haiku-20241022](https://docs.anthropic.com/en/docs/about-claude/models) | 1055 | Claude by Anthropic |
| 9 |  [Llama 3.1 405B Instruct Turbo](https://ai.meta.com/blog/meta-llama-3-1/) | 1055 | Meta's Llama-3.1 most capable models to date |
| 10 |  [Llama 3.3 70B Instruct]() | 1049 | Register the description at fastchat/model/model_registry.py |
| 11 |  [Qwen2.5 72B Instruct](https://huggingface.co/Qwen) | 1049 | LLM family built by Alibaba Cloud |
| 12 |  [gpt-4-0613](https://openai.com/research/gpt-4) | 1048 | GPT-4 by OpenAI |
| 13 |  [gpt-4o-mini-2024-07-18](https://openai.com/index/gpt-4o-mini-advancing-cost-efficient-intelligence/) | 1045 | The most most cost-efficient small OpenAI language model |
| 14 |  [GigaChat-Max-preview 4.0.26.20](https://developers.sber.ru/gigachat/) | 1043 | GigaChat — русскоязычная нейросеть от Сбера |
| 15 |  [Gemma 2 27B](https://blog.google/technology/developers/google-gemma-2/) | 1029 | Gemma is a family of open models from Google |
| 16 |  [Llama 3.1 70B Instruct Turbo](https://ai.meta.com/blog/meta-llama-3-1/) | 1019 | Meta's Llama-3.1 most capable models to date |
| 17 |  [saiga_llama3_70b](https://huggingface.co/IlyaGusev) | 1017 | Saiga - семейство Open Source русскоязычных моделей |
| 18 |  [Cohere: Command R+ (08-2024)](https://docs.cohere.com/v2/docs/command-r-plus) | 1015 | Command R+ 08 2024 is Cohere’s newest large language model, optimized for conversational interaction and long-context tasks. |
| 19 |  [claude-3-haiku-20240307](https://docs.anthropic.com/en/docs/about-claude/models) | 1014 | Claude by Anthropic |
| 20 |  [YandexGPT Experimental](https://ya.ru/ai/gpt-3) | 1014 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 21 |  [Qwen 2 Instruct (72B)](https://huggingface.co/Qwen) | 1011 | LLM family built by Alibaba Cloud |
| 22 |  [Qwen2.5 Coder 32B Instruct](https://huggingface.co/Qwen) | 1008 | LLM family built by Alibaba Cloud |
| 23 |  [YandexGPT 4 Pro](https://ya.ru/ai/gpt-3) | 1001 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 24 |  [Vikhrmodels/Vikhr-Nemo-12B-Instruct-R-21-09-24](https://huggingface.co/Vikhrmodels) | 1000 | Open Source модели семейства Vikhr |
| 25 |  [GigaChat-Pro 4.0.26.20](https://developers.sber.ru/gigachat/) | 999 | GigaChat — русскоязычная нейросеть от Сбера |
| 26 |  [LLaMA-3 Chat (70B)](https://llama.meta.com/llama3/) | 996 | Meta's Llama-3 chat models |
| 27 |  [GigaChat-Pro 4.0.26.15](https://developers.sber.ru/gigachat/) | 990 | GigaChat — русскоязычная нейросеть от Сбера |
| 28 |  [gpt-3.5-turbo-0125](https://platform.openai.com/docs/models/gpt-3-5) | 983 | GPT-3.5-Turbo by OpenAI |
| 29 |  [YandexGPT 3 Pro](https://ya.ru/ai/gpt-3) | 979 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 30 |  [GigaChat 4.0.26.15](https://developers.sber.ru/gigachat/) | 970 | GigaChat — русскоязычная нейросеть от Сбера |
| 31 |  [GigaChat 4.0.26.20](https://developers.sber.ru/gigachat/) | 970 | GigaChat — русскоязычная нейросеть от Сбера |
| 32 |  [saiga_llama3_8b_v7](https://huggingface.co/IlyaGusev) | 964 | Saiga - семейство Open Source русскоязычных моделей |
| 33 |  [GigaChat-Plus 4.0.26.15](https://developers.sber.ru/gigachat/) | 959 | GigaChat — русскоязычная нейросеть от Сбера |
| 34 |  [saiga_phi3_medium](https://huggingface.co/IlyaGusev) | 955 | Saiga - семейство Open Source русскоязычных моделей |
| 35 |  [GigaChat-Pro 4.0.26.8](https://developers.sber.ru/gigachat/) | 948 | GigaChat — русскоязычная нейросеть от Сбера |
| 36 |  [RefalMachine/ruadapt_llama3_instruct_lep_saiga_kto_ablitirated](https://huggingface.co/RefalMachine/ruadapt_llama3_instruct_lep_saiga_kto_ablitirated) | 946 | Model was ablitirated and then trained with KTO on IlyaGusev/saiga_preferences. |
| 37 |  [Llama 3.2 11B Instruct](https://ai.meta.com/blog/llama-3-2-connect-2024-vision-edge-mobile-devices/) | 946 | Meta's Llama-3.2 most capable models to date |
| 38 |  [T-lite-instruct-0.1](https://huggingface.co/AnatoliiPotapov/T-lite-instruct-0.1) | 942 | Open Source модель T-Lite от T-Bank AI |
| 39 |  [YandexGPT 3 Lite](https://ya.ru/ai/gpt-3) | 939 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 40 |  [Llama 3.1 8B Instruct Turbo](https://ai.meta.com/blog/meta-llama-3-1/) | 939 | Meta's Llama-3.1 most capable models to date |
| 41 |  [Vikhrmodels/it-5.2-fp16-cp](https://huggingface.co/Vikhrmodels) | 937 | Open Source модели семейства Vikhr |
| 42 |  [LLaMA-3 Chat (8B)](https://llama.meta.com/llama3/) | 936 | Meta's Llama-3 chat models |
| 43 |  [GigaChat 4.0.26.8](https://developers.sber.ru/gigachat/) | 934 | GigaChat — русскоязычная нейросеть от Сбера |
| 44 |  [GigaChat-Pro 2.2.25.3](https://developers.sber.ru/gigachat/) | 928 | GigaChat — русскоязычная нейросеть от Сбера |
| 45 |  [saiga_llama3_8b_v6](https://huggingface.co/IlyaGusev) | 916 | Saiga - семейство Open Source русскоязычных моделей |
| 46 |  [GigaChat 3.1.25.3](https://developers.sber.ru/gigachat/) | 899 | GigaChat — русскоязычная нейросеть от Сбера |
| 47 |  [GigaChat-Plus 3.1.25.3](https://developers.sber.ru/gigachat/) | 887 | GigaChat — русскоязычная нейросеть от Сбера |