| Rank | Model | Elo Rating | Description |
| --- | --- | --- | --- |
| 1 | 🥇 [Google: Gemini Pro 1.5](https://blog.google/technology/ai/google-gemini-pro-imagen-duet-ai-update/) | 1133 | Gemini by Google |
| 2 | 🥈 [gpt-4o-2024-05-13](https://openai.com/index/hello-gpt-4o/) | 1103 | The most advanced OpenAI language model |
| 3 | 🥉 [claude-3-5-sonnet-20241022](https://docs.anthropic.com/en/docs/about-claude/models) | 1095 | Claude by Anthropic |
| 4 |  [Qwen2.5 72B Instruct](https://huggingface.co/Qwen) | 1085 | LLM family built by Alibaba Cloud |
| 5 |  [Google: Gemini Flash 1.5](https://blog.google/technology/ai/google-gemini-pro-imagen-duet-ai-update/) | 1076 | Gemini by Google |
| 6 |  [claude-3-5-sonnet-20240620](https://docs.anthropic.com/en/docs/about-claude/models) | 1075 | Claude by Anthropic |
| 7 |  [gpt-4-turbo-2024-04-09](https://platform.openai.com/docs/models/gpt-4-and-gpt-4-turbo) | 1060 | GPT-4-Turbo by OpenAI |
| 8 |  [Vikhrmodels/Vikhr-Nemo-12B-Instruct-R-21-09-24](https://huggingface.co/Vikhrmodels) | 1057 | Open Source модели семейства Vikhr |
| 9 |  [Cohere: Command R+ (08-2024)](https://docs.cohere.com/v2/docs/command-r-plus) | 1056 | Command R+ 08 2024 is Cohere’s newest large language model, optimized for conversational interaction and long-context tasks. |
| 10 |  [Gemma 2 27B](https://blog.google/technology/developers/google-gemma-2/) | 1051 | Gemma is a family of open models from Google |
| 11 |  [Llama 3.1 405B Instruct Turbo](https://ai.meta.com/blog/meta-llama-3-1/) | 1046 | Meta's Llama-3.1 most capable models to date |
| 12 |  [gpt-4o-mini-2024-07-18](https://openai.com/index/gpt-4o-mini-advancing-cost-efficient-intelligence/) | 1041 | The most most cost-efficient small OpenAI language model |
| 13 |  [GigaChat-Max-preview 4.0.26.20]() | 1040 | Register the description at fastchat/model/model_registry.py |
| 14 |  [T-lite-instruct-0.1](https://huggingface.co/AnatoliiPotapov/T-lite-instruct-0.1) | 1037 | Open Source модель T-Lite от T-Bank AI |
| 15 |  [YandexGPT Experimental](https://ya.ru/ai/gpt-3) | 1032 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 16 |  [GigaChat-Pro 4.0.26.20]() | 1026 | Register the description at fastchat/model/model_registry.py |
| 17 |  [LLaMA-3 Chat (70B)](https://llama.meta.com/llama3/) | 1022 | Meta's Llama-3 chat models |
| 18 |  [saiga_llama3_70b](https://huggingface.co/IlyaGusev) | 1022 | Saiga - семейство Open Source русскоязычных моделей |
| 19 |  [Llama 3.1 70B Instruct Turbo](https://ai.meta.com/blog/meta-llama-3-1/) | 1019 | Meta's Llama-3.1 most capable models to date |
| 20 |  [claude-3-haiku-20240307](https://docs.anthropic.com/en/docs/about-claude/models) | 1010 | Claude by Anthropic |
| 21 |  [GigaChat-Pro 4.0.26.15](https://developers.sber.ru/gigachat/) | 1003 | GigaChat — русскоязычная нейросеть от Сбера |
| 22 |  [GigaChat 4.0.26.20]() | 1002 | Register the description at fastchat/model/model_registry.py |
| 23 |  [saiga_llama3_8b_v7](https://huggingface.co/IlyaGusev) | 1000 | Saiga - семейство Open Source русскоязычных моделей |
| 24 |  [GigaChat 4.0.26.15](https://developers.sber.ru/gigachat/) | 991 | GigaChat — русскоязычная нейросеть от Сбера |
| 25 |  [GigaChat-Plus 4.0.26.15](https://developers.sber.ru/gigachat/) | 989 | GigaChat — русскоязычная нейросеть от Сбера |
| 26 |  [RefalMachine/ruadapt_llama3_instruct_lep_saiga_kto_ablitirated](https://huggingface.co/RefalMachine/ruadapt_llama3_instruct_lep_saiga_kto_ablitirated) | 985 | Model was ablitirated and then trained with KTO on IlyaGusev/saiga_preferences. |
| 27 |  [YandexGPT 4 Pro](https://ya.ru/ai/gpt-3) | 984 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 28 |  [LLaMA-3 Chat (8B)](https://llama.meta.com/llama3/) | 982 | Meta's Llama-3 chat models |
| 29 |  [gpt-4-0613](https://openai.com/research/gpt-4) | 974 | GPT-4 by OpenAI |
| 30 |  [Qwen 2 Instruct (72B)](https://huggingface.co/Qwen) | 974 | LLM family built by Alibaba Cloud |
| 31 |  [saiga_llama3_8b_v6](https://huggingface.co/IlyaGusev) | 969 | Saiga - семейство Open Source русскоязычных моделей |
| 32 |  [saiga_phi3_medium](https://huggingface.co/IlyaGusev) | 968 | Saiga - семейство Open Source русскоязычных моделей |
| 33 |  [Vikhrmodels/it-5.2-fp16-cp](https://huggingface.co/Vikhrmodels) | 965 | Open Source модели семейства Vikhr |
| 34 |  [YandexGPT 3 Pro](https://ya.ru/ai/gpt-3) | 956 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 35 |  [YandexGPT 3 Lite](https://ya.ru/ai/gpt-3) | 951 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 36 |  [Llama 3.1 8B Instruct Turbo](https://ai.meta.com/blog/meta-llama-3-1/) | 937 | Meta's Llama-3.1 most capable models to date |
| 37 |  [Llama 3.2 11B Instruct](https://ai.meta.com/blog/llama-3-2-connect-2024-vision-edge-mobile-devices/) | 930 | Meta's Llama-3.2 most capable models to date |
| 38 |  [GigaChat-Pro 2.2.25.3](https://developers.sber.ru/gigachat/) | 913 | GigaChat — русскоязычная нейросеть от Сбера |
| 39 |  [GigaChat-Pro 4.0.26.8](https://developers.sber.ru/gigachat/) | 904 | GigaChat — русскоязычная нейросеть от Сбера |
| 40 |  [GigaChat 4.0.26.8](https://developers.sber.ru/gigachat/) | 894 | GigaChat — русскоязычная нейросеть от Сбера |
| 41 |  [gpt-3.5-turbo-0125](https://platform.openai.com/docs/models/gpt-3-5) | 893 | GPT-3.5-Turbo by OpenAI |
| 42 |  [GigaChat 3.1.25.3](https://developers.sber.ru/gigachat/) | 882 | GigaChat — русскоязычная нейросеть от Сбера |
| 43 |  [GigaChat-Plus 3.1.25.3](https://developers.sber.ru/gigachat/) | 868 | GigaChat — русскоязычная нейросеть от Сбера |

Model A: %{y}<br>Model B: %{x}<br>Fraction of A Wins: %{z}<extra></extra>

| 1 | 🥇 [Google: Gemini Pro 1.5](https://blog.google/technology/ai/google-gemini-pro-imagen-duet-ai-update/) | 1144 | Gemini by Google |
| 2 | 🥈 [gpt-4o-2024-05-13](https://openai.com/index/hello-gpt-4o/) | 1126 | The most advanced OpenAI language model |
| 3 | 🥉 [claude-3-5-sonnet-20241022](https://docs.anthropic.com/en/docs/about-claude/models) | 1116 | Claude by Anthropic |
| 4 |  [Google: Gemini Flash 1.5](https://blog.google/technology/ai/google-gemini-pro-imagen-duet-ai-update/) | 1102 | Gemini by Google |
| 5 |  [claude-3-5-sonnet-20240620](https://docs.anthropic.com/en/docs/about-claude/models) | 1101 | Claude by Anthropic |
| 6 |  [Qwen2.5 72B Instruct](https://huggingface.co/Qwen) | 1092 | LLM family built by Alibaba Cloud |
| 7 |  [gpt-4-turbo-2024-04-09](https://platform.openai.com/docs/models/gpt-4-and-gpt-4-turbo) | 1079 | GPT-4-Turbo by OpenAI |
| 8 |  [gpt-4o-mini-2024-07-18](https://openai.com/index/gpt-4o-mini-advancing-cost-efficient-intelligence/) | 1064 | The most most cost-efficient small OpenAI language model |
| 9 |  [Gemma 2 27B](https://blog.google/technology/developers/google-gemma-2/) | 1059 | Gemma is a family of open models from Google |
| 10 |  [GigaChat-Max-preview 4.0.26.20]() | 1056 | Register the description at fastchat/model/model_registry.py |
| 11 |  [Llama 3.1 405B Instruct Turbo](https://ai.meta.com/blog/meta-llama-3-1/) | 1054 | Meta's Llama-3.1 most capable models to date |
| 12 |  [GigaChat-Pro 4.0.26.20]() | 1053 | Register the description at fastchat/model/model_registry.py |
| 13 |  [Vikhrmodels/Vikhr-Nemo-12B-Instruct-R-21-09-24](https://huggingface.co/Vikhrmodels) | 1040 | Open Source модели семейства Vikhr |
| 14 |  [Cohere: Command R+ (08-2024)](https://docs.cohere.com/v2/docs/command-r-plus) | 1026 | Command R+ 08 2024 is Cohere’s newest large language model, optimized for conversational interaction and long-context tasks. |
| 15 |  [YandexGPT Experimental](https://ya.ru/ai/gpt-3) | 1023 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 16 |  [Llama 3.1 70B Instruct Turbo](https://ai.meta.com/blog/meta-llama-3-1/) | 1021 | Meta's Llama-3.1 most capable models to date |
| 17 |  [saiga_llama3_70b](https://huggingface.co/IlyaGusev) | 1020 | Saiga - семейство Open Source русскоязычных моделей |
| 18 |  [gpt-4-0613](https://openai.com/research/gpt-4) | 1017 | GPT-4 by OpenAI |
| 19 |  [T-lite-instruct-0.1](https://huggingface.co/AnatoliiPotapov/T-lite-instruct-0.1) | 1016 | Open Source модель T-Lite от T-Bank AI |
| 20 |  [claude-3-haiku-20240307](https://docs.anthropic.com/en/docs/about-claude/models) | 1015 | Claude by Anthropic |
| 21 |  [LLaMA-3 Chat (70B)](https://llama.meta.com/llama3/) | 1010 | Meta's Llama-3 chat models |
| 22 |  [Qwen 2 Instruct (72B)](https://huggingface.co/Qwen) | 1008 | LLM family built by Alibaba Cloud |
| 23 |  [YandexGPT 4 Pro](https://ya.ru/ai/gpt-3) | 990 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 24 |  [GigaChat 4.0.26.20]() | 988 | Register the description at fastchat/model/model_registry.py |
| 25 |  [GigaChat-Pro 4.0.26.15](https://developers.sber.ru/gigachat/) | 983 | GigaChat — русскоязычная нейросеть от Сбера |
| 26 |  [saiga_llama3_8b_v7](https://huggingface.co/IlyaGusev) | 974 | Saiga - семейство Open Source русскоязычных моделей |
| 27 |  [GigaChat-Plus 4.0.26.15](https://developers.sber.ru/gigachat/) | 967 | GigaChat — русскоязычная нейросеть от Сбера |
| 28 |  [YandexGPT 3 Pro](https://ya.ru/ai/gpt-3) | 963 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 29 |  [GigaChat 4.0.26.15](https://developers.sber.ru/gigachat/) | 962 | GigaChat — русскоязычная нейросеть от Сбера |
| 30 |  [saiga_phi3_medium](https://huggingface.co/IlyaGusev) | 958 | Saiga - семейство Open Source русскоязычных моделей |
| 31 |  [LLaMA-3 Chat (8B)](https://llama.meta.com/llama3/) | 956 | Meta's Llama-3 chat models |
| 32 |  [Llama 3.2 11B Instruct](https://ai.meta.com/blog/llama-3-2-connect-2024-vision-edge-mobile-devices/) | 954 | Meta's Llama-3.2 most capable models to date |
| 33 |  [YandexGPT 3 Lite](https://ya.ru/ai/gpt-3) | 946 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 34 |  [RefalMachine/ruadapt_llama3_instruct_lep_saiga_kto_ablitirated](https://huggingface.co/RefalMachine/ruadapt_llama3_instruct_lep_saiga_kto_ablitirated) | 946 | Model was ablitirated and then trained with KTO on IlyaGusev/saiga_preferences. |
| 35 |  [gpt-3.5-turbo-0125](https://platform.openai.com/docs/models/gpt-3-5) | 941 | GPT-3.5-Turbo by OpenAI |
| 36 |  [Vikhrmodels/it-5.2-fp16-cp](https://huggingface.co/Vikhrmodels) | 938 | Open Source модели семейства Vikhr |
| 37 |  [Llama 3.1 8B Instruct Turbo](https://ai.meta.com/blog/meta-llama-3-1/) | 935 | Meta's Llama-3.1 most capable models to date |
| 38 |  [saiga_llama3_8b_v6](https://huggingface.co/IlyaGusev) | 917 | Saiga - семейство Open Source русскоязычных моделей |
| 39 |  [GigaChat-Pro 4.0.26.8](https://developers.sber.ru/gigachat/) | 910 | GigaChat — русскоязычная нейросеть от Сбера |
| 40 |  [GigaChat-Pro 2.2.25.3](https://developers.sber.ru/gigachat/) | 906 | GigaChat — русскоязычная нейросеть от Сбера |
| 41 |  [GigaChat 4.0.26.8](https://developers.sber.ru/gigachat/) | 897 | GigaChat — русскоязычная нейросеть от Сбера |
| 42 |  [GigaChat 3.1.25.3](https://developers.sber.ru/gigachat/) | 870 | GigaChat — русскоязычная нейросеть от Сбера |
| 43 |  [GigaChat-Plus 3.1.25.3](https://developers.sber.ru/gigachat/) | 856 | GigaChat — русскоязычная нейросеть от Сбера |

| 1 | 🥇 [Google: Gemini Pro 1.5](https://blog.google/technology/ai/google-gemini-pro-imagen-duet-ai-update/) | 1132 | Gemini by Google |
| 2 | 🥈 [claude-3-5-sonnet-20241022](https://docs.anthropic.com/en/docs/about-claude/models) | 1116 | Claude by Anthropic |
| 3 | 🥉 [gpt-4o-2024-05-13](https://openai.com/index/hello-gpt-4o/) | 1107 | The most advanced OpenAI language model |
| 4 |  [claude-3-5-sonnet-20240620](https://docs.anthropic.com/en/docs/about-claude/models) | 1097 | Claude by Anthropic |
| 5 |  [Google: Gemini Flash 1.5](https://blog.google/technology/ai/google-gemini-pro-imagen-duet-ai-update/) | 1093 | Gemini by Google |
| 6 |  [gpt-4-turbo-2024-04-09](https://platform.openai.com/docs/models/gpt-4-and-gpt-4-turbo) | 1073 | GPT-4-Turbo by OpenAI |
| 7 |  [Qwen2.5 72B Instruct](https://huggingface.co/Qwen) | 1061 | LLM family built by Alibaba Cloud |
| 8 |  [Llama 3.1 405B Instruct Turbo](https://ai.meta.com/blog/meta-llama-3-1/) | 1057 | Meta's Llama-3.1 most capable models to date |
| 9 |  [gpt-4o-mini-2024-07-18](https://openai.com/index/gpt-4o-mini-advancing-cost-efficient-intelligence/) | 1054 | The most most cost-efficient small OpenAI language model |
| 10 |  [gpt-4-0613](https://openai.com/research/gpt-4) | 1053 | GPT-4 by OpenAI |
| 11 |  [Gemma 2 27B](https://blog.google/technology/developers/google-gemma-2/) | 1042 | Gemma is a family of open models from Google |
| 12 |  [GigaChat-Max-preview 4.0.26.20]() | 1040 | Register the description at fastchat/model/model_registry.py |
| 13 |  [GigaChat-Pro 4.0.26.20]() | 1036 | Register the description at fastchat/model/model_registry.py |
| 14 |  [Llama 3.1 70B Instruct Turbo](https://ai.meta.com/blog/meta-llama-3-1/) | 1022 | Meta's Llama-3.1 most capable models to date |
| 15 |  [saiga_llama3_70b](https://huggingface.co/IlyaGusev) | 1021 | Saiga - семейство Open Source русскоязычных моделей |
| 16 |  [YandexGPT Experimental](https://ya.ru/ai/gpt-3) | 1020 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 17 |  [Qwen 2 Instruct (72B)](https://huggingface.co/Qwen) | 1019 | LLM family built by Alibaba Cloud |
| 18 |  [claude-3-haiku-20240307](https://docs.anthropic.com/en/docs/about-claude/models) | 1011 | Claude by Anthropic |
| 19 |  [Cohere: Command R+ (08-2024)](https://docs.cohere.com/v2/docs/command-r-plus) | 1008 | Command R+ 08 2024 is Cohere’s newest large language model, optimized for conversational interaction and long-context tasks. |
| 20 |  [YandexGPT 4 Pro](https://ya.ru/ai/gpt-3) | 1006 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 21 |  [LLaMA-3 Chat (70B)](https://llama.meta.com/llama3/) | 1002 | Meta's Llama-3 chat models |
| 22 |  [Vikhrmodels/Vikhr-Nemo-12B-Instruct-R-21-09-24](https://huggingface.co/Vikhrmodels) | 999 | Open Source модели семейства Vikhr |
| 23 |  [GigaChat-Pro 4.0.26.15](https://developers.sber.ru/gigachat/) | 991 | GigaChat — русскоязычная нейросеть от Сбера |
| 24 |  [gpt-3.5-turbo-0125](https://platform.openai.com/docs/models/gpt-3-5) | 987 | GPT-3.5-Turbo by OpenAI |
| 25 |  [YandexGPT 3 Pro](https://ya.ru/ai/gpt-3) | 985 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 26 |  [GigaChat 4.0.26.20]() | 978 | Register the description at fastchat/model/model_registry.py |
| 27 |  [GigaChat 4.0.26.15](https://developers.sber.ru/gigachat/) | 965 | GigaChat — русскоязычная нейросеть от Сбера |
| 28 |  [GigaChat-Plus 4.0.26.15](https://developers.sber.ru/gigachat/) | 965 | GigaChat — русскоязычная нейросеть от Сбера |
| 29 |  [saiga_llama3_8b_v7](https://huggingface.co/IlyaGusev) | 962 | Saiga - семейство Open Source русскоязычных моделей |
| 30 |  [Llama 3.2 11B Instruct](https://ai.meta.com/blog/llama-3-2-connect-2024-vision-edge-mobile-devices/) | 962 | Meta's Llama-3.2 most capable models to date |
| 31 |  [saiga_phi3_medium](https://huggingface.co/IlyaGusev) | 950 | Saiga - семейство Open Source русскоязычных моделей |
| 32 |  [T-lite-instruct-0.1](https://huggingface.co/AnatoliiPotapov/T-lite-instruct-0.1) | 950 | Open Source модель T-Lite от T-Bank AI |
| 33 |  [LLaMA-3 Chat (8B)](https://llama.meta.com/llama3/) | 948 | Meta's Llama-3 chat models |
| 34 |  [GigaChat-Pro 4.0.26.8](https://developers.sber.ru/gigachat/) | 947 | GigaChat — русскоязычная нейросеть от Сбера |
| 35 |  [Llama 3.1 8B Instruct Turbo](https://ai.meta.com/blog/meta-llama-3-1/) | 946 | Meta's Llama-3.1 most capable models to date |
| 36 |  [YandexGPT 3 Lite](https://ya.ru/ai/gpt-3) | 941 | YandexGPT — новая линейка генеративных моделей Яндекса |
| 37 |  [Vikhrmodels/it-5.2-fp16-cp](https://huggingface.co/Vikhrmodels) | 937 | Open Source модели семейства Vikhr |
| 38 |  [RefalMachine/ruadapt_llama3_instruct_lep_saiga_kto_ablitirated](https://huggingface.co/RefalMachine/ruadapt_llama3_instruct_lep_saiga_kto_ablitirated) | 934 | Model was ablitirated and then trained with KTO on IlyaGusev/saiga_preferences. |
| 39 |  [GigaChat 4.0.26.8](https://developers.sber.ru/gigachat/) | 933 | GigaChat — русскоязычная нейросеть от Сбера |
| 40 |  [GigaChat-Pro 2.2.25.3](https://developers.sber.ru/gigachat/) | 928 | GigaChat — русскоязычная нейросеть от Сбера |
| 41 |  [saiga_llama3_8b_v6](https://huggingface.co/IlyaGusev) | 917 | Saiga - семейство Open Source русскоязычных моделей |
| 42 |  [GigaChat 3.1.25.3](https://developers.sber.ru/gigachat/) | 902 | GigaChat — русскоязычная нейросеть от Сбера |
| 43 |  [GigaChat-Plus 3.1.25.3](https://developers.sber.ru/gigachat/) | 890 | GigaChat — русскоязычная нейросеть от Сбера |