MTEB benchmarks?

#2
by lemon07r - opened

How would this model score on the MTEB leaderboard?
https://huggingface.co/spaces/mteb/leaderboard

Beijing Academy of Artificial Intelligence org

Hello, @lemon07r . Thanks for your question. This model is specifically optimized for reasoning-intensive retrieval tasks. We have not yet evaluated its performance on the general retrieval tasks in MTEB, but we may consider doing so in the future.

Hello, @lemon07r . Thanks for your question. This model is specifically optimized for reasoning-intensive retrieval tasks. We have not yet evaluated its performance on the general retrieval tasks in MTEB, but we may consider doing so in the future.

No reason not to unless you don't want users to see those scores.

Sign up or log in to comment