1.25.1

1.25.1 (2024-12-16)

Fix

• fix: Leaderboard refinements (#1603)

• Added explanation of aggregate measures

• Added download button to result tables

• Task info gets sorted by task name

• Added custom, shareable links for each benchmark

• Moved explanation of aggregate metrics to the summary tab (6ecc86f)

Unknown

• Leaderboard: Refined plots (#1601)

• Added embedding size guide to performance-size plot, removed shading on radar chart

• Changed plot names to something more descriptive

• Made plots failsafe (0c9e046)

• Add new models nvidia, gte, linq (#1436)

• Add new models nvidia, gte, linq

• add warning for gte-Qwen and nvidia models re: instruction used in docs as well

---

Co-authored-by: isaac-chung <chungisaac1217@gmail.com> (95d5ae5)

• Feat: add support for scoring function (#1594)

• add support for scoring function

• lint

• move similarity to wrapper

• remove score function

• lint

• remove from InstructionRetrievalEvaluator

• Update mteb/evaluation/evaluators/RetrievalEvaluator.py

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsen@gmail.com>

• remove score function from README.md

---

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsen@gmail.com> (8e6ee46)

• doc: colbert add score_function & doc section (#1592)

• doc: colbert add score_function & doc section

• doc: Update README.md

Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsen@gmail.com>

• doc: Update README.md

Co-authored-by: Isaac Chung <chungisaac1217@gmail.com>

---

Co-authored-by: sam021313 <40773225+sam021313@users.noreply.github.com>
Co-authored-by: Kenneth Enevoldsen <kennethcenevoldsen@gmail.com>
Co-authored-by: Isaac Chung <chungisaac1217@gmail.com> (992b20b)