
MTEB: State-of-the-art evaluation of embeddings across languages and modalities.
Description in other languages
Statistics
Statistics as of Nov 17, 2026
GitHub stars
3,400
±0 (Oct 13〜)
Last commit
Nov 2026
Created on GitHub
Apr 5, 2022
Listed
—
Listed since the page was created
Stars over time
Show as a table
| Month | Stars |
|---|---|
| Dec 2025 | — |
| Jan 2026 | — |
| Feb 2026 | — |
| Mar 2026 | — |
| Apr 2026 | — |
| May 2026 | — |
| Jun 2026 | — |
| Jul 2026 | — |
| Aug 2026 | — |
| Sep 2026 | 3,400 |
| Oct 2026 | 3,400 |
| Nov 2026 | 3,400 |
Last snapshot of each month. Star counts of 1,000 or more are rounded to the nearest 100.
Use on PyPI
PyPI packages: mteb · Monthly figures to Oct 2026 (ClickPy)
Downloads, last 12 months
23,604,322
Share from Japan (last 12 months)
0.5%
PyPI packages that depend on it
28
15 as a required dependency
Monthly downloads on PyPI
Show as a table
| Month | downloads (month) |
|---|---|
| Jan 2019 | — |
| Feb 2019 | — |
| Mar 2019 | — |
| Apr 2019 | — |
| May 2019 | — |
| Jun 2019 | — |
| Jul 2019 | — |
| Aug 2019 | — |
| Sep 2019 | — |
| Oct 2019 | — |
| Nov 2019 | — |
| Dec 2019 | — |
| Jan 2020 | — |
| Feb 2020 | — |
| Mar 2020 | — |
| Apr 2020 | — |
| May 2020 | — |
| Jun 2020 | — |
| Jul 2020 | — |
| Aug 2020 | — |
| Sep 2020 | — |
| Oct 2020 | — |
| Nov 2020 | — |
| Dec 2020 | — |
| Jan 2021 | — |
| Feb 2021 | — |
| Mar 2021 | — |
| Apr 2021 | — |
| May 2021 | — |
| Jun 2021 | — |
| Jul 2021 | — |
| Aug 2021 | — |
| Sep 2021 | — |
| Oct 2021 | — |
| Nov 2021 | — |
| Dec 2021 | — |
| Jan 2022 | — |
| Feb 2022 | — |
| Mar 2022 | — |
| Apr 2022 | — |
| May 2022 | — |
| Jun 2022 | 46 |
| Jul 2022 | 160 |
| Aug 2022 | 77 |
| Sep 2022 | 61 |
| Oct 2022 | 599 |
| Nov 2022 | 684 |
| Dec 2022 | 453 |
| Jan 2023 | 530 |
| Feb 2023 | 1,064 |
| Mar 2023 | 1,616 |
| Apr 2023 | 1,079 |
| May 2023 | 911 |
| Jun 2023 | 1,283 |
| Jul 2023 | 4,463 |
| Aug 2023 | 11,478 |
| Sep 2023 | 2,474 |
| Oct 2023 | 3,589 |
| Nov 2023 | 4,567 |
| Dec 2023 | 14,143 |
| Jan 2024 | 10,903 |
| Feb 2024 | 67,152 |
| Mar 2024 | 124,419 |
| Apr 2024 | 343,353 |
| May 2024 | 103,349 |
| Jun 2024 | 80,563 |
| Jul 2024 | 210,807 |
| Aug 2024 | 229,116 |
| Sep 2024 | 86,433 |
| Oct 2024 | 129,791 |
| Nov 2024 | 125,064 |
| Dec 2024 | 98,809 |
| Jan 2025 | 200,789 |
| Feb 2025 | 163,626 |
| Mar 2025 | 218,342 |
| Apr 2025 | 196,072 |
| May 2025 | 216,958 |
| Jun 2025 | 157,347 |
| Jul 2025 | 155,513 |
| Aug 2025 | 237,083 |
| Sep 2025 | 336,557 |
| Oct 2025 | 485,100 |
| Nov 2025 | 473,289 |
| Dec 2025 | 1,604,999 |
| Jan 2026 | 1,670,397 |
| Feb 2026 | 2,132,022 |
| Mar 2026 | 1,521,270 |
| Apr 2026 | 3,115,223 |
| May 2026 | 2,554,413 |
| Jun 2026 | 3,118,173 |
| Jul 2026 | 3,180,141 |
| Aug 2026 | 2,752,362 |
| Sep 2026 | 699,326 |
| Oct 2026 | 782,707 |
Popular in the same category
miraclproject-miracl214A large-scale multilingual dataset for Information Retrieval. Thorough human-annotations across 18 diverse languages.
lm-evaluation-harnessEleutherAI14kA framework for few-shot evaluation of language models.
sacrebleumjpost1.3kReference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons.
xtremegoogle-research650XTREME is a benchmark for the evaluation of the cross-lingual generalization ability of pre-trained multilingual models that covers 40 typologically diverse languages and includes nine tasks.
pawsgoogle-research-datasets572This dataset contains 108,463 human-labeled and 656k noisily labeled pairs that feature the importance of modeling structure, context, and word order information for the problem of paraphrase identification.
massivealexa572Tools and Modeling Code for the MASSIVE dataset.
Resources in similar research fields
- JMTEBsbintuitions3kJMTEB is a Japanese text‑embedding benchmark featuring 5 tasks (clustering, classification, STS, retrieval, reranking) and 28 datasets, offering a one‑line evaluation script and inviting community contributions.HF datasetShared: Embeddings, search & RAG・Corpora & datasets
- wikipedia-passages-jawiki-embeddingshotchpotch731Japanese Wikipedia sentences are transformed into various embeddings and a FAISS index, offering a Hugging Face Space demo, conversion scripts, and evaluations of search, Q&A, and OpenAI text‑embedding‑3‑small for RAG; embeddings are OpenAI‑licensed, others CC‑BY‑SA‑4.0.HF datasetShared: Embeddings, search & RAG・Corpora & datasets
- msmarco-ja-hard-negativeshotchpotch408Japanese hard‑negative mining and evaluation on the MSMARCO‑JA dataset, detailing normalization, filtering, BAAI/BGE reranker selection, random sampling, SPLADE‑based ranking, and chi‑square analysis showing statistically significant higher positive rates than the original mMARCO(ja).HF datasetShared: Embeddings, search & RAG・Corpora & datasets
- RAG-Evaluation-Dataset-JAallganize246Provides a Japanese RAG benchmark across five industry domains—finance, telecom, manufacturing, public, retail—by publishing datasets, an automatic evaluation framework, and comparative results for models such as Claude 3.5‑Sonnet, GPT‑4o, and others.HF datasetShared: Embeddings, search & RAG・Corpora & datasets
jacwirhotchpotch9JaCWIR: Japanese Casual Web IR Small-scale and casual web title and abstract dataset for Japanese information retrieval evaluation.GitHubShared: Embeddings, search & RAG・Corpora & datasets
JFinTEBretarfi5Japanese Financial Text Embedding BenchmarkGitHubShared: Embeddings, search & RAG・Corpora & datasets