
A large-scale multilingual dataset for Information Retrieval. Thorough human-annotations across 18 diverse languages.
Description in other languages
Statistics
Statistics as of Nov 17, 2026
GitHub stars
214
±0 (Oct 13〜)
Last commit
Jul 2024
Created on GitHub
Sep 8, 2022
Listed
—
Listed since the page was created
Stars over time
Show as a table
| Month | Stars |
|---|---|
| Dec 2025 | — |
| Jan 2026 | — |
| Feb 2026 | — |
| Mar 2026 | — |
| Apr 2026 | — |
| May 2026 | — |
| Jun 2026 | — |
| Jul 2026 | — |
| Aug 2026 | — |
| Sep 2026 | 213 |
| Oct 2026 | 214 |
| Nov 2026 | 214 |
Last snapshot of each month. Star counts of 1,000 or more are rounded to the nearest 100.
Popular in the same category
mtebembeddings-benchmark3.4kMTEB: State-of-the-art evaluation of embeddings across languages and modalities.
lm-evaluation-harnessEleutherAI14kA framework for few-shot evaluation of language models.
sacrebleumjpost1.3kReference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons.
xtremegoogle-research650XTREME is a benchmark for the evaluation of the cross-lingual generalization ability of pre-trained multilingual models that covers 40 typologically diverse languages and includes nine tasks.
pawsgoogle-research-datasets572This dataset contains 108,463 human-labeled and 656k noisily labeled pairs that feature the importance of modeling structure, context, and word order information for the problem of paraphrase identification.
massivealexa572Tools and Modeling Code for the MASSIVE dataset.
Resources in similar research fields
- JMTEBsbintuitions3kJMTEB is a Japanese text‑embedding benchmark featuring 5 tasks (clustering, classification, STS, retrieval, reranking) and 28 datasets, offering a one‑line evaluation script and inviting community contributions.HF datasetShared: Embeddings, search & RAG・Corpora & datasets
- wikipedia-passages-jawiki-embeddingshotchpotch731Japanese Wikipedia sentences are transformed into various embeddings and a FAISS index, offering a Hugging Face Space demo, conversion scripts, and evaluations of search, Q&A, and OpenAI text‑embedding‑3‑small for RAG; embeddings are OpenAI‑licensed, others CC‑BY‑SA‑4.0.HF datasetShared: Embeddings, search & RAG・Corpora & datasets
- msmarco-ja-hard-negativeshotchpotch408Japanese hard‑negative mining and evaluation on the MSMARCO‑JA dataset, detailing normalization, filtering, BAAI/BGE reranker selection, random sampling, SPLADE‑based ranking, and chi‑square analysis showing statistically significant higher positive rates than the original mMARCO(ja).HF datasetShared: Embeddings, search & RAG・Corpora & datasets
- RAG-Evaluation-Dataset-JAallganize246Provides a Japanese RAG benchmark across five industry domains—finance, telecom, manufacturing, public, retail—by publishing datasets, an automatic evaluation framework, and comparative results for models such as Claude 3.5‑Sonnet, GPT‑4o, and others.HF datasetShared: Embeddings, search & RAG・Corpora & datasets
jacwirhotchpotch9JaCWIR: Japanese Casual Web IR Small-scale and casual web title and abstract dataset for Japanese information retrieval evaluation.GitHubShared: Embeddings, search & RAG・Corpora & datasets
JFinTEBretarfi5Japanese Financial Text Embedding BenchmarkGitHubShared: Embeddings, search & RAG・Corpora & datasets