Japanese hard‑negative mining and evaluation on the MSMARCO‑JA dataset, detailing normalization, filtering, BAAI/BGE reranker selection, random sampling, SPLADE‑based ranking, and chi‑square analysis showing statistically significant higher positive rates than the original mMARCO(ja).
Description in other languages
Statistics
Statistics as of Nov 16, 2026
Hugging Face downloads (last 30 days)
408
Hugging Face likes
3
Listed
Nov 26, 2024
Downloads (30-day window) over time
Show as a table
| Month | DL (30d) |
|---|---|
| Dec 2025 | 208 |
| Jan 2026 | — |
| Feb 2026 | — |
| Mar 2026 | — |
| Apr 2026 | — |
| May 2026 | 309 |
| Jun 2026 | — |
| Jul 2026 | — |
| Aug 2026 | 106 |
| Sep 2026 | 216 |
| Oct 2026 | 390 |
| Nov 2026 | 408 |
Downloads over the 30 days before the last snapshot of each month.
Popular in the same category
- JMTEBsbintuitions3kJMTEB is a Japanese text‑embedding benchmark featuring 5 tasks (clustering, classification, STS, retrieval, reranking) and 28 datasets, offering a one‑line evaluation script and inviting community contributions.
- wikipedia-passages-jawiki-embeddingshotchpotch731Japanese Wikipedia sentences are transformed into various embeddings and a FAISS index, offering a Hugging Face Space demo, conversion scripts, and evaluations of search, Q&A, and OpenAI text‑embedding‑3‑small for RAG; embeddings are OpenAI‑licensed, others CC‑BY‑SA‑4.0.
- JQaRAhotchpotch436A Japanese QA dataset for evaluating Retrieval‑Augmented Generation (RAG), built from JAQKET questions and Wikipedia passages with gold retrieval‑relevance labels, released on HuggingFace and GitHub and scored primarily by nDCG@10.
- RAG-Evaluation-Dataset-JAallganize246Provides a Japanese RAG benchmark across five industry domains—finance, telecom, manufacturing, public, retail—by publishing datasets, an automatic evaluation framework, and comparative results for models such as Claude 3.5‑Sonnet, GPT‑4o, and others.
- Japanese-RAG-Generator-Benchmarkneoai-inc113Japanese RAG Generator Benchmark (J‑RAGBench) supplies a multi‑category QA dataset—covering Integration, Reasoning, Logical, Table, and Abstention—designed to evaluate Japanese RAG generators, built with human effort and GPT‑4.1, and released under CC BY‑SA 4.0.
- emilia-yodasTTS-AGI18kDataset of dialogues and lore from the Fate/Stay Night character “Emilia”, formatted for training and evaluating conversational language models.
Resources in similar research fields
mtebembeddings-benchmark3.4kMTEB: State-of-the-art evaluation of embeddings across languages and modalities.MultilingualShared: Embeddings, search & RAG・Corpora & datasets
miraclproject-miracl214A large-scale multilingual dataset for Information Retrieval. Thorough human-annotations across 18 diverse languages.MultilingualShared: Embeddings, search & RAG・Corpora & datasets
jacwirhotchpotch9JaCWIR: Japanese Casual Web IR Small-scale and casual web title and abstract dataset for Japanese information retrieval evaluation.GitHubShared: Embeddings, search & RAG・Corpora & datasets
JFinTEBretarfi5Japanese Financial Text Embedding BenchmarkGitHubShared: Embeddings, search & RAG・Corpora & datasets
lm-evaluation-harnessEleutherAI14kA framework for few-shot evaluation of language models.MultilingualShared: Corpora & datasets・Evaluation & benchmarks- ELYZA-tasks-100elyza2kA 100‑sample Japanese instruction‑tuning evaluation dataset of annotated tasks—ranging from summarization correction and math reasoning to translation, creative generation, and user‑intent understanding—designed for manual or automatic 5‑point rating of fine‑tuned models.Shared: Corpora & datasets・Evaluation & benchmarks