A benchmark dataset and evaluation toolkit for measuring how accurately Japanese G2P, morphological analyzers, and TTS systems read kanji from the Ministry of Culture’s Jōyō‑kanji list, featuring 4,512 kanji‑reading pairs with three annotated example sentences each and detailed annotations for multiple readings.
Description in other languages
Statistics
Statistics as of Nov 16, 2026
Hugging Face downloads (last 30 days)
272
Hugging Face likes
7
Listed
Aug 17, 2026
Downloads (30-day window) over time
Show as a table
| Month | DL (30d) |
|---|---|
| Dec 2025 | — |
| Jan 2026 | — |
| Feb 2026 | — |
| Mar 2026 | — |
| Apr 2026 | — |
| May 2026 | — |
| Jun 2026 | — |
| Jul 2026 | — |
| Aug 2026 | 469 |
| Sep 2026 | 366 |
| Oct 2026 | 290 |
| Nov 2026 | 272 |
Downloads over the 30 days before the last snapshot of each month.
Popular in the same category
- joyo-kanji-yomi-benchmarksbintuitions224A Japanese TTS benchmark that evaluates kanji pronunciation across all 2,136 Joyo kanji with 4,378 readings using 13,095 native‑speaker‑verified sentences, each targeting a single reading and annotated for automatic CER calculation under an MIT license.
- voicebench-jasbintuitions161A dataset that quantitatively compares the intelligence and inference differences between speech‑input and text‑input in voice language models by applying TTS to samples from three benchmarks (Elyza‑tasks‑100, M‑IFEval, JamC‑QA), producing four subsets—Elyza, Spoken‑Elyza, M‑IFEval, and JamC‑QA—with 1,452 usable audio examples under a CC BY‑SA 4.0 license for non‑commercial use.
- emilia-yodasTTS-AGI18kDataset of dialogues and lore from the Fate/Stay Night character “Emilia”, formatted for training and evaluating conversational language models.
- fgo_voices_jpdeepghs10kJP Voice‑Text Dataset for FGO Waifus: a 30,800‑record, 66.4‑hour Japanese audio collection of single‑voice‑actor character lines (≈7.76 s each) useful for ASR/ASV fine‑tuning and evaluation.
- JGLUEshunk0313kUpdated JGLUE dataset card and loading script for a Japanese NLP benchmark (created by Yahoo Japan and Waseda University) that covers text classification (MARC‑ja, JCoLA), sentence‑pair classification (JNLI), and QA (JSQuAD, JCommonsenseQA), with releases linked on GitHub and Hugging Face.
- JMTEBsbintuitions3kJMTEB is a Japanese text‑embedding benchmark featuring 5 tasks (clustering, classification, STS, retrieval, reranking) and 28 datasets, offering a one‑line evaluation script and inviting community contributions.
Resources in similar research fields
lm-evaluation-harnessEleutherAI14kA framework for few-shot evaluation of language models.MultilingualShared: Corpora & datasets・Evaluation & benchmarks- ELYZA-tasks-100elyza2kA 100‑sample Japanese instruction‑tuning evaluation dataset of annotated tasks—ranging from summarization correction and math reasoning to translation, creative generation, and user‑intent understanding—designed for manual or automatic 5‑point rating of fine‑tuned models.Shared: Corpora & datasets・Evaluation & benchmarks
- JMMLUnlp-waseda1kJMMLU is a Japanese Massive Multitask Language Understanding Benchmark featuring 7,536 teacher‑crafted questions across 56 subjects, including professional medicine, psychology, accounting, philosophy, and diverse high‑school disciplines.Shared: Corpora & datasets・Evaluation & benchmarks
sacrebleumjpost1.3kReference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons.MultilingualShared: Corpora & datasets・Evaluation & benchmarks
xtremegoogle-research650XTREME is a benchmark for the evaluation of the cross-lingual generalization ability of pre-trained multilingual models that covers 40 typologically diverse languages and includes nine tasks.MultilingualShared: Corpora & datasets・Evaluation & benchmarks
pawsgoogle-research-datasets572This dataset contains 108,463 human-labeled and 656k noisily labeled pairs that feature the importance of modeling structure, context, and word order information for the problem of paraphrase identification.MultilingualShared: Corpora & datasets・Evaluation & benchmarks