ChouBun is a Japanese-language long‑context benchmark for LLMs featuring two task types—extractive QA (wiki_qa, edinet_qa) and abstractive summarization (corp_sec_qa, corp_sec_sum)—built from Wikipedia articles, EDINET security reports, and corporate documents, with standardized THUDM/LongBench format and up to 32768‑token contexts.
Description in other languages
Statistics
Statistics as of Nov 16, 2026
Hugging Face downloads (last 30 days)
103
Hugging Face likes
10
Listed
Oct 22, 2024
Downloads (30-day window) over time
Show as a table
| Month | DL (30d) |
|---|---|
| Dec 2025 | 113 |
| Jan 2026 | — |
| Feb 2026 | — |
| Mar 2026 | — |
| Apr 2026 | — |
| May 2026 | — |
| Jun 2026 | — |
| Jul 2026 | 156 |
| Aug 2026 | — |
| Sep 2026 | — |
| Oct 2026 | — |
| Nov 2026 | 103 |
Downloads over the 30 days before the last snapshot of each month.
Popular in the same category
- JMedBenchColdog23331kJMedBench is a Japanese biomedical LLM benchmark comprising 20 datasets across five tasks (MCQA, NER, STS, etc.) sourced from MedMCQA, PubMedQA, MMLU, and others, each with its own license, and includes a note that translations may contain biases requiring human review.
- llm-jp-evalllm-book666Dataset card for the ja‑vicuna‑qa‑benchmark used in the book “Introduction to Large‑Scale LLM II” and created by llm‑jp‑eval for cross‑dataset Japanese LLM evaluation (Apache 2.0).
- JDocQA-Reasoningricoh-ai269A Japanese benchmark, JDocQA Reasoning Bench, released by Ricoh for the GENIAC project, evaluates LMMs on 1,286 reasoning questions over complex charts, tables, and diagrams using automated LLM-as‑Judge scoring.
- JGLUEshunk0313kUpdated JGLUE dataset card and loading script for a Japanese NLP benchmark (created by Yahoo Japan and Waseda University) that covers text classification (MARC‑ja, JCoLA), sentence‑pair classification (JNLI), and QA (JSQuAD, JCommonsenseQA), with releases linked on GitHub and Hugging Face.
- JamC-QAsbintuitions2kJamC‑QA is a bilingual benchmark of multiple‑choice questions spanning eight Japanese‑culture and knowledge categories, with leaderboard metrics comparing state‑of‑the‑art models.
- JMMMU-ProJMMMU1kJMMMU‑Pro is an image‑based Japanese multimodal benchmark created by generating visual questions with a realistic model and human verification, revealing that current open‑source LMMs perform poorly on it and offering a cost‑effective method for future VQA benchmark development.
Resources in similar research fields
medLLM_QA_benchmarkaistairc6Trilingual (English, Japanese, Chinese) QA benchmark for medical LLMGitHubShared: Large language models・Corpora & datasets
belebelefacebookresearch339Repo for the Belebele dataset, a massively multilingual reading comprehension dataset.MultilingualShared: Corpora & datasets・Evaluation & benchmarks- auto-wiki-qacl-nagoya747AutoWikiQA is the largest free Japanese QA dataset, providing over 2.3 million handcrafted‑filtered question–answer pairs automatically generated from Wikipedia with Swallow‑MX and LLMs (without rule‑based templates) to support knowledge‑teaching and retrieval‑augmented generation applications.Shared: Large language models・Corpora & datasets
tydiqagoogle-research-datasets319TyDi QA contains 200k human-annotated question-answer pairs in 11 Typologically Diverse languages, written without seeing the answer and without the use of translation, and is designed for the training and evaluation of automatic question answering systems. This repository provides evaluation code and a baseline system for the dataset.MultilingualShared: Corpora & datasets・Evaluation & benchmarks- jhumanevalkogi-jwu731JHumanEval is a hand‑translated Japanese version of the HumanEval benchmark, providing 164 Python programming problems with parallel English and Japanese comments to evaluate Japanese‑LLM code generation while preserving the original English errors.Shared: Large language models・Corpora & datasets
- nri-fin-reasoningnri-ai707Japanese instruction dataset with 632,636 multi‑turn samples (~6.35 B tokens) and GPT‑OSS‑120b reasoning traces for open‑ended, math, writing, and MCQA tasks across 135 finance topics plus 20 general ones, designed to fine‑tune LLM reasoning in finance.Shared: Large language models・Corpora & datasets