AutoWikiQA is the largest free Japanese QA dataset, providing over 2.3 million handcrafted‑filtered question–answer pairs automatically generated from Wikipedia with Swallow‑MX and LLMs (without rule‑based templates) to support knowledge‑teaching and retrieval‑augmented generation applications.
Description in other languages
Statistics
Statistics as of Nov 16, 2026
Hugging Face downloads (last 30 days)
747
Hugging Face likes
24
Listed
May 13, 2024
Downloads (30-day window) over time
Show as a table
| Month | DL (30d) |
|---|---|
| Dec 2025 | 542 |
| Jan 2026 | 157 |
| Feb 2026 | 210 |
| Mar 2026 | 115 |
| Apr 2026 | — |
| May 2026 | 190 |
| Jun 2026 | 163 |
| Jul 2026 | 132 |
| Aug 2026 | 168 |
| Sep 2026 | 247 |
| Oct 2026 | 230 |
| Nov 2026 | 747 |
Downloads over the 30 days before the last snapshot of each month.
Popular in the same category
- JMedBenchColdog23331kJMedBench is a Japanese biomedical LLM benchmark comprising 20 datasets across five tasks (MCQA, NER, STS, etc.) sourced from MedMCQA, PubMedQA, MMLU, and others, each with its own license, and includes a note that translations may contain biases requiring human review.
- nri-fin-reasoningnri-ai707Japanese instruction dataset with 632,636 multi‑turn samples (~6.35 B tokens) and GPT‑OSS‑120b reasoning traces for open‑ended, math, writing, and MCQA tasks across 135 finance topics plus 20 general ones, designed to fine‑tune LLM reasoning in finance.
- llm-jp-evalllm-book666Dataset card for the ja‑vicuna‑qa‑benchmark used in the book “Introduction to Large‑Scale LLM II” and created by llm‑jp‑eval for cross‑dataset Japanese LLM evaluation (Apache 2.0).
- DEJIMA-datasetMIL-UT359DEJIMA is a web‑scale Japanese image dataset with 3.88 M image–caption pairs and 3.88 M image–question–answer pairs, generated by strict filtering, deduplication, detection‑driven evidence extraction, and LLM‑based caption/VQA under grounding constraints, plus multiple curated variants for each task.
- JDocQA-Reasoningricoh-ai269A Japanese benchmark, JDocQA Reasoning Bench, released by Ricoh for the GENIAC project, evaluates LMMs on 1,286 reasoning questions over complex charts, tables, and diagrams using automated LLM-as‑Judge scoring.
- ChouBunSakanaAI103ChouBun is a Japanese-language long‑context benchmark for LLMs featuring two task types—extractive QA (wiki_qa, edinet_qa) and abstractive summarization (corp_sec_qa, corp_sec_sum)—built from Wikipedia articles, EDINET security reports, and corporate documents, with standardized THUDM/LongBench format and up to 32768‑token contexts.
Resources in similar research fields
- embhpprc1kA catalog of Japanese and multilingual QA, NLI and paraphrase datasets, detailing each dataset’s retrieval or QA tasks and its license (Apache 2.0, CC‑BY‑SA/CC‑BY, MIT, etc.).Shared: Annotation and Dataset Development
lawqa_jpdigital-go-jp279Multiple-choice QA dataset on Japanese regulationsGitHubShared: Annotation and Dataset Development- AnswerCarefullyllm-jp644AnswerCarefully Dataset supplies Japanese and multilingual data for commercial or non‑commercial LLM safety enhancement, prohibits any other use—including safety circumvention—allows derivative works with attribution, and carries a creator disclaimer of non‑liability for harms or service changes.Shared: Annotation and Dataset Development
- JGLUEllm-book546Dataset card for the JGLUE dataset used in the book “Large Language Model Introduction,” sourced from the original repo, with code licensed CC BY‑SA 4.0, data under the distributor’s license, citing Kurihara & Kawahara (in Japanese), and built on Shunsuke Kitada’s repository.Shared: Annotation and Dataset Development
- scaling-data-constrained-llmsllm-jp402A collection of Japanese and English web corpora—including a 9 B‑token Japanese set (JA‑WEB‑9B), 63 B‑token English and Japanese sets (EN‑WEB‑63B, JA‑WEB‑63B) and synthetic versions such as paraphrased JA‑PARAPHRASE‑63B, instruction‑style JA‑INSTRUCT‑63B, and translated JA‑TRANSLATE‑63B—used for studying data augmentation in pre‑training Japanese LLMs under data‑constrained settings.Shared: Annotation and Dataset Development
medLLM_QA_benchmarkaistairc6Trilingual (English, Japanese, Chinese) QA benchmark for medical LLMGitHubShared: Annotation and Dataset Development