Japanese instruction‑chat dataset for fine‑tuning LLMs (e.g., with LoRA), 9 M+ samples, recently updated to drop licensed Alpaca data, clean Wikipedia and ALT outputs, and released under CC‑BY‑SA 4.0.
Description in other languages
Statistics
Statistics as of Nov 16, 2026
Hugging Face downloads (last 30 days)
572
Hugging Face likes
148
Listed
—
Listed since the page was created
Downloads (30-day window) over time
Show as a table
| Month | DL (30d) |
|---|---|
| Dec 2025 | 975 |
| Jan 2026 | 836 |
| Feb 2026 | 398 |
| Mar 2026 | 581 |
| Apr 2026 | 501 |
| May 2026 | 437 |
| Jun 2026 | 484 |
| Jul 2026 | 397 |
| Aug 2026 | 424 |
| Sep 2026 | 393 |
| Oct 2026 | 391 |
| Nov 2026 | 572 |
Downloads over the 30 days before the last snapshot of each month.
Popular in the same category
- ClimbLab-JaKantaHayashiAI15kClimbLab‑Ja is a 300 billion‑token Japanese corpus, filtered from LLM‑jp Corpus v4 into 20 clusters for pre‑training language models, released under ODC‑BY with original source licenses and stored in parquet format.
- llm-course-final-2026bumbuboon13kJapanese Wikipedia‑based RAG dataset for the LLM course final competition, containing ~1 million text chunks and a search index.
- JMedBenchColdog23331kJMedBench is a Japanese biomedical LLM benchmark comprising 20 datasets across five tasks (MCQA, NER, STS, etc.) sourced from MedMCQA, PubMedQA, MMLU, and others, each with its own license, and includes a note that translations may contain biases requiring human review.
- vntl-leaderboardlmg-anon857A leaderboard that ranks large language models by their semantic accuracy in translating Japanese visual novels into English, using cosine similarity over 256 samples and reporting chrF scores for comparison with tools like Sugoi Translator, Google Translate, Naver Papago, and Alibaba Translate.
- auto-wiki-qacl-nagoya747AutoWikiQA is the largest free Japanese QA dataset, providing over 2.3 million handcrafted‑filtered question–answer pairs automatically generated from Wikipedia with Swallow‑MX and LLMs (without rule‑based templates) to support knowledge‑teaching and retrieval‑augmented generation applications.
- jhumanevalkogi-jwu731JHumanEval is a hand‑translated Japanese version of the HumanEval benchmark, providing 164 Python programming problems with parallel English and Japanese comments to evaluate Japanese‑LLM code generation while preserving the original English errors.
Resources in similar research fields
jmed-llmsociocom59JMED-LLM: Japanese Medical Evaluation Dataset for Large Language ModelsGitHubShared: Semantic Text Processing- japanese-gpt-neox-smallrinna656kA 12‑layer, 768‑hidden Japanese GPT‑NeoX model trained on CC‑100, C4, and Wikipedia, compatible with Huggingface, with an optional toy prefix‑tuning weight that forces each sentence to end with a smiling‑face emoji.HF modelShared: Semantic Text Processing
- llm-jp-3-150mllm-jp75kLLM‑jp‑3‑150m—a 150‑M‑parameter Japanese language model from the National Institute of Informatics’ LLM R&D Center—is distributed in Hugging Face Transformers format, requiring torch ≥ 2.3.0, transformers ≥ 4.40.1, accelerate ≥ 0.29.3, flash‑attn ≥ 2.5.8, and was pretrained on Japanese Wikipedia, Common Crawl, WARP/PDF, WARP/HTML, and Kaken data using a unigram byte‑fallback tokenizer.HF modelShared: Semantic Text Processing
- llm-jp-3-1.8bllm-jp3kA collection of Japanese large‑language models (1.8 b to 172 b beta1, with instruct variants) from NII’s R&D Center, packaged in Hugging Face Transformers format and pretrained on a mix of Japanese, English, and Web corpora totalling >1 trillion tokens, requiring torch ≥ 2.3, transformers ≥ 4.40, accelerate ≥ 0.29, and flash‑attn ≥ 2.5.HF modelShared: Semantic Text Processing
- japanese-gpt-1brinna2kA 1.3‑B‑parameter, 24‑layer transformer GPT‑1B, trained on Japanese C4, CC‑100, and Wikipedia, was released by rinna Co. on January 26 2022 and is available under the MIT license.HF modelShared: Semantic Text Processing
WLSP-familiaritymasayu-a13Word Familiarity Rate for 'Word List by Semantic Principles (WLSP)'GitHubShared: Semantic Text Processing