
This repository contains scripts to reproduce the LLM-jp corpus.
Description in other languages
Statistics
Statistics as of Nov 17, 2026
GitHub stars
49
±0 (Oct 13〜)
Last commit
Oct 2023
Created on GitHub
Jun 14, 2023
Listed
Jul 24, 2023
Stars over time
Show as a table
| Month | Stars |
|---|---|
| Dec 2025 | 43 |
| Jan 2026 | 43 |
| Feb 2026 | 43 |
| Mar 2026 | 44 |
| Apr 2026 | 45 |
| May 2026 | 46 |
| Jun 2026 | 47 |
| Jul 2026 | 47 |
| Aug 2026 | 48 |
| Sep 2026 | 48 |
| Oct 2026 | 49 |
| Nov 2026 | 49 |
Last snapshot of each month. Star counts of 1,000 or more are rounded to the nearest 100.
Popular in the same category
llm-japanese-datasetmasanorihirano91Japanese chat dataset for building LLM.
jmed-llmsociocom59JMED-LLM: Japanese Medical Evaluation Dataset for Large Language Models
japanese-llm-benchmarkshi3z53A benchmark tool for evaluating Japanese language capabilities of various LLMs.
EDINET-BenchSakanaAI37[ICLR 2026] Evaluating the performance of LLMs on Japanese challenging financial tasks.
Japanese-RP-BenchAratako25Japanese-RP-Bench is a benchmark for measuring LLM's Japanese role-playing ability.
do-not-answer-jakunishou24A safety evaluation dataset "Do-Not-Answer" released by the University of Melbourne in August 2023 has been automatically translated into Japanese for use in the evaluation of Japanese LLM, and further modified to take into account Japanese culture.
Resources in similar research fields
- AnswerCarefullyllm-jp644AnswerCarefully Dataset supplies Japanese and multilingual data for commercial or non‑commercial LLM safety enhancement, prohibits any other use—including safety circumvention—allows derivative works with attribution, and carries a creator disclaimer of non‑liability for harms or service changes.HF datasetShared: Annotation and Dataset Development
- JGLUEllm-book546Dataset card for the JGLUE dataset used in the book “Large Language Model Introduction,” sourced from the original repo, with code licensed CC BY‑SA 4.0, data under the distributor’s license, citing Kurihara & Kawahara (in Japanese), and built on Shunsuke Kitada’s repository.HF datasetShared: Annotation and Dataset Development
- scaling-data-constrained-llmsllm-jp402A collection of Japanese and English web corpora—including a 9 B‑token Japanese set (JA‑WEB‑9B), 63 B‑token English and Japanese sets (EN‑WEB‑63B, JA‑WEB‑63B) and synthetic versions such as paraphrased JA‑PARAPHRASE‑63B, instruction‑style JA‑INSTRUCT‑63B, and translated JA‑TRANSLATE‑63B—used for studying data augmentation in pre‑training Japanese LLMs under data‑constrained settings.HF datasetShared: Annotation and Dataset Development
- kaken-trans-ja-enhpprc358Japanese text from the kaken subset of llm-jp-corpus-v3 translated into English with Qwen/Qwen2.5‑32B‑Instruct, released as an open Japanese–English parallel corpus under a CC‑BY 4.0 license that inherits the original dataset’s terms.HF datasetShared: Annotation and Dataset Development
- oasst1-21k-jallm-jp271oasst1‑21k‑ja is a Japanese instruction‑tuning dataset derived by DeepL from the English OASST1 subset, created through the LLM‑jp collaborative project in Japan; contact llm‑jp@nii.ac.jp and authors include Kiyomaru, Matsuda, Suzuki, Han, Sugawara, Sasaki, Kurita, Nakamura, Kodama, and Okamoto.HF datasetShared: Annotation and Dataset Development
- llm-japanese-dataset-vanillaizumi-lab255A Japanese chat dataset stripped of English‑Japanese translation data from izumi-lab’s llm-japanese-dataset, intended for fine‑tuning Japanese LLMs on instruction‑response tasks via LoRA and available under CC‑BY‑SA 4.0.HF datasetShared: Annotation and Dataset Development