
A repo for evaluating Japanese LLMs ・ 日本語LLMを評価するレポ
Description in other languages
Statistics
Statistics as of Nov 17, 2026
GitHub stars
5
±0 (Oct 13〜)
Last commit
Apr 2024
Created on GitHub
Mar 28, 2024
Listed
May 14, 2024
Stars over time
Show as a table
| Month | Stars |
|---|---|
| Dec 2025 | 5 |
| Jan 2026 | 5 |
| Feb 2026 | 5 |
| Mar 2026 | 5 |
| Apr 2026 | 5 |
| May 2026 | — |
| Jun 2026 | 5 |
| Jul 2026 | 5 |
| Aug 2026 | 5 |
| Sep 2026 | 5 |
| Oct 2026 | 5 |
| Nov 2026 | 5 |
Last snapshot of each month. Star counts of 1,000 or more are rounded to the nearest 100.
Popular in the same category
llm-leaderboardwandb95Project of llm evaluation to Japanese tasks
japanese-llm-rankingyuzu-ai50This repository supports YuzuAI's Rakuda leaderboard of Japanese LLMs, which is a Japanese-focused analogue of LMSYS' Vicuna eval.
llm-jp-eval-mmllm-jp44This tool automatically evaluates Japanese multi-modal large language models across multiple datasets.
japanese-llm-roleplay-benchmarkoshizo42This repository was created to evaluate the performance of character role-playing in Japanese LLM.
gpt4-autoevalnorthern-system-service17Script for automatically evaluating language model responses using GPT-4.
IgakuQA119naoto-iwase10Evaluating LLMs on the 119th Japanese Medical Licensing Examination
Resources in similar research fields
IgakuQAjungokasai52Evaluating GPT-4 and ChatGPT on Japanese Medical Licensing ExaminationsShared: Large language models・Evaluation & benchmarks
jp-tl-benchshisa-ai6Anchored Pairwise LLM Evaluation for Bidirectional Japanese-English TranslationShared: Large language models・Evaluation & benchmarks
pitchbenchshewiiii2Experimental Japanese pitch accent based LLM BenchmarkShared: Large language models・Evaluation & benchmarks- jhumanevalkogi-jwu731JHumanEval is a hand‑translated Japanese version of the HumanEval benchmark, providing 164 Python programming problems with parallel English and Japanese comments to evaluate Japanese‑LLM code generation while preserving the original English errors.HF datasetShared: Large language models・Evaluation & benchmarks
- EDINET-BenchSakanaAI662EDINET‑Bench is a Japanese financial benchmark that evaluates LLMs on tasks such as accounting fraud detection, earnings forecasting, and industry prediction using ten years of EDINET‑API disclosed reports, with construction and evaluation code provided and the dataset relicensed to PDL 1.0.HF datasetShared: Large language models・Evaluation & benchmarks
jmed-llmsociocom59JMED-LLM: Japanese Medical Evaluation Dataset for Large Language ModelsShared: Large language models・Evaluation & benchmarks