
About Training and evaluation scripts for JGLUE, a Japanese language understanding benchmark
Description in other languages
Statistics
Statistics as of Nov 17, 2026
GitHub stars
18
±0 (Oct 13〜)
Last commit
Nov 2026
Created on GitHub
Mar 19, 2023
Listed
Jan 14, 2024
Stars over time
Show as a table
| Month | Stars |
|---|---|
| Dec 2025 | 18 |
| Jan 2026 | 18 |
| Feb 2026 | 18 |
| Mar 2026 | 18 |
| Apr 2026 | 18 |
| May 2026 | 18 |
| Jun 2026 | 18 |
| Jul 2026 | 18 |
| Aug 2026 | 18 |
| Sep 2026 | 18 |
| Oct 2026 | 18 |
| Nov 2026 | 18 |
Last snapshot of each month. Star counts of 1,000 or more are rounded to the nearest 100.
Popular in the same category
JGLUEyahoojapan349JGLUE: Japanese General Language Understanding Evaluation
llm-jp-evalllm-jp175This tool is designed to automatically evaluate large-scale Japanese language models across multiple datasets.
jp-stabletree155JP Language Model Evaluation Harness
japanese-lm-fin-harnesspfnet-research80Japanese Language Model Financial Evaluation Harness
japanese-llm-rankingyuzu-ai50This repository supports YuzuAI's Rakuda leaderboard of Japanese LLMs, which is a Japanese-focused analogue of LMSYS' Vicuna eval.
japanese-llm-roleplay-benchmarkoshizo42This repository was created to evaluate the performance of character role-playing in Japanese LLM.
Resources in similar research fields
- ELYZA-tasks-100elyza2kA 100‑sample Japanese instruction‑tuning evaluation dataset of annotated tasks—ranging from summarization correction and math reasoning to translation, creative generation, and user‑intent understanding—designed for manual or automatic 5‑point rating of fine‑tuned models.HF datasetShared: Annotation and Dataset Development
- qg_jaquadlmqg494Japanese JaQuAD, a subset of QG‑Bench, provides sentence‑ and paragraph‑level data with highlighted answer tokens for training Japanese question‑generation models, evaluated by BLEU4, METEOR, ROUGE‑L, BERTScore, and MoverScore.HF datasetShared: Annotation and Dataset Development
- zenz-v2.5-datasetMiwa-Keita439A 190 M‑pair JSONL dataset for Japanese kana‑to‑kanji conversion, featuring “left context – input – output” triples and pre‑trained models (medium, small, xsmall) plus the AJIMEE-Bench benchmark, released under CC BY‑SA 4.0 with subsets licensed from Wikipedia and Common Crawl.HF datasetShared: Annotation and Dataset Development
- emilia-yodasTTS-AGI18kDataset of dialogues and lore from the Fate/Stay Night character “Emilia”, formatted for training and evaluating conversational language models.HF datasetShared: Annotation and Dataset Development
- JamC-QAsbintuitions2kJamC‑QA is a bilingual benchmark of multiple‑choice questions spanning eight Japanese‑culture and knowledge categories, with leaderboard metrics comparing state‑of‑the‑art models.HF datasetShared: Annotation and Dataset Development
ajimee-benchazookey30AJIMEE-Bench (Advanced Japanese IME Evaluation Benchmark)Shared: Annotation and Dataset Development