
Japanese Vicuna QA Benchmark
Description in other languages
Statistics
Statistics as of Nov 17, 2026
GitHub stars
34
+1 (Oct 13〜)
Last commit
Jun 2024
Created on GitHub
Aug 11, 2023
Listed
Dec 21, 2023
Stars over time
Show as a table
| Month | Stars |
|---|---|
| Dec 2025 | 33 |
| Jan 2026 | 33 |
| Feb 2026 | 33 |
| Mar 2026 | 33 |
| Apr 2026 | 33 |
| May 2026 | 33 |
| Jun 2026 | 33 |
| Jul 2026 | 33 |
| Aug 2026 | 33 |
| Sep 2026 | 33 |
| Oct 2026 | 33 |
| Nov 2026 | 34 |
Last snapshot of each month. Star counts of 1,000 or more are rounded to the nearest 100.
Popular in the same category
JGLUEyahoojapan349JGLUE: Japanese General Language Understanding Evaluation
llm-jp-evalllm-jp175This tool is designed to automatically evaluate large-scale Japanese language models across multiple datasets.
jp-stabletree155JP Language Model Evaluation Harness
japanese-lm-fin-harnesspfnet-research80Japanese Language Model Financial Evaluation Harness
japanese-llm-rankingyuzu-ai50This repository supports YuzuAI's Rakuda leaderboard of Japanese LLMs, which is a Japanese-focused analogue of LMSYS' Vicuna eval.
japanese-llm-roleplay-benchmarkoshizo42This repository was created to evaluate the performance of character role-playing in Japanese LLM.
Resources in similar research fields
- JEMHopQAsbintuitions297Japanese multi‑hop question‑answering dataset (JEMHopQA) that provides questions, answers and semi‑structured derivation steps linking two Wikipedia articles, with updated derivation formatting and expanded answer sets across multiple versioned releases.HF datasetShared: Natural Language Interfaces・Question Answering
- rakuda-questionsyuzuai188Rakuda supplies 40 Japanese questions—open‑ended for history, society, and government, and specific for geography—for benchmarking Japanese AI assistants, comparable to vicuna‑eval, and can be loaded with datasets.load_dataset.HF datasetShared: Natural Language Interfaces・Question Answering
- JQaRAhotchpotch436A Japanese QA dataset for evaluating Retrieval‑Augmented Generation (RAG), built from JAQKET questions and Wikipedia passages with gold retrieval‑relevance labels, released on HuggingFace and GitHub and scored primarily by nDCG@10.HF datasetShared: Natural Language Interfaces・Question Answering
- JaQuADSkelterLabsInc916JaQuAD is a 2022 Japanese QA dataset of 39,696 SQuAD‑style extractive pairs from Wikipedia, totaling 73.2 MB, that achieves 78.92 % F1 (63.38 % EM) when fine‑tuned with BERT‑Japanese.HF datasetShared: Natural Language Interfaces・Question Answering
niilc-qamynlp19NIILC QA dataShared: Natural Language Interfaces・Question Answering- JAQKETkumapo327A Japanese open‑domain QA dataset, JAQKET, provides quiz‑style questions with multiple choice answers (v1.0) and free‑text answer generation (v2.0), containing 13 061 training and 271 validation examples for v1.0 and 2 154 training and 1 164 validation examples for v2.0.HF datasetShared: Natural Language Interfaces