
Trilingual (English, Japanese, Chinese) QA benchmark for medical LLM
Description in other languages
Statistics
Statistics as of Nov 17, 2026
GitHub stars
6
±0 (Oct 13〜)
Last commit
Jan 2025
Created on GitHub
Dec 16, 2024
Listed
Jun 16, 2026
Stars over time
Show as a table
| Month | Stars |
|---|---|
| Dec 2025 | — |
| Jan 2026 | — |
| Feb 2026 | — |
| Mar 2026 | — |
| Apr 2026 | — |
| May 2026 | — |
| Jun 2026 | 6 |
| Jul 2026 | 6 |
| Aug 2026 | 6 |
| Sep 2026 | 6 |
| Oct 2026 | 6 |
| Nov 2026 | 6 |
Last snapshot of each month. Star counts of 1,000 or more are rounded to the nearest 100.
Popular in the same category
jmed-llmsociocom59JMED-LLM: Japanese Medical Evaluation Dataset for Large Language Models
japanese-llm-benchmarkshi3z53A benchmark tool for evaluating Japanese language capabilities of various LLMs.
EDINET-BenchSakanaAI37[ICLR 2026] Evaluating the performance of LLMs on Japanese challenging financial tasks.
jemhopqaaiishii30JEMHopQA (Japanese Explainable Multi-hop Question Answering) is a Japanese multi-hop QA dataset that can evaluate internal reasoning.
Japanese-RP-BenchAratako25Japanese-RP-Bench is a benchmark for measuring LLM's Japanese role-playing ability.
do-not-answer-jakunishou24A safety evaluation dataset "Do-Not-Answer" released by the University of Melbourne in August 2023 has been automatically translated into Japanese for use in the evaluation of Japanese LLM, and further modified to take into account Japanese culture.
Resources in similar research fields
- JDocQA-Reasoningricoh-ai269A Japanese benchmark, JDocQA Reasoning Bench, released by Ricoh for the GENIAC project, evaluates LMMs on 1,286 reasoning questions over complex charts, tables, and diagrams using automated LLM-as‑Judge scoring.HF datasetShared: Annotation and Dataset Development
- JGLUEshunk0313kUpdated JGLUE dataset card and loading script for a Japanese NLP benchmark (created by Yahoo Japan and Waseda University) that covers text classification (MARC‑ja, JCoLA), sentence‑pair classification (JNLI), and QA (JSQuAD, JCommonsenseQA), with releases linked on GitHub and Hugging Face.HF datasetShared: Annotation and Dataset Development
- JamC-QAsbintuitions2kJamC‑QA is a bilingual benchmark of multiple‑choice questions spanning eight Japanese‑culture and knowledge categories, with leaderboard metrics comparing state‑of‑the‑art models.HF datasetShared: Annotation and Dataset Development
- auto-wiki-qacl-nagoya747AutoWikiQA is the largest free Japanese QA dataset, providing over 2.3 million handcrafted‑filtered question–answer pairs automatically generated from Wikipedia with Swallow‑MX and LLMs (without rule‑based templates) to support knowledge‑teaching and retrieval‑augmented generation applications.HF datasetShared: Annotation and Dataset Development
- nri-fin-reasoningnri-ai707Japanese instruction dataset with 632,636 multi‑turn samples (~6.35 B tokens) and GPT‑OSS‑120b reasoning traces for open‑ended, math, writing, and MCQA tasks across 135 finance topics plus 20 general ones, designed to fine‑tune LLM reasoning in finance.HF datasetShared: Annotation and Dataset Development
jmle2026-benchnaoto-iwase11LLM benchmark on the 120th Japanese Medical Licensing Examination (Feb 7-8, 2026)Shared: Annotation and Dataset Development