
J-MeetEval: Benchmark for Evaluating Instruction Compliance in Japanese Meeting Tasks
Description in other languages
Statistics
Statistics as of Nov 17, 2026
GitHub stars
2
+1 (Oct 13〜)
Last commit
Aug 2026
Created on GitHub
Jul 20, 2026
Listed
Oct 13, 2026
Popular in the same category
pfgen-benchpfnet-research110Preferred Generation Benchmark
small_parallel_enjaodashi9750k English-Japanese Parallel Corpus for Machine Translation Benchmark.
jmed-llmsociocom59JMED-LLM: Japanese Medical Evaluation Dataset for Large Language Models
japanese-llm-benchmarkshi3z53A benchmark tool for evaluating Japanese language capabilities of various LLMs.
JMMLUnlp-waseda45Japanese Massive Multitask Language Understanding Benchmark
japanese-toxic-datasetinspection-ai43"Proposal and Evaluation of Japanese Toxicity Schema" provides a schema and dataset for toxicity in the Japanese language.
Resources in similar research fields
lm-evaluation-harnessEleutherAI14kA framework for few-shot evaluation of language models.MultilingualShared: Corpora & datasets・Evaluation & benchmarks- ELYZA-tasks-100elyza2kA 100‑sample Japanese instruction‑tuning evaluation dataset of annotated tasks—ranging from summarization correction and math reasoning to translation, creative generation, and user‑intent understanding—designed for manual or automatic 5‑point rating of fine‑tuned models.HF datasetShared: Corpora & datasets・Evaluation & benchmarks
sacrebleumjpost1.3kReference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons.MultilingualShared: Corpora & datasets・Evaluation & benchmarks
xtremegoogle-research650XTREME is a benchmark for the evaluation of the cross-lingual generalization ability of pre-trained multilingual models that covers 40 typologically diverse languages and includes nine tasks.MultilingualShared: Corpora & datasets・Evaluation & benchmarks
pawsgoogle-research-datasets572This dataset contains 108,463 human-labeled and 656k noisily labeled pairs that feature the importance of modeling structure, context, and word order information for the problem of paraphrase identification.MultilingualShared: Corpora & datasets・Evaluation & benchmarks
massivealexa572Tools and Modeling Code for the MASSIVE dataset.MultilingualShared: Corpora & datasets・Evaluation & benchmarks