
J-tau: A Japanese tau-bench for Benchmarking Tool-Agent-User Interaction in Real-World Domains
Description in other languages
Statistics
Statistics as of Nov 17, 2026
GitHub stars
18
+3 (Oct 13〜)
Last commit
Oct 2026
Created on GitHub
Apr 22, 2026
Listed
Aug 18, 2026
Stars over time
Show as a table
| Month | Stars |
|---|---|
| Dec 2025 | — |
| Jan 2026 | — |
| Feb 2026 | — |
| Mar 2026 | — |
| Apr 2026 | — |
| May 2026 | — |
| Jun 2026 | — |
| Jul 2026 | — |
| Aug 2026 | 12 |
| Sep 2026 | 15 |
| Oct 2026 | 15 |
| Nov 2026 | 18 |
Last snapshot of each month. Star counts of 1,000 or more are rounded to the nearest 100.
Popular in the same category
pfgen-benchpfnet-research110Preferred Generation Benchmark
small_parallel_enjaodashi9750k English-Japanese Parallel Corpus for Machine Translation Benchmark.
jmed-llmsociocom59JMED-LLM: Japanese Medical Evaluation Dataset for Large Language Models
japanese-llm-benchmarkshi3z53A benchmark tool for evaluating Japanese language capabilities of various LLMs.
JMMLUnlp-waseda45Japanese Massive Multitask Language Understanding Benchmark
japanese-toxic-datasetinspection-ai43"Proposal and Evaluation of Japanese Toxicity Schema" provides a schema and dataset for toxicity in the Japanese language.
Resources in similar research fields
lm-evaluation-harnessEleutherAI14kA framework for few-shot evaluation of language models.MultilingualShared: Corpora & datasets・Evaluation & benchmarks- ELYZA-tasks-100elyza2kA 100‑sample Japanese instruction‑tuning evaluation dataset of annotated tasks—ranging from summarization correction and math reasoning to translation, creative generation, and user‑intent understanding—designed for manual or automatic 5‑point rating of fine‑tuned models.HF datasetShared: Corpora & datasets・Evaluation & benchmarks
sacrebleumjpost1.3kReference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons.MultilingualShared: Corpora & datasets・Evaluation & benchmarks
xtremegoogle-research650XTREME is a benchmark for the evaluation of the cross-lingual generalization ability of pre-trained multilingual models that covers 40 typologically diverse languages and includes nine tasks.MultilingualShared: Corpora & datasets・Evaluation & benchmarks
pawsgoogle-research-datasets572This dataset contains 108,463 human-labeled and 656k noisily labeled pairs that feature the importance of modeling structure, context, and word order information for the problem of paraphrase identification.MultilingualShared: Corpora & datasets・Evaluation & benchmarks
massivealexa572Tools and Modeling Code for the MASSIVE dataset.MultilingualShared: Corpora & datasets・Evaluation & benchmarks