
pfmt-bench-fin-ja: Preferred Multi-turn Benchmark for Finance in Japanese
Description in other languages
Statistics
Statistics as of Nov 17, 2026
GitHub stars
9
±0 (Oct 13〜)
Last commit
Mar 2025
Created on GitHub
Jun 24, 2024
Listed
Jan 6, 2026
Stars over time
Show as a table
| Month | Stars |
|---|---|
| Dec 2025 | — |
| Jan 2026 | 9 |
| Feb 2026 | 9 |
| Mar 2026 | 9 |
| Apr 2026 | 9 |
| May 2026 | 9 |
| Jun 2026 | 9 |
| Jul 2026 | 9 |
| Aug 2026 | 9 |
| Sep 2026 | 9 |
| Oct 2026 | 9 |
| Nov 2026 | 9 |
Last snapshot of each month. Star counts of 1,000 or more are rounded to the nearest 100.
Popular in the same category
JGLUEyahoojapan349JGLUE: Japanese General Language Understanding Evaluation
JapaneseEmbeddingEvaloshizo184Japanese Embedding Evaluation
llm-jp-evalllm-jp175This tool is designed to automatically evaluate large-scale Japanese language models across multiple datasets.
jp-stabletree155JP Language Model Evaluation Harness
jmtebsbintuitions96The evaluation scripts of JMTEB (Japanese Massive Text Embedding Benchmark)
llm-leaderboardwandb95Project of llm evaluation to Japanese tasks
Resources in similar research fields
llm-jp-judgellm-jp64Python tool for generating automatic evaluationsShared: Evaluation & benchmarks
jtransbenchwebbigdata-jp13A tool to easily benchmark Japanese translation skillsShared: Evaluation & benchmarks
lm-evaluation-harnessEleutherAI14kA framework for few-shot evaluation of language models.MultilingualShared: Evaluation & benchmarks- ELYZA-tasks-100elyza2kA 100‑sample Japanese instruction‑tuning evaluation dataset of annotated tasks—ranging from summarization correction and math reasoning to translation, creative generation, and user‑intent understanding—designed for manual or automatic 5‑point rating of fine‑tuned models.HF datasetShared: Evaluation & benchmarks
- JMMLUnlp-waseda1kJMMLU is a Japanese Massive Multitask Language Understanding Benchmark featuring 7,536 teacher‑crafted questions across 56 subjects, including professional medicine, psychology, accounting, philosophy, and diverse high‑school disciplines.HF datasetShared: Evaluation & benchmarks
sacrebleumjpost1.3kReference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons.MultilingualShared: Evaluation & benchmarks