
Script for automatically evaluating language model responses using GPT-4.
Description in other languages
Statistics
Statistics as of Nov 17, 2026
GitHub stars
17
±0 (Oct 13〜)
Last commit
Jun 2024
Created on GitHub
Dec 18, 2023
Listed
May 9, 2024
Stars over time
Show as a table
| Month | Stars |
|---|---|
| Dec 2025 | 16 |
| Jan 2026 | 16 |
| Feb 2026 | 16 |
| Mar 2026 | 16 |
| Apr 2026 | 16 |
| May 2026 | 17 |
| Jun 2026 | 17 |
| Jul 2026 | 17 |
| Aug 2026 | 17 |
| Sep 2026 | 17 |
| Oct 2026 | 17 |
| Nov 2026 | 17 |
Last snapshot of each month. Star counts of 1,000 or more are rounded to the nearest 100.
Popular in the same category
llm-leaderboardwandb95Project of llm evaluation to Japanese tasks
japanese-llm-rankingyuzu-ai50This repository supports YuzuAI's Rakuda leaderboard of Japanese LLMs, which is a Japanese-focused analogue of LMSYS' Vicuna eval.
llm-jp-eval-mmllm-jp44This tool automatically evaluates Japanese multi-modal large language models across multiple datasets.
japanese-llm-roleplay-benchmarkoshizo42This repository was created to evaluate the performance of character role-playing in Japanese LLM.
IgakuQA119naoto-iwase10Evaluating LLMs on the 119th Japanese Medical Licensing Examination
jp-tl-benchshisa-ai6Anchored Pairwise LLM Evaluation for Bidirectional Japanese-English Translation
Resources in similar research fields
- gpt-neox-japanese-2.7babeja3kA 2.7‑B‑parameter Japanese GPT‑NeoX model trained on Japanese CC‑100 and OSCAR by ABEJA Inc, usable via Hugging Face Transformers pipelines or PyTorch and released under the MIT license.HF modelShared: Text Generation・Language Models
text-generationdiscus043419Easy-to-use scripts to fine-tune GPT-2-JA with your own texts, to generate sentences, and to tweet them automatically.Shared: Text Generation・Language Models- gpt2-large-japaneseabeja2kA large Japanese GPT‑2 model trained by ABEJA, Inc. on Japanese CC‑100, Wikipedia, and OSCAR, tokenized with sentencepiece, usable via Hugging Face transformers in PyTorch or TensorFlow under the MIT license.HF modelShared: Text Generation・Language Models
mbart-finetuningken113Code to perform finetuning of the mBART model.Shared: Text Generation・Language Models
gpt2-japanesetanreinama322Japanese GPT2 Generation ModelShared: Text Generation・Language Models
t5-japanesemegagonlabs39Codes to pre-train Japanese T5 modelsShared: Text Generation・Language Models