
This project is a benchmarking tool for evaluating and comparing the performance of various Vision Language Models (VLMs). It uses two datasets: LLaVA-Bench-In-the-Wild and Japanese HERON Bench to measure model performance.
Description in other languages
Statistics
Statistics as of Nov 17, 2026
GitHub stars
6
±0 (Oct 13〜)
Last commit
Dec 2024
Created on GitHub
Jun 12, 2024
Listed
Oct 13, 2024
Stars over time
Show as a table
| Month | Stars |
|---|---|
| Dec 2025 | 6 |
| Jan 2026 | 6 |
| Feb 2026 | 6 |
| Mar 2026 | 6 |
| Apr 2026 | 6 |
| May 2026 | 6 |
| Jun 2026 | 6 |
| Jul 2026 | 6 |
| Aug 2026 | 6 |
| Sep 2026 | 6 |
| Oct 2026 | 6 |
| Nov 2026 | 6 |
Last snapshot of each month. Star counts of 1,000 or more are rounded to the nearest 100.
Popular in the same category
JaSPICEYuigaWada9JaSPICE: Automatic Evaluation Metric Using Predicate-Argument Structures for Image Captioning Models
simple-evals-mmllm-jp6A lightweight library for evaluating vision language models on English and Japanese benchmarks.
eval_vertical_jallm-jp3Evaluating Multimodal Large Language Models on Vertically Written Japanese Text
jp-ocr-evaluationyoshino1Evaluate the performance of OCR on Japanese text images.
manga-ocrkha-white2.8kAbout Optical character recognition for Japanese text, with the main focus being Japanese manga
mokurokha-white1.8kRead Japanese manga inside browser with selectable text.
Resources in similar research fields
swallow-evaluation-instructswallow-llm34Swallow Project Post-learning Large-scale Language Model Evaluation FrameworkShared: Language Models- japanese-reranker-cross-encoder-small-v1hotchpotch156kJapanese‑trained CrossEncoder rerankers ranging from xsmall (384) to large (1024) plus a BGE‑v2‑m3‑v1 model, with example code for fine‑tuning, inference, and benchmark scores on JQaRA, JaCWIR, MIRACL, and JSQuAD.HF modelShared: Language Models
- japanese-reranker-cross-encoder-xsmall-v1hotchpotch16kJapanese CrossEncoder reranker models ranging from xsmall to large (plus BGE), evaluated on JQaRA, JaCWIR, MIRACL, and JSQuAD, with ready‑to‑use integration examples for sentence_transformers and HuggingFace.HF modelShared: Language Models
- Llama-3.1-Swallow-8B-Instruct-v0.3tokyotech-llm5kLlama 3.1 Swallow is a Japanese‑enhanced series of 8B/70B Llama 3.1 models, trained via continual pre‑training and Japanese‑specific instruction fine‑tuning, with the latest 8B‑Instruct‑v0.3 setting state‑of‑the‑art results on Japanese MT‑Bench.HF modelShared: Language Models
- Llama-3-ELYZA-JP-8Belyza4kLlama‑3‑ELYZA‑JP‑8B is a Japanese‑enhanced, 8‑billion‑parameter Llama 3 model by ELYZA, fine‑tuned for Japanese on Meta‑Llama‑3‑8B‑Instruct.HF modelShared: Language Models
pretrained_doc2vec_jayagays25pretrained doc2vec models on Japanese WikipediaShared: Language Models