
A lightweight library for evaluating vision language models on English and Japanese benchmarks.
Description in other languages
Statistics
Statistics as of Nov 17, 2026
GitHub stars
6
+1 (Oct 13〜)
Last commit
Nov 2026
Created on GitHub
Mar 28, 2026
Listed
Jun 16, 2026
Stars over time
Show as a table
| Month | Stars |
|---|---|
| Dec 2025 | — |
| Jan 2026 | — |
| Feb 2026 | — |
| Mar 2026 | — |
| Apr 2026 | — |
| May 2026 | — |
| Jun 2026 | 5 |
| Jul 2026 | 5 |
| Aug 2026 | 5 |
| Sep 2026 | 5 |
| Oct 2026 | 5 |
| Nov 2026 | 6 |
Last snapshot of each month. Star counts of 1,000 or more are rounded to the nearest 100.
Popular in the same category
JaSPICEYuigaWada9JaSPICE: Automatic Evaluation Metric Using Predicate-Argument Structures for Image Captioning Models
heron-vlm-leaderboardwandb6This project is a benchmarking tool for evaluating and comparing the performance of various Vision Language Models (VLMs). It uses two datasets: LLaVA-Bench-In-the-Wild and Japanese HERON Bench to measure model performance.
eval_vertical_jallm-jp3Evaluating Multimodal Large Language Models on Vertically Written Japanese Text
jp-ocr-evaluationyoshino1Evaluate the performance of OCR on Japanese text images.
manga-ocrkha-white2.8kAbout Optical character recognition for Japanese text, with the main focus being Japanese manga
mokurokha-white1.8kRead Japanese manga inside browser with selectable text.
Resources in similar research fields
- JMMMUJMMMU3kJMMMU is a Japanese multimodal benchmark expanded over tenfold to 1,320 culturally diverse questions (720 culture‑agnostic, 600 culture‑specific) translated by native subject experts, now featuring a public leaderboard.HF datasetShared: Evaluation & benchmarks・Vision & multimodal
- KokushiMD-10humanalysis-square327KokushiMD‑10 is a multilingual benchmark for ten Japanese healthcare professions, offering text‑only and image‑based single‑choice, multiple‑choice, calculation, and fill‑in‑the‑blank questions with chain‑of‑thought explanations, available in separate Japanese, English, or mixed splits.HF datasetShared: Evaluation & benchmarks・Vision & multimodal
- Japanese-Heron-Benchturing-motors316Japanese‑Heron‑Bench is a Japanese VLM benchmark comprising 21 images from seven subcategories, each paired with 3‑category questions (Conversation, Detail, Complex) for a total of 102 queries under CC BY licenses.HF datasetShared: Evaluation & benchmarks・Vision & multimodal
cameraCyberAgentAILab26CAMERA (CyberAgent Multimodal Evaluation for Ad Text GeneRAtion) is the Japanese ad text generation dataset.Shared: Evaluation & benchmarks・Vision & multimodal
transformershuggingface167k🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.MultilingualShared: Vision & multimodal
huggingface-datasets_CAMERAcreative-graphic-design3CAMERA (CyberAgent Multimodal Evaluation for Ad Text GeneRAtion) for huggingface datasetsShared: Evaluation & benchmarks・Vision & multimodal