JaCWIR is a Japanese casual Web IR dataset with 5,000 ChatGPT‑generated queries linked to 500k web‑page titles and descriptions from Hatena Bookmark, released on HuggingFace for non‑commercial evaluation of information‑retrieval tasks using MAP@10 or full‑scale BM25 ranking.
Description in other languages
Statistics
Statistics as of Nov 16, 2026
Hugging Face downloads (last 30 days)
167
Hugging Face likes
6
Listed
May 13, 2024
Downloads (30-day window) over time
Show as a table
| Month | DL (30d) |
|---|---|
| Dec 2025 | 102 |
| Jan 2026 | — |
| Feb 2026 | — |
| Mar 2026 | — |
| Apr 2026 | — |
| May 2026 | 125 |
| Jun 2026 | — |
| Jul 2026 | — |
| Aug 2026 | — |
| Sep 2026 | 143 |
| Oct 2026 | 157 |
| Nov 2026 | 167 |
Downloads over the 30 days before the last snapshot of each month.
Popular in the same category
- JMedBenchColdog23331kJMedBench is a Japanese biomedical LLM benchmark comprising 20 datasets across five tasks (MCQA, NER, STS, etc.) sourced from MedMCQA, PubMedQA, MMLU, and others, each with its own license, and includes a note that translations may contain biases requiring human review.
- vntl-leaderboardlmg-anon857A leaderboard that ranks large language models by their semantic accuracy in translating Japanese visual novels into English, using cosine similarity over 256 samples and reporting chrF scores for comparison with tools like Sugoi Translator, Google Translate, Naver Papago, and Alibaba Translate.
- jhumanevalkogi-jwu731JHumanEval is a hand‑translated Japanese version of the HumanEval benchmark, providing 164 Python programming problems with parallel English and Japanese comments to evaluate Japanese‑LLM code generation while preserving the original English errors.
- llm-jp-evalllm-book666Dataset card for the ja‑vicuna‑qa‑benchmark used in the book “Introduction to Large‑Scale LLM II” and created by llm‑jp‑eval for cross‑dataset Japanese LLM evaluation (Apache 2.0).
- EDINET-BenchSakanaAI662EDINET‑Bench is a Japanese financial benchmark that evaluates LLMs on tasks such as accounting fraud detection, earnings forecasting, and industry prediction using ten years of EDINET‑API disclosed reports, with construction and evaluation code provided and the dataset relicensed to PDL 1.0.
- JDocQA-Reasoningricoh-ai269A Japanese benchmark, JDocQA Reasoning Bench, released by Ricoh for the GENIAC project, evaluates LMMs on 1,286 reasoning questions over complex charts, tables, and diagrams using automated LLM-as‑Judge scoring.
Resources in similar research fields
jmed-llmsociocom59JMED-LLM: Japanese Medical Evaluation Dataset for Large Language ModelsGitHubShared: Large language models・Corpora & datasets
japanese-llm-benchmarkshi3z53A benchmark tool for evaluating Japanese language capabilities of various LLMs.GitHubShared: Large language models・Corpora & datasets
Japanese-RP-BenchAratako25Japanese-RP-Bench is a benchmark for measuring LLM's Japanese role-playing ability.GitHubShared: Large language models・Corpora & datasets
do-not-answer-jakunishou24A safety evaluation dataset "Do-Not-Answer" released by the University of Melbourne in August 2023 has been automatically translated into Japanese for use in the evaluation of Japanese LLM, and further modified to take into account Japanese culture.GitHubShared: Large language models・Corpora & datasets- injecagent-jamasahiroid212A Japanese translation of the InjecAgent benchmark (v0.1.1) that preserves original English tool schemas and attack instructions while adding translated agent thoughts, user guidance, and enhanced hacking prefixes for measuring LLM robustness under an MIT license.Shared: Large language models・Corpora & datasets
jmle2026-benchnaoto-iwase11LLM benchmark on the 120th Japanese Medical Licensing Examination (Feb 7-8, 2026)GitHubShared: Large language models・Corpora & datasets