Japanese Wikipedia sentences are transformed into various embeddings and a FAISS index, offering a Hugging Face Space demo, conversion scripts, and evaluations of search, Q&A, and OpenAI text‑embedding‑3‑small for RAG; embeddings are OpenAI‑licensed, others CC‑BY‑SA‑4.0.
Description in other languages
Statistics
Statistics as of Nov 16, 2026
Hugging Face downloads (last 30 days)
731
Hugging Face likes
3
Listed
Oct 29, 2024
Downloads (30-day window) over time
Show as a table
| Month | DL (30d) |
|---|---|
| Dec 2025 | 2,000 |
| Jan 2026 | 3,000 |
| Feb 2026 | 243 |
| Mar 2026 | 250 |
| Apr 2026 | 472 |
| May 2026 | 417 |
| Jun 2026 | 473 |
| Jul 2026 | 297 |
| Aug 2026 | 508 |
| Sep 2026 | 1,000 |
| Oct 2026 | 901 |
| Nov 2026 | 731 |
Downloads over the 30 days before the last snapshot of each month.
Popular in the same category
- JMTEBsbintuitions3kJMTEB is a Japanese text‑embedding benchmark featuring 5 tasks (clustering, classification, STS, retrieval, reranking) and 28 datasets, offering a one‑line evaluation script and inviting community contributions.
- JQaRAhotchpotch436A Japanese QA dataset for evaluating Retrieval‑Augmented Generation (RAG), built from JAQKET questions and Wikipedia passages with gold retrieval‑relevance labels, released on HuggingFace and GitHub and scored primarily by nDCG@10.
- msmarco-ja-hard-negativeshotchpotch408Japanese hard‑negative mining and evaluation on the MSMARCO‑JA dataset, detailing normalization, filtering, BAAI/BGE reranker selection, random sampling, SPLADE‑based ranking, and chi‑square analysis showing statistically significant higher positive rates than the original mMARCO(ja).
- RAG-Evaluation-Dataset-JAallganize246Provides a Japanese RAG benchmark across five industry domains—finance, telecom, manufacturing, public, retail—by publishing datasets, an automatic evaluation framework, and comparative results for models such as Claude 3.5‑Sonnet, GPT‑4o, and others.
- Japanese-RAG-Generator-Benchmarkneoai-inc113Japanese RAG Generator Benchmark (J‑RAGBench) supplies a multi‑category QA dataset—covering Integration, Reasoning, Logical, Table, and Abstention—designed to evaluate Japanese RAG generators, built with human effort and GPT‑4.1, and released under CC BY‑SA 4.0.
- emilia-yodasTTS-AGI18kDataset of dialogues and lore from the Fate/Stay Night character “Emilia”, formatted for training and evaluating conversational language models.
Resources in similar research fields
ja.text8Hironsan113Japanese text8 corpus for word embedding.GitHubShared: Representation Learning・Semantic Text Processing- plamo-embedding-1bpfnet486kPLaMo‑Embedding‑1B is a Japanese text‑embedding model from Preferred Networks that converts Japanese text into vectors for information retrieval, classification, and clustering, shows strong performance on the JMTEB benchmark, and is freely available under an Apache v2.0 license.HF modelShared: Representation Learning・Semantic Text Processing
- ruri-v3-70mcl-nagoya14kRuri v3 delivers high‑performance Japanese text embeddings up to 8192 tokens, a 100k‑token vocabulary, FlashAttention support, and multiple model sizes (30 m–310 m) for efficient inference and fine‑tuning via sentence‑transformers.HF modelShared: Representation Learning・Semantic Text Processing
- japanese-splade-v2hotchpotch4kHigh‑performance Japanese SPLADE v2 enables sparse‑vector conversion and inference through a WebUI demo, trains with YAST, offers YASEM embedding, and reports JMTEB benchmark results.HF modelShared: Representation Learning・Semantic Text Processing
- ruri-v3-310mcl-nagoya634kRuri v3 is a state‑of‑the‑art Japanese text‑embedding model built on ModernBERT‑Ja, supporting up to 8,192‑token inputs, a 100K‑token vocabulary, FlashAttention‑accelerated inference, and multiple size variants for fast sentence‑transformer usage.HF modelShared: Representation Learning・Semantic Text Processing
- ruri-v3-30mcl-nagoya126kRuri v3 is a state‑of‑the‑art Japanese text embedding model built on ModernBERT‑Ja, supporting up to 8,192 tokens, a 100 k‑token vocabulary, FlashAttention acceleration, and multiple sizes from 37 M to 315 M parameters.HF modelShared: Representation Learning・Semantic Text Processing