A Japanese‑language T5 model, pretrained on ~100 GB of Wikipedia and OSCAR data with SentencePiece tokenization, surpasses Google’s multilingual T5 on a news‑classification benchmark but needs fine‑tuning and may yield biased outputs.
Description in other languages
Statistics
Statistics as of Nov 16, 2026
Hugging Face downloads (last 30 days)
1,000
Hugging Face likes
57
Listed
—
Listed since the page was created
Downloads (30-day window) over time
Show as a table
| Month | DL (30d) |
|---|---|
| Dec 2025 | 3,000 |
| Jan 2026 | 2,000 |
| Feb 2026 | 2,000 |
| Mar 2026 | 2,000 |
| Apr 2026 | 3,000 |
| May 2026 | 5,000 |
| Jun 2026 | 81,000 |
| Jul 2026 | 204,000 |
| Aug 2026 | 216,000 |
| Sep 2026 | 3,000 |
| Oct 2026 | 2,000 |
| Nov 2026 | 1,000 |
Downloads over the 30 days before the last snapshot of each month.
Popular in the same category
- sentence-bert-base-ja-mean-tokens-v2sonoisa53kA Japanese Sentence‑BERT v2, fine‑tuned on cl‑tohoku/bert‑base‑japanese‑whole‑word‑masking with MultipleNegativesRankingLoss, boosts accuracy by ~1.5–2 % over v1 and is released as sonoisa/sentence‑bert‑base‑ja‑mean‑tokens‑v2.
- clip-japanese-baseline-corporation34kLY Corporation’s clip‑japanese‑base is a Japanese CLIP model trained on ~1 B image‑text pairs, using an Eva02‑B transformer image encoder with a 12‑layer BERT text encoder, achieving R@1 0.30 on STAIR, 0.89 accuracy on Recruit and 0.58 accuracy on ImageNet‑1K, and supporting zero‑shot image classification and retrieval.
- transformers-ud-japanese-electra-base-ginza-510megagonlabs22kja_ginza_electra is a spaCy v3 Python package offering a Japanese ELECTRA model fine‑tuned on mC4 and UD_Japanese_BCCWJ r2.8 (based on megagonlabs/transformers‑ud‑japanese‑electra‑base‑discrimininator) with custom bunsetu‑phrase detection, distributed under the MIT license.
- sentence-bert-base-ja-mean-tokenssonoisa14kJapanese Sentence‑BERT (v1) model for generating sentence embeddings, with an improved v2 available and sample usage via Hugging Face Transformers and a custom SentenceBertJapanese class.
- sentence-luke-japanese-base-litesonoisa10kJapanese Sentence‑LUKE model trained on the same dataset as Sentence‑BERT, outperforming or matching it, built on studio‑ousia/luke‑japanese‑base‑lite and used via Hugging Face Transformers’ MLukeTokenizer and LukeModel.
- clip-japanese-base-v2line-corporation2kJapanese CLIP model clip‑japanese‑base‑v2, upgraded with ~2 B image‑text pairs and distillation, pairs an Eva02‑B image encoder with a 12‑layer BERT text encoder to reach higher ImageNet‑1k accuracy (0.708) than its predecessor.
Resources in similar research fields
- t5-base-japanese-v1.1sonoisa17kA Japanese T5‑v1.1 model pretrained on ≈100 GB of Wikipedia and OSCAR CC‑100 data (mixed 10:1 for SentencePiece with byte‑fallback), requiring fine‑tuning for downstream tasks, includes transfer‑learning sample code, notes potential bias in outputs, and is licensed CC‑BY‑SA 4.0.Shared: Text Generation・Language Models
gpt2-japanesetanreinama322Japanese GPT2 Generation ModelGitHubShared: Text Generation・Language Models
t5-japanesemegagonlabs39Codes to pre-train Japanese T5 modelsGitHubShared: Text Generation・Language Models- modernbert-ja-310msbintuitions36kModernBERT‑Ja‑310M is a Japanese‑language BERT variant that blends local‑global attention with RoPE, trained on 4.09 T tokens of Japanese/English text, supports a 102 400‑word vocabulary, 8 192‑token sequences, and is optimized for Flash Attention 2.Shared: Language Models・Semantic Text Processing
- deberta-v2-base-japaneseku-nlp24kJapanese DeBERTa V2 base model pretrained on 171 GB of Japanese Wikipedia, CC‑100 and OSCAR data using Juman++ segmentation and SentencePiece tokenization, trained for three weeks on eight NVIDIA A100 GPUs and ready for fine‑tuning.Shared: Language Models・Semantic Text Processing
- modernbert-ja-130msbintuitions12kA 132‑million‑parameter Japanese ModernBERT model that blends local‑global and RoPE attention, trained on 4.39 T tokens (Japanese/English) with a 102‑k‑size vocab, 8,192‑token max length, and optimized for Flash Attention 2.Shared: Language Models・Semantic Text Processing