
Codes to pre-train Japanese T5 models
Description in other languages
Statistics
Statistics as of Nov 17, 2026
GitHub stars
39
±0 (Oct 13〜)
Last commit
Sep 2021
Created on GitHub
Aug 24, 2021
Listed
Jun 15, 2022
Stars over time
Show as a table
| Month | Stars |
|---|---|
| Dec 2025 | 40 |
| Jan 2026 | 40 |
| Feb 2026 | 40 |
| Mar 2026 | 40 |
| Apr 2026 | 40 |
| May 2026 | 40 |
| Jun 2026 | 40 |
| Jul 2026 | 40 |
| Aug 2026 | 40 |
| Sep 2026 | 40 |
| Oct 2026 | 39 |
| Nov 2026 | 39 |
Last snapshot of each month. Star counts of 1,000 or more are rounded to the nearest 100.
Popular in the same category
gpt2-japanesetanreinama322Japanese GPT2 Generation Model
text2text-japanesetanreinama34gpt-2 based text2text conversion model
albert-japanese-tinysegmenternknytk13Pretrained models, codes and guidances to pretrain official ALBERT(https://github.com/google-research/albert) on Japanese Wikipedia Resources
gpt-jacolorfulscoop3GPT-2 Japanese model for HuggingFace's transformers
lukestudio-ousia727LUKE -- Language Understanding with Knowledge-based Embeddings
bert-japanesecl-tohoku551BERT models for Japanese language text.
Resources in similar research fields
- t5-base-japanese-v1.1sonoisa17kA Japanese T5‑v1.1 model pretrained on ≈100 GB of Wikipedia and OSCAR CC‑100 data (mixed 10:1 for SentencePiece with byte‑fallback), requiring fine‑tuning for downstream tasks, includes transfer‑learning sample code, notes potential bias in outputs, and is licensed CC‑BY‑SA 4.0.HF modelShared: Text Generation・Language Models
jmlm_scoringminhpqn5Masked Language Model-based Scoring for Japanese and VietnameseShared: Text Generation・Language Models- deberta-v3-base-japaneseku-nlp13kJapanese DeBERTa V3 base pre‑trained on 540 B tokens from LLM‑jp v1.0, trained with a modified DeBERTa V3 setup, uses a unigram byte‑fallback tokenizer (no morphological analyzer), and is fine‑tuned for JGLUE NLU tasks.HF modelShared: Language Models・Semantic Text Processing
t5_japanese_dialogue_generationJinyamyzk3Conversation generation using T5.Shared: Text Generation・Language Models- gpt-neox-japanese-2.7babeja3kA 2.7‑B‑parameter Japanese GPT‑NeoX model trained on Japanese CC‑100 and OSCAR by ABEJA Inc, usable via Hugging Face Transformers pipelines or PyTorch and released under the MIT license.HF modelShared: Text Generation・Language Models
text-generationdiscus043419Easy-to-use scripts to fine-tune GPT-2-JA with your own texts, to generate sentences, and to tweet them automatically.Shared: Text Generation・Language Models