
A Japanese DistilBERT pretrained model, which was trained on Wikipedia.
Description in other languages
Statistics
Statistics as of Nov 17, 2026
GitHub stars
161
±0 (Oct 13〜)
Last commit
Apr 2020
Created on GitHub
Apr 22, 2020
Listed
Aug 13, 2022
Stars over time
Show as a table
| Month | Stars |
|---|---|
| Dec 2025 | 161 |
| Jan 2026 | 161 |
| Feb 2026 | 161 |
| Mar 2026 | 161 |
| Apr 2026 | 161 |
| May 2026 | 161 |
| Jun 2026 | 161 |
| Jul 2026 | 161 |
| Aug 2026 | 161 |
| Sep 2026 | 161 |
| Oct 2026 | 161 |
| Nov 2026 | 161 |
Last snapshot of each month. Star counts of 1,000 or more are rounded to the nearest 100.
Popular in the same category
lukestudio-ousia727LUKE -- Language Understanding with Knowledge-based Embeddings
bert-japanesecl-tohoku551BERT models for Japanese language text.
bert-japaneseyoheikikuta497BERT with SentencePiece for Japanese text.
gpt2-japanesetanreinama322Japanese GPT2 Generation Model
japanese-dialog-transformersnttcslab247Code for evaluating Japanese pretrained models provided by NTT Ltd.
Japanese-Alpaca-LoRAkunishou141Link to the Low-Rank Adapter created by fine-tuning LLaMA using the Stanford Alpaca dataset translated into Japanese, and sample code for generating it.
Resources in similar research fields
shibaoctanove89Pytorch implementation and pre-trained Japanese model for CANINE, the efficient character-level transformer.Shared: Responsible & Trustworthy NLP・Representation Learning- line-distilbert-base-japaneseline-corporation14kLINE DistilBERT Japanese is a 66‑million‑parameter DistilBERT model pre‑trained on 131 GB of Japanese web text using an in‑house BERT‑base teacher, evaluated on JGLUE, tokenized with MeCab Unidic and SentencePiece, and released under the Apache 2.0 license.HF modelShared: Representation Learning・Language Models
LINE-DistilBERT-Japaneseline47DistilBERT model pre-trained on 131 GB of Japanese web text. The teacher model is BERT-base that built in-house at LINE.Shared: Representation Learning・Language Models- bert-large-japanese-v2tohoku-nlp66kJapanese‑BERT‑Large trained on CC‑100 and Wikipedia, using Unidic‑lite word‑level tokenization with WordPiece subwords and whole‑word masking (24 layers, 1024‑dim hidden, 16 heads, 32k vocab), with pretraining code on cl‑tohoku/bert‑japanese.HF modelShared: Representation Learning・Language Models
- bert-base-japanese-v3tohoku-nlp66kJapanese BERT‑base (12 layers, 768‑dim hidden, 12 heads, 32 k vocab) pretrained with whole‑word masking on CC‑100 and 2023‑Jan Wikipedia, using Unidic 2.1.2 word‑level tokenization plus WordPiece, in 2 M training steps.HF modelShared: Representation Learning・Language Models
Laboro-BERT-Japaneselaboroai73Laboro BERT Japanese: Japanese BERT Pre-Trained With Web-CorpusShared: Representation Learning・Language Models