
Examples to finetune encoder-only and encoder-decoder transformers for Japanese language (Hugging Face) Resources
Description in other languages
Statistics
Statistics as of Nov 17, 2026
GitHub stars
16
±0 (Oct 13〜)
Last commit
Oct 2023
Created on GitHub
Oct 24, 2022
Listed
Sep 10, 2024
Stars over time
Show as a table
| Month | Stars |
|---|---|
| Dec 2025 | 16 |
| Jan 2026 | 16 |
| Feb 2026 | 16 |
| Mar 2026 | 16 |
| Apr 2026 | 16 |
| May 2026 | 16 |
| Jun 2026 | 16 |
| Jul 2026 | 16 |
| Aug 2026 | 16 |
| Sep 2026 | 16 |
| Oct 2026 | 16 |
| Nov 2026 | 16 |
Last snapshot of each month. Star counts of 1,000 or more are rounded to the nearest 100.
Popular in the same category
namacochakki-works40Character Based Named Entity Recognition.
pygeonlpgeonlp-platform22pygeonlp, A python module for geotagging Japanese texts.
entitypediachakki-works13Entitypedia is an Extended Named Entity Dictionary from Wikipedia.
bert-japanese-ner-finetuningken1111This is a sample code for creating and using a model for named entity recognition task through finetuning of the BERT model.
noyakiken115Converts character span label information to tokenized text-based label information.
bert-ner-japanesejurabiinc5Program for fine-tuning Japanese named entity recognition using BERT
Resources in similar research fields
- JMedBenchColdog23331kJMedBench is a Japanese biomedical LLM benchmark comprising 20 datasets across five tasks (MCQA, NER, STS, etc.) sourced from MedMCQA, PubMedQA, MMLU, and others, each with its own license, and includes a note that translations may contain biases requiring human review.HF datasetShared: Language Models・Semantic Text Processing
- japanese-gpt-neox-smallrinna656kA 12‑layer, 768‑hidden Japanese GPT‑NeoX model trained on CC‑100, C4, and Wikipedia, compatible with Huggingface, with an optional toy prefix‑tuning weight that forces each sentence to end with a smiling‑face emoji.HF modelShared: Language Models・Semantic Text Processing
- llm-jp-3-150mllm-jp75kLLM‑jp‑3‑150m—a 150‑M‑parameter Japanese language model from the National Institute of Informatics’ LLM R&D Center—is distributed in Hugging Face Transformers format, requiring torch ≥ 2.3.0, transformers ≥ 4.40.1, accelerate ≥ 0.29.3, flash‑attn ≥ 2.5.8, and was pretrained on Japanese Wikipedia, Common Crawl, WARP/PDF, WARP/HTML, and Kaken data using a unigram byte‑fallback tokenizer.HF modelShared: Language Models・Semantic Text Processing
- sentence-bert-base-ja-mean-tokens-v2sonoisa53kA Japanese Sentence‑BERT v2, fine‑tuned on cl‑tohoku/bert‑base‑japanese‑whole‑word‑masking with MultipleNegativesRankingLoss, boosts accuracy by ~1.5–2 % over v1 and is released as sonoisa/sentence‑bert‑base‑ja‑mean‑tokens‑v2.HF modelShared: Language Models・Semantic Text Processing
- modernbert-ja-310msbintuitions36kModernBERT‑Ja‑310M is a Japanese‑language BERT variant that blends local‑global attention with RoPE, trained on 4.09 T tokens of Japanese/English text, supports a 102 400‑word vocabulary, 8 192‑token sequences, and is optimized for Flash Attention 2.HF modelShared: Language Models・Semantic Text Processing
- kotoba-whisper-v2.0kotoba-tech25kKotoba‑Whisper v2.0 is a Japanese ASR model distilled from OpenAI Whisper large‑v3, trained on 7.2 million ReazonSpeech clips, that runs 6.3× faster while matching the teacher’s CER/WER on in‑domain tests and includes stable‑ts/punctuation support and full training code on GitHub.HF modelShared: Language Models・Semantic Text Processing