
AllenNLP integration for Shiba: Japanese CANINE model
Description in other languages
Statistics
Statistics as of Nov 17, 2026
GitHub stars
12
±0 (Oct 13〜)
Package downloads per week
26
Total package downloads
24,000
Last commit
Jun 2021
Created on GitHub
Jun 26, 2021
Listed
Jul 29, 2022
Stars over time
Show as a table
| Month | Stars |
|---|---|
| Dec 2025 | 12 |
| Jan 2026 | 12 |
| Feb 2026 | 12 |
| Mar 2026 | 12 |
| Apr 2026 | 12 |
| May 2026 | 12 |
| Jun 2026 | 12 |
| Jul 2026 | 12 |
| Aug 2026 | 12 |
| Sep 2026 | 12 |
| Oct 2026 | 12 |
| Nov 2026 | 12 |
Last snapshot of each month. Star counts of 1,000 or more are rounded to the nearest 100.
Use on PyPI
PyPI packages: allennlp-shiba · Monthly figures to Oct 2026 (ClickPy)
Downloads, last 12 months
4,725
Share from Japan (last 12 months)
0.8%
PyPI packages that depend on it
0
0 as a required dependency
Monthly downloads on PyPI
Show as a table
| Month | downloads (month) |
|---|---|
| Jan 2019 | — |
| Feb 2019 | — |
| Mar 2019 | — |
| Apr 2019 | — |
| May 2019 | — |
| Jun 2019 | — |
| Jul 2019 | — |
| Aug 2019 | — |
| Sep 2019 | — |
| Oct 2019 | — |
| Nov 2019 | — |
| Dec 2019 | — |
| Jan 2020 | — |
| Feb 2020 | — |
| Mar 2020 | — |
| Apr 2020 | — |
| May 2020 | — |
| Jun 2020 | — |
| Jul 2020 | — |
| Aug 2020 | — |
| Sep 2020 | — |
| Oct 2020 | — |
| Nov 2020 | — |
| Dec 2020 | — |
| Jan 2021 | — |
| Feb 2021 | — |
| Mar 2021 | — |
| Apr 2021 | — |
| May 2021 | — |
| Jun 2021 | 700 |
| Jul 2021 | 812 |
| Aug 2021 | 457 |
| Sep 2021 | 340 |
| Oct 2021 | 413 |
| Nov 2021 | 424 |
| Dec 2021 | 370 |
| Jan 2022 | 321 |
| Feb 2022 | 405 |
| Mar 2022 | 806 |
| Apr 2022 | 317 |
| May 2022 | 223 |
| Jun 2022 | 310 |
| Jul 2022 | 237 |
| Aug 2022 | 367 |
| Sep 2022 | 271 |
| Oct 2022 | 296 |
| Nov 2022 | 314 |
| Dec 2022 | 243 |
| Jan 2023 | 204 |
| Feb 2023 | 334 |
| Mar 2023 | 318 |
| Apr 2023 | 264 |
| May 2023 | 253 |
| Jun 2023 | 242 |
| Jul 2023 | 293 |
| Aug 2023 | 258 |
| Sep 2023 | 172 |
| Oct 2023 | 211 |
| Nov 2023 | 235 |
| Dec 2023 | 219 |
| Jan 2024 | 233 |
| Feb 2024 | 250 |
| Mar 2024 | 252 |
| Apr 2024 | 280 |
| May 2024 | 178 |
| Jun 2024 | 236 |
| Jul 2024 | 302 |
| Aug 2024 | 290 |
| Sep 2024 | 320 |
| Oct 2024 | 1,686 |
| Nov 2024 | 649 |
| Dec 2024 | 341 |
| Jan 2025 | 428 |
| Feb 2025 | 409 |
| Mar 2025 | 451 |
| Apr 2025 | 457 |
| May 2025 | 232 |
| Jun 2025 | 231 |
| Jul 2025 | 251 |
| Aug 2025 | 225 |
| Sep 2025 | 257 |
| Oct 2025 | 229 |
| Nov 2025 | 255 |
| Dec 2025 | 205 |
| Jan 2026 | 250 |
| Feb 2026 | 323 |
| Mar 2026 | 294 |
| Apr 2026 | 233 |
| May 2026 | 1,338 |
| Jun 2026 | 938 |
| Jul 2026 | 346 |
| Aug 2026 | 254 |
| Sep 2026 | 123 |
| Oct 2026 | 166 |
Popular in the same category
ginza-transformersmegagonlabs16Use custom tokenizers in spacy-transformers
compare-ja-tokenizerhitachi-nlp6How do different tokenizers perform on downstream tasks in scriptio continua languages?: A case study in Japanese - ACL SRW 2023
jptranstokenizerretarfi5Japanese Tokenizer for transformers library
JGLUEyahoojapan349JGLUE: Japanese General Language Understanding Evaluation
llm-jp-evalllm-jp175This tool is designed to automatically evaluate large-scale Japanese language models across multiple datasets.
jp-stabletree155JP Language Model Evaluation Harness
Resources in similar research fields
- bert-base-japanese-whole-word-maskingtohoku-nlp462kJapanese BERT‑base pretrained on 2019 Japanese Wikipedia with IPA‑dictionary and whole‑word masking, 12‑layer 768‑dim, 32,000‑vocab, 512‑token sequences, 1 M steps, available at cl‑tohoku/bert‑japanese under CC‑BY‑SA.HF modelShared: Representation Learning・Syntactic Text Processing
- bert-base-japanese-char-v3tohoku-nlp130kJapanese‑language BERT‑Base (12 layers, 768‑dim, 12 heads) pretrained with Unidic‑based word‑level plus character‑level tokenization and whole‑word masking on CC‑100 and 2023 Wikipedia, producing a 7,027‑token vocabulary.HF modelShared: Representation Learning・Syntactic Text Processing
- bert-base-japanese-char-v2tohoku-nlp55kA BERT‑base Japanese model (12 layers, 768‑dim hidden states, 12 heads) trained on 30 M Wikipedia sentences (~4 GB) with Unidic 2.1.2 word‑level tokenization followed by character‑level tokenization and whole‑word masking, using 512‑token sequences, 256 batches, and 1 M training steps.HF modelShared: Representation Learning・Syntactic Text Processing
- bert-base-japanese-chartohoku-nlp11kA BERT‑base Japanese model (12 layers, 768‑dim hidden, 12 heads) pretrained on ~17 M sentences from Japanese Wikipedia (2.6 GB) using MeCab IPA word‑level tokenization followed by character tokenization into a 4000‑word vocabulary, with training code at cl‑tohoku/bert‑japanese and released under CC BY‑SA 3.0.HF modelShared: Representation Learning・Syntactic Text Processing
- bert-base-japanese-v2tohoku-nlp9kJapanese BERT‑base (12 layers, 768 hidden, 12 heads) pretrained on 4 GB of Japanese Wikipedia (≈30 M sentences) with Unidic 2.1.2 word‑level tokenization, WordPiece sub‑tokenization, and whole‑word masking.HF modelShared: Representation Learning・Syntactic Text Processing
- bert-base-japanesetohoku-nlp9kA BERT base model pretrained on ~17 M Japanese Wikipedia sentences (2.6 GB) that tokenizes with the IPA dictionary and WordPiece, has 12 layers/768‑dim hidden states/12 heads, a 32 000‑token vocabulary, was trained for 1 M steps on Cloud TPUs and is released under CC‑BY‑SA 3.0.HF modelShared: Representation Learning・Syntactic Text Processing