
tokenizer specified for Japanese
Description in other languages
Statistics
Statistics as of Nov 17, 2026
GitHub stars
53
Package downloads per week
500
Total package downloads
183,000
Last commit
Nov 2015
Created on GitHub
Jul 4, 2014
Listed
Sep 5, 2022
Use on PyPI
PyPI packages: tinysegmenter3 · Monthly figures to Oct 2026 (ClickPy)
Downloads, last 12 months
15,522
Share from Japan (last 12 months)
10.5%
PyPI packages that depend on it
2
1 as a required dependency
Monthly downloads on PyPI
Show as a table
| Month | downloads (month) |
|---|---|
| Jan 2019 | 651 |
| Feb 2019 | 699 |
| Mar 2019 | 483 |
| Apr 2019 | 520 |
| May 2019 | 776 |
| Jun 2019 | 421 |
| Jul 2019 | 1,570 |
| Aug 2019 | 1,381 |
| Sep 2019 | 1,072 |
| Oct 2019 | 1,513 |
| Nov 2019 | 1,010 |
| Dec 2019 | 1,030 |
| Jan 2020 | 1,771 |
| Feb 2020 | 1,611 |
| Mar 2020 | 1,660 |
| Apr 2020 | 1,813 |
| May 2020 | 1,876 |
| Jun 2020 | 2,102 |
| Jul 2020 | 2,523 |
| Aug 2020 | 2,476 |
| Sep 2020 | 2,697 |
| Oct 2020 | 2,447 |
| Nov 2020 | 1,810 |
| Dec 2020 | 1,596 |
| Jan 2021 | 2,591 |
| Feb 2021 | 2,129 |
| Mar 2021 | 2,821 |
| Apr 2021 | 2,428 |
| May 2021 | 1,814 |
| Jun 2021 | 2,393 |
| Jul 2021 | 1,969 |
| Aug 2021 | 2,498 |
| Sep 2021 | 3,229 |
| Oct 2021 | 2,881 |
| Nov 2021 | 2,429 |
| Dec 2021 | 1,769 |
| Jan 2022 | 2,519 |
| Feb 2022 | 2,818 |
| Mar 2022 | 2,972 |
| Apr 2022 | 2,676 |
| May 2022 | 2,979 |
| Jun 2022 | 2,753 |
| Jul 2022 | 2,619 |
| Aug 2022 | 2,417 |
| Sep 2022 | 2,513 |
| Oct 2022 | 2,389 |
| Nov 2022 | 2,603 |
| Dec 2022 | 2,189 |
| Jan 2023 | 2,545 |
| Feb 2023 | 3,203 |
| Mar 2023 | 4,363 |
| Apr 2023 | 3,057 |
| May 2023 | 3,597 |
| Jun 2023 | 3,149 |
| Jul 2023 | 3,008 |
| Aug 2023 | 2,515 |
| Sep 2023 | 2,427 |
| Oct 2023 | 2,927 |
| Nov 2023 | 3,217 |
| Dec 2023 | 2,436 |
| Jan 2024 | 2,948 |
| Feb 2024 | 1,378 |
| Mar 2024 | 1,152 |
| Apr 2024 | 922 |
| May 2024 | 1,017 |
| Jun 2024 | 885 |
| Jul 2024 | 1,090 |
| Aug 2024 | 814 |
| Sep 2024 | 946 |
| Oct 2024 | 1,153 |
| Nov 2024 | 843 |
| Dec 2024 | 894 |
| Jan 2025 | 1,223 |
| Feb 2025 | 1,191 |
| Mar 2025 | 1,201 |
| Apr 2025 | 1,399 |
| May 2025 | 1,640 |
| Jun 2025 | 1,229 |
| Jul 2025 | 1,415 |
| Aug 2025 | 1,212 |
| Sep 2025 | 1,402 |
| Oct 2025 | 1,448 |
| Nov 2025 | 1,449 |
| Dec 2025 | 1,534 |
| Jan 2026 | 880 |
| Feb 2026 | 891 |
| Mar 2026 | 1,477 |
| Apr 2026 | 1,235 |
| May 2026 | 1,053 |
| Jun 2026 | 1,717 |
| Jul 2026 | 1,470 |
| Aug 2026 | 1,217 |
| Sep 2026 | 1,001 |
| Oct 2026 | 1,598 |
Popular in the same category
janomemocobeta922Japanese morphological analysis engine written in pure Python
mecab-python3SamuraiT581mecab-python. you can find original version here:http://taku910.github.io/mecab/
fugashipolm538A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.
sudachi.rsWorksApplications492SudachiPy 0.6* and above are developed as Sudachi.rs.
nagisataishi-i424A Japanese tokenizer based on recurrent neural networks
mecabikegami-yukino274This repository is for building Windows 64-bit MeCab binary and improving MeCab Python binding.
Resources in similar research fields
kuromoji.jstakuyaa1kJavaScript implementation of Japanese morphological analyzerShared: Syntactic Text Processing・Text Segmentation
kagomeikawaha988Self-contained Japanese Morphological Analyzer written in pure GoShared: Syntactic Text Processing・Text Segmentation
rakutenmarakuten-nlp471Rakuten MA - morphological analyzer (word segmentor + PoS Tagger) for Chinese and Japanese written purely in JavaScript.Shared: Syntactic Text Processing・Text Segmentation
vibratodaac-tools430vibrato: Viterbi-based accelerated tokenizerShared: Syntactic Text Processing・Text Segmentation
jumanppku-nlp413Juman++ (a Morphological Analyzer Toolkit)Shared: Syntactic Text Processing・Text Segmentation
vaporettodaac-tools302Vaporetto: Very Accelerated POintwise pREdicTion based TOkenizerShared: Syntactic Text Processing・Text Segmentation