
Yet another sentence-level tokenizer for the Japanese text
Description in other languages
Statistics
Statistics as of Nov 17, 2026
GitHub stars
24
±0 (Oct 13〜)
Package downloads per week
46
Total package downloads
140,000
Last commit
Nov 2025
Created on GitHub
Oct 4, 2019
Listed
Jun 9, 2022
Stars over time
Show as a table
| Month | Stars |
|---|---|
| Dec 2025 | 24 |
| Jan 2026 | 24 |
| Feb 2026 | 24 |
| Mar 2026 | 24 |
| Apr 2026 | 24 |
| May 2026 | 24 |
| Jun 2026 | 24 |
| Jul 2026 | 24 |
| Aug 2026 | 24 |
| Sep 2026 | 24 |
| Oct 2026 | 24 |
| Nov 2026 | 24 |
Last snapshot of each month. Star counts of 1,000 or more are rounded to the nearest 100.
Use on PyPI
PyPI packages: sengiri · Monthly figures to Oct 2026 (ClickPy)
Downloads, last 12 months
5,942
Share from Japan (last 12 months)
2.1%
PyPI packages that depend on it
0
0 as a required dependency
Monthly downloads on PyPI
Show as a table
| Month | downloads (month) |
|---|---|
| Jan 2019 | — |
| Feb 2019 | — |
| Mar 2019 | — |
| Apr 2019 | — |
| May 2019 | — |
| Jun 2019 | — |
| Jul 2019 | — |
| Aug 2019 | — |
| Sep 2019 | — |
| Oct 2019 | 999 |
| Nov 2019 | 277 |
| Dec 2019 | 424 |
| Jan 2020 | 382 |
| Feb 2020 | 265 |
| Mar 2020 | 408 |
| Apr 2020 | 550 |
| May 2020 | 1,589 |
| Jun 2020 | 584 |
| Jul 2020 | 2,030 |
| Aug 2020 | 1,792 |
| Sep 2020 | 2,499 |
| Oct 2020 | 1,385 |
| Nov 2020 | 1,433 |
| Dec 2020 | 1,578 |
| Jan 2021 | 1,577 |
| Feb 2021 | 1,506 |
| Mar 2021 | 1,793 |
| Apr 2021 | 1,643 |
| May 2021 | 1,736 |
| Jun 2021 | 6,341 |
| Jul 2021 | 6,128 |
| Aug 2021 | 6,024 |
| Sep 2021 | 5,293 |
| Oct 2021 | 2,918 |
| Nov 2021 | 3,182 |
| Dec 2021 | 3,331 |
| Jan 2022 | 2,115 |
| Feb 2022 | 3,351 |
| Mar 2022 | 8,711 |
| Apr 2022 | 7,873 |
| May 2022 | 8,018 |
| Jun 2022 | 8,272 |
| Jul 2022 | 8,661 |
| Aug 2022 | 9,463 |
| Sep 2022 | 5,005 |
| Oct 2022 | 939 |
| Nov 2022 | 1,345 |
| Dec 2022 | 1,232 |
| Jan 2023 | 645 |
| Feb 2023 | 734 |
| Mar 2023 | 586 |
| Apr 2023 | 708 |
| May 2023 | 461 |
| Jun 2023 | 654 |
| Jul 2023 | 484 |
| Aug 2023 | 754 |
| Sep 2023 | 462 |
| Oct 2023 | 462 |
| Nov 2023 | 520 |
| Dec 2023 | 416 |
| Jan 2024 | 313 |
| Feb 2024 | 368 |
| Mar 2024 | 358 |
| Apr 2024 | 534 |
| May 2024 | 408 |
| Jun 2024 | 381 |
| Jul 2024 | 446 |
| Aug 2024 | 354 |
| Sep 2024 | 485 |
| Oct 2024 | 441 |
| Nov 2024 | 501 |
| Dec 2024 | 292 |
| Jan 2025 | 324 |
| Feb 2025 | 334 |
| Mar 2025 | 378 |
| Apr 2025 | 351 |
| May 2025 | 276 |
| Jun 2025 | 141 |
| Jul 2025 | 136 |
| Aug 2025 | 183 |
| Sep 2025 | 214 |
| Oct 2025 | 296 |
| Nov 2025 | 547 |
| Dec 2025 | 446 |
| Jan 2026 | 213 |
| Feb 2026 | 333 |
| Mar 2026 | 293 |
| Apr 2026 | 328 |
| May 2026 | 326 |
| Jun 2026 | 425 |
| Jul 2026 | 380 |
| Aug 2026 | 484 |
| Sep 2026 | 693 |
| Oct 2026 | 1,474 |
Popular in the same category
bunkaimegagonlabs201Sentence boundary disambiguation tool for Japanese texts (日本語文境界判定器)
fast-bunkaihotchpotch77Japanese sentence splitting(日本語文境界判定器), 40–250× faster via a Rust-accelerated Python library with near-perfect API compatibility with megagonlabs/bunkai.
japanese-sentence-breakerhppRC14Japanese Sentence Breaker
ja-senter-benchmarkhkiyomaru10Comparison of Japanese Sentence Segmentation Tools
hasamimkartawijaya6A tool to perform sentence segmentation on Japanese text
kuzukirialinear-corp6Japanese Text Segmenter for Python written in Rust
Resources in similar research fields
ja_sentence_segmenterwwwcojpjapanese sentence segmentation library for pythonShared: Syntactic Text Processing・Text Segmentation
TinySegmenterMakershogo8214874A tool for creating a custom learning model for TinySegmenter.Shared: Syntactic Text Processing・Text Segmentation
nlp-recipes-jaupura66Samples codes for natural language processing in JapaneseShared: Syntactic Text Processing・Text Segmentation
react-native-japanese-tokenizercraftzdog40Async Japanese Tokenizer Native Plugin for React Native for iOS and AndroidShared: Syntactic Text Processing・Text Segmentation
WordCloud-Japaneseaocattleya10A script that enables morphological analysis-like display of Japanese sentences in WordCloud without using Mecab (a morphological analysis engine).Shared: Syntactic Text Processing・Text Segmentation
chirptextletuananh7ChirpText is a collection of text processing tools for Python.Shared: Syntactic Text Processing・Text Segmentation