GitHub

taishi-i / toiro

A comparison tool of Japanese tokenizers

Description in other languages

Statistics

Statistics as of Nov 17, 2026

GitHub stars
122
±0 (Oct 13〜)
Package downloads per week
28
Total package downloads
29,000
Last commit
Nov 2025
Created on GitHub
Aug 13, 2020
Listed
—
Listed since the page was created

Stars over time

115120125130NovSepJulMayMarJan 2026122
Show as a table
MonthStars
Dec 2025120
Jan 2026120
Feb 2026121
Mar 2026121
Apr 2026121
May 2026123
Jun 2026122
Jul 2026122
Aug 2026122
Sep 2026122
Oct 2026122
Nov 2026122

Last snapshot of each month. Star counts of 1,000 or more are rounded to the nearest 100.

Use on PyPI

PyPI packages: toiro · Monthly figures to Oct 2026 (ClickPy)

Downloads, last 12 months
4,590
Share from Japan (last 12 months)
2.1%
PyPI packages that depend on it
0
0 as a required dependency

Monthly downloads on PyPI

01k2k20262025202420232022202120202019350
Show as a table
Monthdownloads (month)
Jan 2019—
Feb 2019—
Mar 2019—
Apr 2019—
May 2019—
Jun 2019—
Jul 2019—
Aug 2019—
Sep 2019—
Oct 2019—
Nov 2019—
Dec 2019—
Jan 2020—
Feb 2020—
Mar 2020—
Apr 2020—
May 2020—
Jun 2020—
Jul 2020—
Aug 20201,726
Sep 20201,152
Oct 2020630
Nov 2020906
Dec 2020504
Jan 2021547
Feb 2021531
Mar 2021583
Apr 2021364
May 2021450
Jun 2021410
Jul 2021458
Aug 2021298
Sep 2021343
Oct 2021383
Nov 2021297
Dec 2021360
Jan 2022406
Feb 2022391
Mar 2022660
Apr 2022429
May 2022281
Jun 2022353
Jul 2022249
Aug 2022346
Sep 2022358
Oct 2022364
Nov 2022384
Dec 2022203
Jan 2023148
Feb 2023349
Mar 2023330
Apr 2023266
May 2023327
Jun 2023186
Jul 2023451
Aug 2023477
Sep 2023241
Oct 2023161
Nov 2023306
Dec 2023305
Jan 2024340
Feb 2024274
Mar 2024193
Apr 2024319
May 2024174
Jun 2024207
Jul 2024307
Aug 2024255
Sep 2024414
Oct 2024591
Nov 2024412
Dec 2024352
Jan 2025469
Feb 2025323
Mar 2025493
Apr 2025549
May 2025327
Jun 2025139
Jul 2025244
Aug 2025260
Sep 2025282
Oct 2025571
Nov 2025955
Dec 2025579
Jan 2026384
Feb 2026288
Mar 2026317
Apr 2026289
May 2026447
Jun 2026365
Jul 2026172
Aug 2026281
Sep 2026163
Oct 2026350

Statistics for Japanese NLP as a whole

Popular in the same category

Resources in similar research fields

Learn from slides & articles