GitHub

retarfi / jptranstokenizer

Japanese Tokenizer for transformers library

Description in other languages

Statistics

Statistics as of Nov 17, 2026

GitHub stars
5
±0 (Oct 13〜)
Package downloads per week
77
Total package downloads
32,000
Last commit
Feb 2024
Created on GitHub
Aug 24, 2022
Listed
Jun 23, 2023

Stars over time

2468NovSepJulMayMarJan 20265
Show as a table
MonthStars
Dec 20255
Jan 20265
Feb 20265
Mar 20265
Apr 20265
May 20265
Jun 20265
Jul 20265
Aug 20265
Sep 20265
Oct 20265
Nov 20265

Last snapshot of each month. Star counts of 1,000 or more are rounded to the nearest 100.

Use on PyPI

PyPI packages: jptranstokenizer · Monthly figures to Oct 2026 (ClickPy)

Downloads, last 12 months
5,992
Share from Japan (last 12 months)
1.5%
PyPI packages that depend on it
0
0 as a required dependency

Monthly downloads on PyPI

05001k1.5k2k20262025202420232022202120202019413
Show as a table
Monthdownloads (month)
Jan 2019—
Feb 2019—
Mar 2019—
Apr 2019—
May 2019—
Jun 2019—
Jul 2019—
Aug 2019—
Sep 2019—
Oct 2019—
Nov 2019—
Dec 2019—
Jan 2020—
Feb 2020—
Mar 2020—
Apr 2020—
May 2020—
Jun 2020—
Jul 2020—
Aug 2020—
Sep 2020—
Oct 2020—
Nov 2020—
Dec 2020—
Jan 2021—
Feb 2021—
Mar 2021—
Apr 2021—
May 2021—
Jun 2021—
Jul 2021—
Aug 2021—
Sep 2021—
Oct 2021—
Nov 2021—
Dec 2021—
Jan 2022—
Feb 2022—
Mar 2022—
Apr 2022—
May 2022—
Jun 2022—
Jul 2022—
Aug 2022334
Sep 2022770
Oct 2022895
Nov 2022591
Dec 2022480
Jan 2023716
Feb 2023911
Mar 20231,066
Apr 2023829
May 20231,076
Jun 2023662
Jul 2023593
Aug 2023803
Sep 2023457
Oct 2023441
Nov 2023593
Dec 2023431
Jan 2024472
Feb 2024974
Mar 2024492
Apr 2024449
May 2024470
Jun 2024341
Jul 2024602
Aug 2024526
Sep 2024715
Oct 20241,554
Nov 2024937
Dec 2024724
Jan 2025791
Feb 2025623
Mar 2025869
Apr 2025911
May 2025330
Jun 2025439
Jul 2025421
Aug 2025423
Sep 2025531
Oct 2025282
Nov 2025669
Dec 2025449
Jan 2026423
Feb 2026271
Mar 2026282
Apr 2026547
May 2026613
Jun 20261,081
Jul 2026452
Aug 2026515
Sep 2026277
Oct 2026413

Statistics for Japanese NLP as a whole

Popular in the same category

Resources in similar research fields

Learn from slides & articles