Multilingual

google / sentencepiece

Unsupervised text tokenizer for Neural Network-based text generation.

Description in other languages

Statistics

Statistics as of Nov 17, 2026

GitHub stars
12,000
±0 (Oct 13〜)
Last commit
Nov 2026
Created on GitHub
Mar 7, 2017
Listed
—
Listed since the page was created

Stars over time

11,50012,00012,500NovSepJulMayMarJan 202612,000
Show as a table
MonthStars
Dec 2025—
Jan 2026—
Feb 2026—
Mar 2026—
Apr 2026—
May 2026—
Jun 2026—
Jul 2026—
Aug 2026—
Sep 202612,000
Oct 202612,000
Nov 202612,000

Last snapshot of each month. Star counts of 1,000 or more are rounded to the nearest 100.

Use on PyPI

PyPI packages: sentencepiece · Monthly figures to Oct 2026 (ClickPy)

Downloads, last 12 months
389,251,173
Share from Japan (last 12 months)
1.4%
PyPI packages that depend on it
1,824
1,412 as a required dependency

Monthly downloads on PyPI

020M40M2026202520242023202220212020201929,786,299
Show as a table
Monthdownloads (month)
Jan 201954,237
Feb 201952,540
Mar 201966,524
Apr 201954,626
May 201970,157
Jun 201963,544
Jul 201989,424
Aug 2019126,645
Sep 2019165,084
Oct 2019204,413
Nov 2019258,676
Dec 2019335,380
Jan 2020322,894
Feb 2020403,748
Mar 2020516,140
Apr 2020945,214
May 20201,388,158
Jun 20201,262,991
Jul 20201,216,011
Aug 20201,284,371
Sep 20201,436,944
Oct 20201,720,029
Nov 20202,140,647
Dec 20201,574,918
Jan 20211,633,162
Feb 20211,696,131
Mar 20212,009,045
Apr 20212,096,489
May 20212,258,493
Jun 20212,612,420
Jul 20212,788,863
Aug 20213,180,523
Sep 20212,721,353
Oct 20212,664,970
Nov 20213,017,958
Dec 20213,302,593
Jan 20224,070,128
Feb 20224,492,176
Mar 20225,408,149
Apr 20225,505,491
May 20227,440,345
Jun 20225,973,223
Jul 20225,514,434
Aug 20225,774,297
Sep 20225,818,315
Oct 20227,627,259
Nov 20227,518,865
Dec 20227,710,800
Jan 20238,183,460
Feb 20237,831,852
Mar 202310,294,963
Apr 20239,938,795
May 202310,867,452
Jun 202310,332,791
Jul 20239,766,147
Aug 202310,583,857
Sep 202310,409,231
Oct 202310,458,138
Nov 202310,563,208
Dec 202312,248,707
Jan 202412,192,431
Feb 202413,720,533
Mar 202419,356,690
Apr 202422,292,443
May 202422,706,375
Jun 202420,147,923
Jul 202418,349,136
Aug 202423,368,283
Sep 202420,961,790
Oct 202425,373,437
Nov 202421,862,058
Dec 202424,339,370
Jan 202521,173,684
Feb 202522,356,560
Mar 202524,144,106
Apr 202527,809,389
May 202527,300,818
Jun 202523,882,691
Jul 202525,763,592
Aug 202531,268,505
Sep 202527,781,517
Oct 202532,357,929
Nov 202532,166,375
Dec 202531,710,186
Jan 202631,733,398
Feb 202627,965,186
Mar 202633,802,909
Apr 202632,711,268
May 202637,659,478
Jun 202632,304,139
Jul 202635,582,256
Aug 202636,493,855
Sep 202627,335,824
Oct 202629,786,299

Statistics for Japanese NLP as a whole

Popular in the same category

Resources in similar research fields

Learn from slides & articles