
Utility scripts for preprocessing Wikipedia texts for NLP
Description in other languages
Statistics
Statistics as of Nov 17, 2026
GitHub stars
78
±0 (Oct 13〜)
Last commit
Apr 2024
Created on GitHub
Jan 9, 2022
Listed
Jun 27, 2022
Stars over time
Show as a table
| Month | Stars |
|---|---|
| Dec 2025 | 78 |
| Jan 2026 | 78 |
| Feb 2026 | 78 |
| Mar 2026 | 78 |
| Apr 2026 | 78 |
| May 2026 | 78 |
| Jun 2026 | 78 |
| Jul 2026 | 78 |
| Aug 2026 | 78 |
| Sep 2026 | 78 |
| Oct 2026 | 78 |
| Nov 2026 | 78 |
Last snapshot of each month. Star counts of 1,000 or more are rounded to the nearest 100.
Popular in the same category
kanji-datadavidluzgouveia243A JSON kanji dataset with updated JLPT levels and WaniKani information
NMeCabkomutan106NMeCab: About Japanese morphological analyzer on .NET
emoji-jayagays83Japanese pronunciation/keywords/classification dictionary for UNICODE emojis.
japanese-toxic-datasetinspection-ai43"Proposal and Evaluation of Japanese Toxicity Schema" provides a schema and dataset for toxicity in the Japanese language.
WikipediaAnnotatedCorpusku-nlp30This is a Japanese text corpus that consists of Wikipedia articles with various linguistic annotations.
jcmsshigashiyama9A Japanese Corpus of Many Specialized Domains (JCMS)
Resources in similar research fields
alkana.pyzomysan35A tool to get the katakana reading of an alphabetical string.Shared: Syntactic Text Processing・Text Normalization
j-unimorphcl-tohoku9Dataset of UniMorph in JapaneseShared: Syntactic Text Processing・Morphology
hirakanadicpo3rin7Allows Sudachi to normalize from hiragana to katakana from any compound word listShared: Syntactic Text Processing・Text Normalization
kuroshirohexenq1kJapanese language library for converting Japanese sentence to Hiragana, Katakana or Romaji with furigana and okurigana modes supported.Shared: Syntactic Text Processing・Text Normalization
WanaKanaWaniKani945A Javascript library that can detect and transliterate between Hiragana, Katakana, and Romaji.Shared: Syntactic Text Processing・Text Normalization
cutletpolm390Japanese to romaji converter in PythonShared: Syntactic Text Processing・Text Normalization