16

Educational Resources and Tutorials

Many implementation codes and samples related to books on Japanese NLP have been published.

  • japanese_text_classification (Stars: 9): Comparative implementation of various DNN text classification methods including BERT
  • nlp-recipes-ja (Stars: 66): Collection of sample code for Japanese NLP
  • Japanese_nlp_scripts (Stars: 27): Scripts for Japanese text processing in Python
japanese_text_classification
- japanese_text_classification (Stars: 9): Comparative implementation of various DNN text classification methods including BERT
9
nlp-recipes-ja
- nlp-recipes-ja (Stars: 66): Collection of sample code for Japanese NLP
66
Japanese_nlp_scripts
- Japanese_nlp_scripts (Stars: 27): Scripts for Japanese text processing in Python
27

16.2 Tutorials and Comparison Tools

  • toiro (Stars: 122): A comparison tool for Japanese tokenizers. Can benchmark the accuracy and speed of major morphological analyzers at once.
  • ja-tokenizer-benchmark (Stars: 7): Speed benchmark for Japanese tokenizers
  • compare-ja-tokenizer (Stars: 6): Investigates the impact of different tokenizers on downstream tasks (ACL SRW 2023)
  • ja-senter-benchmark (Stars: 10): Comparison of Japanese sentence splitting tools
toiro
- toiro (Stars: 122): A comparison tool for Japanese tokenizers. Can benchmark the accuracy and speed of major morphological analyzers at once.
122
ja-tokenizer-benchmark
- ja-tokenizer-benchmark (Stars: 7): Speed benchmark for Japanese tokenizers
7
compare-ja-tokenizer
- compare-ja-tokenizer (Stars: 6): Investigates the impact of different tokenizers on downstream tasks (ACL SRW 2023)
6
ja-senter-benchmark
- ja-senter-benchmark (Stars: 10): Comparison of Japanese sentence splitting tools
10

16.3 Visualization Tools

  • nlplot (Stars: 237): Visualization module for NLP results
  • WordCloud-Japanese (Stars: 10): Japanese word cloud without MeCab
  • mecab-visualizer (Stars: 2): Visualization of MeCab morphological analysis results

nlplot
- nlplot (Stars: 237): Visualization module for NLP results
237
WordCloud-Japanese
- WordCloud-Japanese (Stars: 10): Japanese word cloud without MeCab
10
mecab-visualizer
- mecab-visualizer (Stars: 2): Visualization of MeCab morphological analysis results
2