CJK Tokenizer
This module is to provide a better and faster search experience for languages
such as Chinese, Japanese and Korean. For languages in Asia countries, Drupal's default
implementation is too simple, it will cause problems such as waste of storage and slow
down the system. It is especially prominent for sites with a large amount of content. The
reason is that the default words tokenization algorithm is designed to deal with
latin languages like English or German.