Manticore Search for Chinese

xpt · January 9, 2021, 9:43pm

Hi,

If I want to use Manticore Search for Chinese text searching, what should I do?

I did a search on the Internet trying to find an answer, and came upon the following two articles,

Which are basically the same, stressing the difficulties, but also showing that it is possible.

So the problem is, how can I make it happen on my end?

Thanks

xpt · January 9, 2021, 10:10pm

Ok. it has built-in support –

To enable CJK tokenization support the official packages contain binaries with embedded ICU library and include ICU data file.

Manticore has built-in support for indexing CJK texts

xpt · January 9, 2021, 10:23pm

Hmm…, however, I’m having problem make my mysql accept the Chinese I pasted in.
But I guess that’s a mysql problem…

xpt · January 9, 2021, 10:26pm

When I type or paste Chinese characters in mysql client, the Chinese characters are not inputed.

Reported in year 2015, and yet still not solved…

l1t · August 22, 2023, 12:11am

you may need set the client charactor sets and code page of terminal to utf8