Issue Indexing Chinese and English in Plain Index

General Discussions - English
12

Try --dump-rows to see what you get from the database, e.g.:

snikolaev@dev:~$ indexer -c min_cjk_non_cjk.conf --all --dump-rows /tmp/dump
Manticore 5.0.2 348514c@220530 dev (columnar 1.15.4 2fef34e@220522)
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2022, Manticore Software LTD (https://manticoresearch.com)

using config file 'min_cjk_non_cjk.conf'...
indexing index 't'...
collected 1 docs, 0.0 MB
creating lookup: 0.0 Kdocs, 100.0% done
sorted 0.0 Mhits, 100.0% done
total 1 docs, 110 bytes
total 0.386 sec, 284 bytes/sec, 2.58 docs/sec
total 3 reads, 0.000 sec, 0.1 kb/call avg, 0.0 msec/call avg
total 15 writes, 0.000 sec, 0.0 kb/call avg, 0.0 msec/call avg

snikolaev@dev:~$ cat /tmp/dump
#
# === source t ts 1669742096
# Tue Nov 29 18:14:56 2022
#
# field 0: f
# sql_attr_bigint = id # attr 0
#

DROP TABLE IF EXISTS rows_t;
CREATE TABLE rows_t (
  id VARCHAR(32) NOT NULL,
  f VARCHAR(4096) NOT NULL,
  KEY(id) );

INSERT INTO rows_t VALUES ('1', 'SHANGHAI HEFU ARTIFICIAL INTELLIGENCE TECH GROUP CO LTD,上海荷福人工智能科技（集团）有限公司');