What to do if node utf8 Chinese characters are garbled

node The solution to garbled Chinese characters in utf8: 1. Check the type of "SarchName" through "typeof"; 2. Use the "Name=iconv.decode(name,'gbk')" method to convert the encoding to utf8. Can.

The operating environment of this tutorial: Windows10 system, node v14.16.0 version, DELL G3 computer

What to do if node utf8 Chinese characters are garbled ?

• node.js implements encoding to GBK to UTF8, Chinese garbled solution

I met a need before doing this, then It uses node to do a fuzzy query of names. In fact, this is a simple matter that cannot be simpler anymore, but I was stuck on this issue for two days.

Due to business needs, make a fuzzy query for the new function.

First, I had to set up a node http service, and then I configured mysql. After establishing the ORM model, I encountered a strange thing when I was about to start writing SQL statements, because my node was encoded in utf8. However, our company's database uses GBK encoding, which caused an error when I performed data query and the query failed. The reason was due to encoding problems.

This problem is also very simple, just transcode! ! !

When I started using Baidu node’s transcoding method, I came across the iconv-jschardet plug-in, so I went to npm to check it out. I started using

const iconv = require('iconv-jschardet');
SarchName =  iconv.encode(SarchName, 'gbk');

to convert the characters sent from the front end into GBK encoding, and I was very happy.

The result is still an error. Because of this error, I spent an afternoon looking for it. I don’t know if the conversion was successful, so I tried countless methods but still couldn’t solve the encoding problem, so I thought of using SQL to convert it to binary for fuzzy matching when querying when writing PHP.

So I typeof the SarchName and it turned out to be Obj. I was very confused and thought it should be String. So I printed the output and saw that it was a Buffer. Now I understood that it was better not to convert it directly to String. I used the Buffer.toString() method but it still didn't work, and then I looked through the documentation. I found out that there was no GBK encoding, which was a big headache.

Then I tried ascii and found that it still didn’t work, so I tried binary and it was ok.

#** The fuzzy query execution is completed without any problem. When the returned data is found, it is still GBK encoded. That's easy! ! ! ! Then convert it to utf8

Name=iconv.decode(name,'gbk')

and then return and find that there is no problem, then ok is done.

After a while, others detected a bug and said that the person’s name was not fully displayed! ! ! !

As a result, this symbol � appeared in some people’s names. . . . .

Baidu found that the decoding was incomplete and there is no solution yet. . .

In the end, I had no choice but to use the indexOf('�') method to retrieve the rare characters in the string

, then record its status and then use PHP to transcode it.

In short, one word, pit! **

Additional: Node.js's gbk to utf8 conversion will still fail to convert some rare characters and cause garbled characters. It is recommended that libraries with gbk do not let node do things like Chinese transcoding and change to something else. Language.

Recommended learning: "node.js Video Tutorial"

The above is the detailed content of What to do if node utf8 Chinese characters are garbled. For more information, please follow other related articles on the PHP Chinese website!