Home  >  Article  >  Backend Development  >  How to solve the problem of garbled characters when importing csv files into PHP_PHP Tutorial

How to solve the problem of garbled characters when importing csv files into PHP_PHP Tutorial

WBOY
WBOYOriginal
2016-07-13 10:39:22708browse

If you want to write a method of importing csv files in PHP, you can implement how to import them.
But I encountered two problems when importing. One was that the test had garbled characters when writing code on Windows, and then it was solved.
The second one is that the code was garbled when submitted to the Linux system. I didn’t know the reason for the garbled code at first. At first I thought it was an error in the code svn submission. In the end, I asked a question in one of my groups. A friend of mine works in phpcms. He said that he encountered an error from Windows. When submitting to Linux, errors always occurred at first. Later, the cause was found to be garbled characters. Let’s get right to the point and see how to solve these two problems!

Problem 1 solved:

PHP reads csv files, but Chinese cannot be read on Windows. I immediately thought of a function mb_convert_encoding(); make the following settings $str = mb_convert_encoding($str, "UTF-8", "GBK" ); then that's it. Of course, you can also use iconv(); to set iconv('GBK', "UTF-8//TRANSLIT//IGNORE", $str); as follows; these two functions can solve the problem of garbled characters on Windows.

Solution to problem two:

PHP reads csv files, but Chinese cannot be read on Linux. I found a solution after searching on Baidu and Google

Just added a line of code setlocale(LC_ALL, 'zh_CN'); Yes, it will blind your eyes. It's that simple, and if you didn't know, you could spend a lot of time figuring it out.
PHP setlocale() function explanation
Definition and usage

The setlocale() function sets regional information (regional information).

Regional information is language, currency, time and other information for a geographical area. This function returns the current locale, or false on failure.
The following are commonly used region identifiers for data collection:
zh_CN GB2312
en_US.UTF-8 UTF-8
zh_TW BIG5
zh_HK BIG5-HKSCS
zh_TW.EUC-TW EUC-TW
zh_TW.UTF-8 UTF-8
zh_HK.UTF-8 UTF-8
zh_CN.GBK GBK

For example,
utf-8: setlocale(LC_ALL, ‘en_US.UTF-8′);
Simplified Chinese: setlocale(LC_ALL, ‘zh_CN’);

The reason why I tell you about the setlocale() function is because when I imported the csv file into the Linux system, garbled characters occurred. Even though I used the two functions mb_convert_encoding() and iconv(), I failed to solve the final problem. Finally, I added this sentence setlocale(LC_ALL, 'zh_CN'); in front of the code at the beginning of importing the csv file and it was easily done. Then I searched for information and found that the fgetcsv() function is sensitive to locale settings. For example, if LANG is set to en_US.UTF-8, single-byte encoded files will have read errors, so we need to set the culture. Specially shared with everyone.

I also tried the following code but couldn’t get it to work. These are the header settings for generating csv files. It might not work for me, but it might work for you. So I sorted it out and tried my best to help colleagues who encountered garbled characters when importing csv files, because it was really difficult to deal with it when there was no other way. Everyone can try it! There is always one that belongs to you.
$csvContent="csvzero,csvone,csvtwo,csvthree,csvfour,csvfive";
header("Content-Type: application/vnd.ms-excel; charset=GB2312") ;
header("Pragma: public");
header("Expires: 0"); www.jbxue.com
header("Cache-Control: must-revalidate, post-check=0, pre-check=0");
header("Content-Type: application/force-download");
header("Content-Type: application/octet-stream"); ​​
header(" Content-Type: application/download");
header("Content-Disposition: attachment;filename=CSV data.csv ");
header("Content-Transfer-Encoding: binary ");
$csvContent = iconv("utf-8","gb2312",$csvContent);
echo $csvContent;
exit;
?>

Look specifically at the code for php to import csv files:

A brief introduction to the two functions,

The character encoding detected by mb_detect_encoding(), or FALSE when the encoding of the specified string cannot be detected.

The fgetcsv() function reads in a line from the file pointer and parses the CSV fields. Similar to fgets(), except that fgetcsv() parses the read line and finds the fields in CSV format, then returns an array containing those fields. fgetcsv() returns FALSE on error, including when the end of file is encountered.

Note: As of PHP 4.3.5, the operation of fgetcsv() is binary safe.

Note: Empty lines in the CSV file will be returned as an array containing a single null field and will not be treated as an error.

Note: This function is sensitive to locale settings. For example, if LANG is set to en_US.UTF-8, single-byte encoded files will have read errors.

Note: If you encounter that PHP cannot recognize the line ending characters of Macintosh files when reading the file, you can activate the auto_detect_line_endings runtime configuration option.
setlocale(LC_ALL, 'zh_CN'); //Set regional information (regional information)
$file = $_FILES['files'];
$file_type = substr( strstr($file['name'],'.'),1);
if ($file_type != 'csv'){
echo "";
exit;
}
$handle = fopen($file['tmp_name'],"r");
$file_encoding = mb_detect_encoding($handle);
if ($file_encoding != 'ASCII'){
echo "";
exit;
} www.jbxue.com
$row = 0;
$str="";
$sy ="";
while ($data = fgetcsv($handle,1000,',')){
$row++;
if ($row == 0)
continue;
$num = count($data);
for ($i=0; $i<$num; $i++){
$str = (string)$data[$i].'|';
$str = mb_convert_encoding($str, "UTF-8", "GBK"); //The source code is known to be GBK and converted to utf-8
$sy .= $str; //What I did here It's more complicated. I use '|' to put all the contents in the csv file together with '|'. Because I'm importing product information, I need to define which data needs to be imported according to the user's needs
//The data to be imported of.
}
}
if ($sy) { $sy = rtrim($sy, '|'); }
$arr = explode('|',$sy);
$key = array_slice($arr,0,$num); //This array is the title in the csv file, which is the data of product id, title, selling point, etc.
$skey = array();
$length = array();
$co = count($arr);
$p = $co/$num; //Find the length of the data to be taken out
for($j=0;$ j<$p;$j++){
$offset=($j-1)*$num; //Offset, just like paging, the array I take out based on the offset is a product information.
if($j==0){
$length[] = array_slice($arr,0,$num);
}else{
$length[] = array_slice($arr, $num+$offset,$num);//Get out which fields and products are there
}
}
$arrtitle = array();
$arrfileds = array();
$arrtagname = DB::select('Field ID', 'Field Name')->from('Field Table')->fetch_all();
foreach ($arrtagname as $value) {
$arrfileds [$value['fileds_tags']] = $value['fileds_name'];
}
foreach ($fileds as $v)
{
$temarr= explode('-', $ v);
if (isset($temarr[0]) && !empty($temarr[0])) {
if (isset($temarr[1]) && !empty($temarr[1] )) {
if ($temarr[1] == 'wenben') {
$arrtitle[] = $arrfileds[$temarr[0]].'text';
}
} else {
if ($temarr[0] != 'pic') { //If the field is a picture, remove it
$arrtitle[] = $arrfileds[$temarr[0]];
}
}
}

}

$skey = array();
$order = array();
$order[] = 'act_tag';
$order[] = 'channel_tag';
$order[ ] = 'created_time';
$order[] = 'orderby';
$rows ='';
$f = $co/$num;//Find how many items there are
for($p=0;$p//Here is to find out the data you need according to your own needs, and find out the relevant information in the table through the product field identification required by the user. Corresponding English logo.
$skey[]= DB::select('Field ID')->from('Field Table')->where('Field Name', '=', $arrtitle[$p])- >fetch_row();
$rows .= $skey[$p]['Field ID'].'|';
}
if($rows){ $rows = rtrim($rows ,'|'); }
if(!empty($rows)){ $exrows = explode('|',$rows); }else{ $exrows = array(); }
$skeys = array_merge($order,$exrows);
$count1 = count($skeys); //Number of fields
if(!empty($length)){
for($x=1; $x<$f;$x++){ //Find out how many times to loop based on the number of items
$orders = array();
$orders[] = $act_tag;
$orders[ ] = $channel_tag;
$orders[] = time();
$newlen = array_merge($orders,$length[$x]);
if($count1 !== count($newlen )){ //If the length of the product field is different from the length of the product, it means that the user has not entered any field
$newrs = array();
echo "";
fclose($handle);
exit();
}else{ //start
$arrimport = array_combine($skeys,$newlen); // If the two arrays are equal, I merge the arrays and change the date imported into the csv to a timestamp and store it in the database
if(!empty($arrimport['start_time'])){ $sta = strtotime($ armimport['start_time']); }else{ $sta=(int)0; }
if(!empty($arrimport['end_time'])){ $end = strtotime($arrimport['end_time'] ); }else{ $end=(int)0; }
$arrtime=array('start_time'=>$sta,'end_time'=>$end);
if(!empty($ arrival['start_time']) && !empty($arrimport['end_time'])){
$newrs=array_merge($arrimport,$arrtime);
}else{
$newrs = array( );
echo "";
fclose($handle);
exit();
}
if(count($skeys) == count($newrs)){
DB::insert('product table', array_values($skeys))
->values(array_values($newrs))
->execute();
}
} //end
}
}
if($row-1==(int)0){
echo "";
}else{
echo "