Home  >  Article  >  Backend Development  >  Dedicated to all friends who want to learn regular expressions and collection_PHP tutorial

Dedicated to all friends who want to learn regular expressions and collection_PHP tutorial

WBOY
WBOYOriginal
2016-07-13 17:37:03797browse

function get_url_content($Url,$Method = c) {
//Introduce the required language encoding. If not, it will default to utf-8, don't worry.
global $Charset;
$Urlarr = parse_url($Url);
//If the domain name cannot be detected, return.
if (!isset($Urlarr[host])) {
        return false;
     }
     //We define the header multiple information in a smart way. =Host && $val = $Urlarr[host];
            $key===Referer && $val =http://.$Urlarr[host];
                                                                            $Urlarr[host];                            ";
}
//Virtual source.
!eregi(Referer,$str) && $str .="Referer:http://{$Urlarr[host]}, ";
//After correction, basically, the source is the same site, and the host is also the Url site.
$Header = array(trim($str));
//The following is just to choose which one to use Program to collect.
if($Method === f&&function_exists(file_get_contents)) {
$opts = array(
http=>array(
method=>"GET",
header=>$Header,
)
);
$cxContext = stream_context_create($opts);
$file_contents = @file_get_contents($Url, false, $cxContext);
} elseif ($Method === c&&function_exists(curl_init)) {
$Ch = curl_init();
$Timeout = 5;
curl_setopt($Ch,CURLOPT_HTTPHEADER,$Header);
curl_setopt ($Ch, CURLOPT_URL, $Url);
curl_setopt ($Ch, CURLOPT_RETURNTRANSFER,1);
curl_setopt ($Ch, CURLOPT_CONNECTTIMEOUT, $Timeout);
$file_contents = curl_exec($Ch);
curl_close($Ch);
}
//In order to make the style display beautifully, we add a target guide to it.
$file_contents = str_replace(,"< /title> ",$file_contents);
//Process the most common encodings. If the target website does not have encoding, it will default to GBK
!preg_match(/charset=([^<>"]*)"/isU,$file_contents,$lang) && $lang[1]=GBK;
function_exists(mb_convert_encoding) && $file_contents = mb_convert_encoding($file_contents,empty($Charset)?UTF-8:$Charset,$lang[1]);
//Unset some codes;
unset($Url,$lang,$Timeout,$ Urlarr,$Charset);
return $file_contents;
}

//Start the test using the file_get_contents method
HEADER("CONTENT-TYPE:TEXT/HTML; CHARSET=UTF-8 ");
//http://www.xtzj.com/read-htm-tid-347550.html This cannot be collected.
$file = get_url_content("http://www.hao123. com",f);
$file = strip_tags($file,);
preg_match_all(/(http:[^"<>]*)>/isU,$file, $link);unset($link[0]);
$link = $link[1];

//Let’s simulate getting data. Change the numbers yourself. 0-151 The following is using curl

$x = 10;

$file = get_url_content($link[$x]);
echo $file;
?>

Write all descriptions and comments..

If you don’t understand the reply... Let me spread the knowledge about the collection.

Original address: http://bbs.phpchina.com/viewthread.php?tid=99263

http://www.bkjia.com/PHPjc/486604.html

truehttp: //www.bkjia.com/PHPjc/486604.htmlTechArticle?php function get_url_content($Url,$Method = c) { //Introduce the required language encoding. If not , it will default to utf-8, don’t worry. global $Charset; $Urlarr = parse_url($Url); //If you check...