Ruby：无法抓取百度搜索结果

Question

URL：http://www.baidu.com/s?wd=site:www.cnblogs.com
代码：

def get_html(url)
    uri = URI(url)
    p resp = Net::HTTP.get(uri)
end

而获取到的结果是百度首页的源码，并不是搜索site:www.cnblogs.com的结果

---

不知道，Ruby中有关于网络编程方面的好书籍没？
刚接触ruby，很多东西不知道从何找（目前都是到官网看文档）。

---

使用PHP简单实现了下：

<?php
set_time_limit(0);
function _rand()
{
    $length = 26;
    $chars = "0123456789abcdefghijklmnopqrstuvwxyz";
    $max = strlen($chars) - 1;
    mt_srand((double)microtime() * 1000000);
    $string = '';
    for ($i = 0; $i < $length; $i++) {
        $string.= $chars[mt_rand(0, $max) ];
    }
    return $string;
}
$HTTP_SESSION = _rand();
$HTTP_SESSION;
$HTTP_Server = "www.baidu.com";
$HTTP_URL = "/s?wd=site:www.cnblogs.com";
$ch = curl_init();
curl_setopt($ch, CURLOPT_URL, "http://" . $HTTP_Server . $HTTP_URL);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
curl_setopt($ch, CURLOPT_USERAGENT, "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322; .NET CLR 2.0.50727)");
$res = curl_exec($ch);
curl_close($ch);
print_r($res);

Answer 1

No matter what language code you use to crawl, you cannot capture Baidu content so easily.
Baidu is not the same Baidu it used to be. Without various cookie authentications, you can't even catch it. You'd better do some research to see if there is an API. Baidu's front-end code is full of twists and turns, just to prevent you from being caught.

Answer 2

http://www.baidu.com/s?wd=www.cnblogs.com&rsv_bp=0&ch=&tn=19045005_5_pg&bar=&rsv_spt=3&ie=utf-8&rsv_n=2&rsv_sug3=1&rsv_sug4=57&rsv_sug2=0&inputT=635
Postmaster, you can only get back by throwing out such a large amount, right?

Answer 3

Owner, do you want to grab the POI collected by Baidu?