Home  >  Article  >  Backend Development  >  使用curl_setopt抓取百度,百度图片防盗有什么好的办法?

使用curl_setopt抓取百度,百度图片防盗有什么好的办法?

WBOY
WBOYOriginal
2016-06-20 12:55:59884browse

$url = "http://www.baidu.com/s?wd=csdn";$header = array (        'User-Agent: Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/33.0.1750.146 Safari/537.36');$ch = curl_init ();$timeout = 10; curl_setopt ( $ch, CURLOPT_URL, $url );curl_setopt ( $ch, CURLOPT_HTTPHEADER, $header );curl_setopt ( $ch, CURLOPT_RETURNTRANSFER, 1 );curl_setopt ( $ch, CURLOPT_CONNECTTIMEOUT,$timeout);$content = curl_exec ( $ch );if ($content == FALSE) {    echo "error:" . curl_error ( $ch );}curl_close ( $ch );echo $content;



回复讨论(解决方案)

伪造referer url

1楼已经说的很清楚了。

伪造referer url


curl_setopt ( $ch, CURLOPT_REFERER, 'http://www.baidu.com/'); 
不行。

你要明白,图片展示的时候,不是php的curl请求了,而是浏览器发的请求。浏览器发的请求,你当前url是什么域名比如www.devtest.com,那么图片的refer就是什么。所以肯定看不到图片。

有一种做法就是,所有百度的图片,你替换成访问自己写的一个php比如url/image.php?baidu_url=******,*****就是真实的图片地址,然后你的image.php在调用curl并加上refer去抓取。

http://i7.baidu.com/it/u=1366412274,1504179524&fm=96&s=E840F41219BFE0C844FC8DCA0300F0B3
你是不能用代码直接访问到的(403错)
但你带上访问 http://www.baidu.com/s?wd=csdn 时得到的 cookie 就可以用代码访问到了

谢谢大家,已经解决啦

header('Content-type:image/jpeg');$ch = curl_init ();$url = "http://t12.baidu.com/it/u=1464136568,2122787600&fm=58&s=3FF6E816C0B4FF90237DC7C40200F024";curl_setopt ( $ch, CURLOPT_URL, $url );curl_setopt ( $ch, CURLOPT_REFERER, 'http://www.baidu.com'); $content = curl_exec ( $ch );curl_close ( $ch );echo $content;

Statement:
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn