为什么想起来做这个功能?是因为前段时间在做一个淘客网站的时候,想到是否能抓取到淘宝商品的买家秀呢?经过一番折腾发现,淘宝商品用户评价信息是通过Ajax来调取的,通过嗅探网址发现,评论数据的请求接口是:
https:<span>//</span><span>rate.tmall.com/list_detail_rate.htm?itemId=524394294771&spuId=341564036&sellerId=100414600&order=3¤tPage=1&append=0&content=1&tagId=&posi=&picture=1&callback=jsonp2339</span>
其实上面很多参数也很容易理解,itemId是商品的ID,currentPage是当前页,picture为1时显示有图的评价,既然是抓取买家秀,那么picture参数一定要为1了。
如果你直接去访问上面的接口时,会得到如下图所示的请求结果:
看到请求结果是jsonp格式我就蛋碎了,我不知道如何去解析,但是换种思路,直接用PHP的正则去解析也未尝不可嘛,通过尝试,已经正确的能够解析到评论内容和买家秀的图片内容,如图:
效果不错,代码实现了评论内容的抓取、买家秀图片的抓取,代码奉上:
<?<span>php </span><span>$url</span> = "https://rate.tmall.com/list_detail_rate.htm?itemId=524394294771&spuId=341564036&sellerId=100414600&order=3¤tPage=1&append=0&content=1&tagId=&posi=&picture=1&callback=jsonp2339"<span>; </span><span>$ch2</span> =<span> curl_init(); curl_setopt(</span><span>$ch2</span>, CURLOPT_URL, <span>$url</span><span>); curl_setopt(</span><span>$ch2</span>, CURLOPT_FOLLOWLOCATION, <span>TRUE</span><span>); curl_setopt(</span><span>$ch2</span>, CURLOPT_SSL_VERIFYHOST, <span>FALSE</span><span>); curl_setopt(</span><span>$ch2</span>, CURLOPT_SSL_VERIFYPEER, <span>false</span><span>); curl_setopt(</span><span>$ch2</span>, CURLOPT_RETURNTRANSFER, <span>TRUE</span><span>); </span><span>$texts</span> = curl_exec(<span>$ch2</span><span>); curl_close(</span><span>$ch2</span><span>); </span><span>//</span><span>echo $texts;</span> <span>$pattern</span> = '/"pics"(.+?)","reply"/is'<span>; </span><span>preg_match_all</span>(<span>$pattern</span>, <span>$texts</span>, <span>$match</span><span>); </span><span>for</span>(<span>$i</span>=0;<span>$i</span><<span>count</span>(<span>$match</span>[0]);<span>$i</span>++<span>){ </span><span>$pattern2</span> = '/"rateContent":"(.+?)."reply"/is'<span>; </span><span>preg_match</span>(<span>$pattern2</span>, <span>$match</span>[0][<span>$i</span>], <span>$matchcomments_only</span><span>); </span><span>echo</span> "<p>".<span>str_replace</span>('","rateDate":"',' ',<span>str_replace</span>('","reply"','',<span>str_replace</span>('"rateContent":"','',<span>$matchcomments_only</span>[0])))."</p>"<span>; </span><span>$pattern3</span> = '/img.alicdn(.+?).jpg/is'<span>; </span><span>preg_match</span>(<span>$pattern3</span>, <span>$match</span>[0][<span>$i</span>], <span>$matchpic_only</span><span>); </span><span>echo</span> '<img src="http://'.<span alt="用PHP抓取淘宝商品的用户晒单评论+图片实例," >$matchpic_only</span>[0].'" width=120>'<span>; } </span><span>/*</span><span>匹配一张图片 $pattern = '/"pics"(.+?)","position"/is'; preg_match_all($pattern, $texts, $matchpic); for($i=0;$i<count($matchpic[0]);$i++){ $pattern3 = '/img.alicdn(.+?).jpg/is'; preg_match($pattern3, $matchpic[0][$i], $matchpic_only); echo "<p>".$matchpic_only[0]."</p>"; }</span><span>*/</span> <span>/*</span><span>匹配所有图片 $pattern = '/"pics"(.+?)","position"/is'; preg_match_all($pattern, $texts, $matchpic); for($i=0;$i<count($matchpic[0]);$i++){ $pics_str=str_replace('"pics":["//','',str_replace('"],"picsSmall":"","position"','',$matchpic[0][$i])); $arr = explode('","//',$pics_str); echo "<p>"; foreach($arr as $newstr){ echo '<img src=http://'.$newstr.' style="max-width:90%"用PHP抓取淘宝商品的用户晒单评论+图片实例," >'; } echo "</p>"; }</span><span>*/</span> ?>
有什么解析jsonp格式的好方法呢?求大神~~~