巧妙运用PHP函数实现采集器

php经过长时间的发展，很多用户都很了解php了，我们现在可以利用php函数实现采集器程序。何为采集器，通常又叫小偷程序，主要是用来抓取别人网页内容的。关于采集器的制作，其实并不难，就是远程打开要采集的网页，然后用正则表达式将需要的内容匹配出来，只要稍微有点正则表达式的基础，都能做出自己的采集器来的。

前几天做了个小说连载的程序，因为怕更新麻烦，顺带就写了个采集器，采集八路中文网的，功能比较简单，不能自定义规则，不过大概思路都在里面了，自定义规则可以自己来扩展。用php来做采集器主要用到两个PHP函数：file_get_contents()和preg_match_all()，前一个是远程读取网页内容的，不过只在php5以上的版本才能用，后一个是正则函数，用来提取需要的内容的。面就一步一步来讲功能实现。因为是采集小说，所以首先要将书名、作者、类型这三个提取出来，别的信息可根据需要提取。

这样还不够，还需要一个切取PHP函数：

<OL class=dp-xml><LI class=alt><SPAN><SPAN>function cut($string,$start,$end){     </SPAN></SPAN><LI class=""><SPAN>$</SPAN><SPAN class=attribute><FONT color=#ff0000>message</FONT></SPAN><SPAN> = </SPAN><SPAN class=attribute-value><FONT color=#0000ff>explode</FONT></SPAN><SPAN>($start,$string);     </SPAN></SPAN><LI class=alt><SPAN>$</SPAN><SPAN class=attribute><FONT color=#ff0000>message</FONT></SPAN><SPAN> = </SPAN><SPAN class=attribute-value><FONT color=#0000ff>explode</FONT></SPAN><SPAN>($end,$message[1]); return $message[0];}其中$string为要被切取的内容，$start为开始的地方，$end为结束的地方。取出分类号：     </SPAN></SPAN><LI class=""><SPAN> </SPAN><LI class=alt><SPAN>$</SPAN><SPAN class=attribute><FONT color=#ff0000>start</FONT></SPAN><SPAN> = </SPAN><SPAN class=attribute-value><FONT color=#0000ff>"Html/Book/"</FONT></SPAN><SPAN>;     </SPAN></SPAN><LI class=""><SPAN>$</SPAN><SPAN class=attribute><FONT color=#ff0000>end</FONT></SPAN><SPAN>    </SPAN></SPAN><LI class=alt><SPAN>= </SPAN><SPAN class=attribute-value><FONT color=#0000ff>"List.shtm"</FONT></SPAN><SPAN>;     </SPAN></SPAN><LI class=""><SPAN>$</SPAN><SPAN class=attribute><FONT color=#ff0000>typeid</FONT></SPAN><SPAN> = </SPAN><SPAN class=attribute-value><FONT color=#0000ff>cut</FONT></SPAN><SPAN>($typeid[0][0],$start,$end);     </SPAN></SPAN><LI class=alt><SPAN>$</SPAN><SPAN class=attribute><FONT color=#ff0000>typeid</FONT></SPAN><SPAN> = </SPAN><SPAN class=attribute-value><FONT color=#0000ff>explode</FONT></SPAN><SPAN>("/",$typeid);[/php]     </SPAN></SPAN><LI class=""><SPAN> </SPAN><LI class=alt><SPAN>这样，$typeid[0]就是我们要找的分类号了。方法如下：     </SPAN><LI class=""><SPAN> </SPAN><LI class=alt><SPAN>$</SPAN><SPAN class=attribute><FONT color=#ff0000>ustart</FONT></SPAN><SPAN> = </SPAN><SPAN class=attribute-value><FONT color=#0000ff>""</FONT></SPAN><SPAN>";     </SPAN></SPAN><LI class=""><SPAN>$</SPAN><SPAN class=attribute><FONT color=#ff0000>uend</FONT></SPAN><SPAN>    </SPAN></SPAN><LI class=alt><SPAN>= </SPAN><SPAN class=attribute-value><FONT color=#0000ff>""</FONT></SPAN><SPAN>";     </SPAN></SPAN><LI class=""><SPAN>//t表示title的缩写     </SPAN><LI class=alt><SPAN>$</SPAN><SPAN class=attribute><FONT color=#ff0000>tstart</FONT></SPAN><SPAN> = </SPAN><SPAN class=attribute-value><FONT color=#0000ff>">"</FONT></SPAN><SPAN>;     </SPAN></SPAN><LI class=""><SPAN>$</SPAN><SPAN class=attribute><FONT color=#ff0000>tend</FONT></SPAN><SPAN>    </SPAN></SPAN><LI class=alt><SPAN>= </SPAN><SPAN class=attribute-value><FONT color=#0000ff>"<"</FONT></SPAN><SPAN>;     </SPAN></SPAN><LI class=""><SPAN>//取路径,例如:123.shtm,2342.shtm,233.shtm     </SPAN><LI class=alt><SPAN>preg_match_all("/"[0-9]{1,}.(shtm)"/is",$chapterurl,$url);     </SPAN><LI class=""><SPAN>//取标题,例如:第一章 九世善人     </SPAN><LI class=alt><SPAN>preg_match_all("/</SPAN><STRONG><FONT color=#006699><SPAN class=tag><</SPAN><SPAN class=tag-name>a</SPAN></FONT></STRONG><SPAN> </SPAN><SPAN class=attribute><FONT color=#ff0000>href</FONT></SPAN><SPAN>="[0-9]{1,}.shtm"(.*?)</SPAN><SPAN class=tag><STRONG><FONT color=#006699><</FONT></STRONG></SPAN><SPAN>/a</SPAN><SPAN class=tag><STRONG><FONT color=#006699>></FONT></STRONG></SPAN><SPAN>/is",$file,$title);     </SPAN></SPAN><LI class=""><SPAN>$</SPAN><SPAN class=attribute-value><FONT color=#0000ff>count</FONT></SPAN><SPAN class=attribute><FONT color=#ff0000>countcount</FONT></SPAN><SPAN> = count($url[0]);     </SPAN></SPAN><LI class=alt><SPAN>for($</SPAN><SPAN class=attribute><FONT color=#ff0000>i</FONT></SPAN><SPAN>=</SPAN><SPAN class=attribute-value><FONT color=#0000ff>0</FONT></SPAN><SPAN>;$i</SPAN><SPAN class=tag><STRONG><FONT color=#006699><</FONT></STRONG></SPAN><SPAN>=$count;$i++)     </SPAN></SPAN><LI class=""><SPAN>{     </SPAN><LI class=alt><SPAN>$</SPAN><SPAN class=attribute><FONT color=#ff0000>u</FONT></SPAN><SPAN> = </SPAN><SPAN class=attribute-value><FONT color=#0000ff>cut</FONT></SPAN><SPAN>($url[0][$i],$ustart,$uend);     </SPAN></SPAN><LI class=""><SPAN>$</SPAN><SPAN class=attribute><FONT color=#ff0000>t</FONT></SPAN><SPAN> = </SPAN><SPAN class=attribute-value><FONT color=#0000ff>cut</FONT></SPAN><SPAN>($title[0][$i],$tstart,$tend);     </SPAN></SPAN><LI class=alt><SPAN>$array[$u] = $t;     </SPAN><LI class=""><SPAN>}    </SPAN></LI></OL>

$array数组就是所有的章节地址了，到这里，采集器就完成一半了，剩下的就是循环打开每个章节地址，读取，然后将内容匹配出来。这个比较简单，这里就不详细叙述了。好了，今天就先写到这吧，第一次写这么长的文章，语言组织方面难免有问题，还请大家多包涵！

php免费学习视频：立即学习
踏上前端学习之旅，开启通往精通之路！从前端基础到项目实战，循序渐进，一步一个脚印，迈向巅峰！