search
HomeBackend DevelopmentPHP TutorialSome ideas for programming search engines in PHP_PHP tutorial

The original text of this article is reproduced from: http://blog.csdn.net/guoguo1980/archive/2006/08/24/1112768.aspx

The author of this article: guoguo1980

Article summary :

Editor's note: This is a wonderful programming teaching article. It not only analyzes the principles of search engine in detail, but also provides some of the author's own ideas on using PHP to compile search engines. The whole article explains it in simple terms. I believe that both experts and novices can get a lot of inspiration from it.

When talking about web search engines, most people will think of Yahoo. Indeed, Yahoo created an era of Internet search. However, the technology Yahoo currently uses to search the web was not originally developed by the company. In August 2000, Yahoo adopted technology from Google (www.Google.com), a venture company founded by Stanford University students. The reason is very simple. Google's search engine can search for the required information faster and more accurately than the technology previously used by Yahoo.

It is probably impossible for us to design and develop a powerful and efficient search engine and database ourselves in a short period of time in terms of technology and funds. However, since Yahoo is using others technology, then can we also use other people’s ready-made search engine websites?

Analysis of programming ideas

We can imagine this: simulate a query, issue a search command in a corresponding format to a search engine website, then return the search results, and analyze the HTML code of the results , strip off redundant characters and codes, and finally display it in our own website page in the required format.

In this way, the key to the problem is that we need to select a search information that is accurate (so that our search will be more meaningful) and fast (because we need extra time to analyze the search results and display them) , a search website with concise search results (convenient for HTML source code analysis and stripping). Due to various excellent features of the new generation search engine Google, here we choose it as an example to see how to use PHP to implement background processing of Google (www.Google.com) search and front-end personalized display process.

Let’s first take a look at the composition of Google’s query commands. Enter the www.Google.com website, enter "abcd" in the query bar, click the query button, we can find that the browser's address bar changes to: http://www. Google.com/search?q=abcd&btnG=Google%CB%D1%CB%F7&hl=zh-CN&lr=, it can be seen that Google passes the query parameters and submits the query command through the get method of the form. We can use the file() function in PHP to simulate this query process.

Understand the File() function

Syntax: array file(string filename);

The return value is an array, and all files are read into the array variable. The file here can be local or remote. The remote file must indicate the protocol used. For example: result=file(“http://www.Google.com/search?q=abcd&btnG=Google%CB%D1%CB%F7&hl=zh-CN&lr=” ), this statement will simulate the process of querying the word "abcd" on Google, and transfer the search results back to the array variable result in the form of elements per row. Because the file read here is remote, the protocol name "http://" cannot be missing.

If you want the user to enter search characters for any search, we can make an input text box and submit button, and replace the searched character "abcd" above with a variable:
echo
; //For a form without parameters, the default submission method is get, submitted to itself
echo; //Construct a text input box
echo; //Construct a submit query button
echo
;

if (isset( $keywords)) //After submission, PHP will generate the variable kwywords, which requires the following program to run after submission
{
urlencode( $keywords) ; //URL encode the user input
result=file(http://www.Google.com/search?q=. $keywords.&btnG=Google%CB%D1%CB%F7&hl=zh-CN&lr =);
//Replace variables in the query statement and save the query results in the array variable result
$result_string=join(, result); //Merge the array $result into a string, each array element Use spaces to paste
... //further processing
}
?>
Note: The above can be used file_get_contents() function to implement, $result_string=file_get_contents(“http://....")

The above program can already query based on user input and synthesize the returned result into a string variable $result_string. Please note that you must use the urlencode() function to URL-encode the user input so that the input Chinese characters, spaces, and other special characters can be queried normally. This also simulates Google's query commands as realistically as possible to ensure the search results are accurate. Correctness.

Analysis of Google

For ease of understanding, let’s assume that what we really need is: the title of the search results. URL and introduction, etc. This is a simple and typical requirement. In this way, all we have to do is: remove the header and footer of Google search results, including a Google logo, input box for re-search, search result description, etc., and strip the original HTML from the remaining search result items. Format tag, replace it with the format we want.

To do this, we must carefully analyze the HTML source code of Google search results and find the patterns. It is not difficult to find that the text of Google search results is always included between the first
tag and the penultimate

tag of the source code, and the penultimate

The mark is followed by the table character, and this combination "


All the following procedures are continued in the "further processing" of the above program.

result_string = strstr( result_string,

); //Get the string after result_string starting from the first

to remove the Google header
position= strpos( result_string,

table symbol Position
result_string= substr(result_string,0, position);//Intercept the string before the first

table symbol to remove the footnote

Application and Implementation

OK, now that we have obtained the useful HTML source code backbone, the remaining problem is how to display this content autonomously. Let’s analyze these search result entries and find that there are also very regular uses between each entry
Separate, that is, each entry is divided into a paragraph. According to this feature, we use the explode() function to cut each entry:

Syntax: explode(string separator, string string);

Return An array, each small string divided by separator is saved in the array

So:
result_array=explode(

, result_string); //Use string
. >
Cut the results

We get an array result_array, where each element is a search result entry. All we have to do is study each entry and its HTML display format code, and then. Just replace as required. Use a loop to process each entry in result_array ( i=0; i {
... //process each entry
}

For each entry, we can easily find some characteristics: each entry is composed of title, abstract, introduction, category, URL, etc. Each part is line-wrapped, that is, it contains the
tag, so it is divided again: (below The handler is placed in the loop above)
every_item=explode(
, result_array[ i]);

  In this way we get an array every_item, where every_item[0] is the title, every_item[ 1] and every_item[2] are two lines of summary. If the headers of every_item[3], every_item[4], etc. contain "Introduction:", " Category:" character, it is an introduction or category (because some result entries do not have this item). If the header contains "", it must be the URL. We often use regular expressions for this kind of comparison. (omitted), it is also very convenient if you want to replace it. For example, $every_item[0] containing the title has a link itself. We want to modify this link attribute so that it opens the link in a new window:
echo eregi_replace( {
... //Process each item except the first item in each entry (the first item is the title, which has been displayed)
... //More format modifications
}

In this way, the link attribute is modified, and many other display format modifications, stripping, and replacements can be completed using regular replacement eregi_replace().

At this point we have obtained each item of each search item, and can modify the format of each item at will, and even put a beautiful table on it. However, a good program should be able to adapt to various operating environments, and here is no exception. In fact, we have only discussed a framework method for HTML stripping of search results. To really do it perfectly, there are many things to consider, such as It displays the total number of search results, how many pages it is divided into, etc. It can even remove the "category", "introduction" and other codes related to Google, so that customers cannot see the original website at all. However, we can all extract these contents and requirements by analyzing HTML. Now everyone can do it themselves and build a highly personalized search engine.

http://www.bkjia.com/PHPjc/735095.htmlwww.bkjia.comtruehttp: //www.bkjia.com/PHPjc/735095.htmlTechArticleThe original text of this article is reproduced from: http://blog.csdn.net/guoguo1980/archive/2006/08/24 /1112768.aspx Author of this article: guoguo1980 Article summary: Editor's note: This is a wonderful programming teaching article...
Statement
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
The Continued Use of PHP: Reasons for Its EnduranceThe Continued Use of PHP: Reasons for Its EnduranceApr 19, 2025 am 12:23 AM

What’s still popular is the ease of use, flexibility and a strong ecosystem. 1) Ease of use and simple syntax make it the first choice for beginners. 2) Closely integrated with web development, excellent interaction with HTTP requests and database. 3) The huge ecosystem provides a wealth of tools and libraries. 4) Active community and open source nature adapts them to new needs and technology trends.

PHP and Python: Exploring Their Similarities and DifferencesPHP and Python: Exploring Their Similarities and DifferencesApr 19, 2025 am 12:21 AM

PHP and Python are both high-level programming languages ​​that are widely used in web development, data processing and automation tasks. 1.PHP is often used to build dynamic websites and content management systems, while Python is often used to build web frameworks and data science. 2.PHP uses echo to output content, Python uses print. 3. Both support object-oriented programming, but the syntax and keywords are different. 4. PHP supports weak type conversion, while Python is more stringent. 5. PHP performance optimization includes using OPcache and asynchronous programming, while Python uses cProfile and asynchronous programming.

PHP and Python: Different Paradigms ExplainedPHP and Python: Different Paradigms ExplainedApr 18, 2025 am 12:26 AM

PHP is mainly procedural programming, but also supports object-oriented programming (OOP); Python supports a variety of paradigms, including OOP, functional and procedural programming. PHP is suitable for web development, and Python is suitable for a variety of applications such as data analysis and machine learning.

PHP and Python: A Deep Dive into Their HistoryPHP and Python: A Deep Dive into Their HistoryApr 18, 2025 am 12:25 AM

PHP originated in 1994 and was developed by RasmusLerdorf. It was originally used to track website visitors and gradually evolved into a server-side scripting language and was widely used in web development. Python was developed by Guidovan Rossum in the late 1980s and was first released in 1991. It emphasizes code readability and simplicity, and is suitable for scientific computing, data analysis and other fields.

Choosing Between PHP and Python: A GuideChoosing Between PHP and Python: A GuideApr 18, 2025 am 12:24 AM

PHP is suitable for web development and rapid prototyping, and Python is suitable for data science and machine learning. 1.PHP is used for dynamic web development, with simple syntax and suitable for rapid development. 2. Python has concise syntax, is suitable for multiple fields, and has a strong library ecosystem.

PHP and Frameworks: Modernizing the LanguagePHP and Frameworks: Modernizing the LanguageApr 18, 2025 am 12:14 AM

PHP remains important in the modernization process because it supports a large number of websites and applications and adapts to development needs through frameworks. 1.PHP7 improves performance and introduces new features. 2. Modern frameworks such as Laravel, Symfony and CodeIgniter simplify development and improve code quality. 3. Performance optimization and best practices further improve application efficiency.

PHP's Impact: Web Development and BeyondPHP's Impact: Web Development and BeyondApr 18, 2025 am 12:10 AM

PHPhassignificantlyimpactedwebdevelopmentandextendsbeyondit.1)ItpowersmajorplatformslikeWordPressandexcelsindatabaseinteractions.2)PHP'sadaptabilityallowsittoscaleforlargeapplicationsusingframeworkslikeLaravel.3)Beyondweb,PHPisusedincommand-linescrip

How does PHP type hinting work, including scalar types, return types, union types, and nullable types?How does PHP type hinting work, including scalar types, return types, union types, and nullable types?Apr 17, 2025 am 12:25 AM

PHP type prompts to improve code quality and readability. 1) Scalar type tips: Since PHP7.0, basic data types are allowed to be specified in function parameters, such as int, float, etc. 2) Return type prompt: Ensure the consistency of the function return value type. 3) Union type prompt: Since PHP8.0, multiple types are allowed to be specified in function parameters or return values. 4) Nullable type prompt: Allows to include null values ​​and handle functions that may return null values.

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

Video Face Swap

Video Face Swap

Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Tools

DVWA

DVWA

Damn Vulnerable Web App (DVWA) is a PHP/MySQL web application that is very vulnerable. Its main goals are to be an aid for security professionals to test their skills and tools in a legal environment, to help web developers better understand the process of securing web applications, and to help teachers/students teach/learn in a classroom environment Web application security. The goal of DVWA is to practice some of the most common web vulnerabilities through a simple and straightforward interface, with varying degrees of difficulty. Please note that this software

VSCode Windows 64-bit Download

VSCode Windows 64-bit Download

A free and powerful IDE editor launched by Microsoft

SublimeText3 Mac version

SublimeText3 Mac version

God-level code editing software (SublimeText3)

SAP NetWeaver Server Adapter for Eclipse

SAP NetWeaver Server Adapter for Eclipse

Integrate Eclipse with SAP NetWeaver application server.

Dreamweaver Mac version

Dreamweaver Mac version

Visual web development tools