Long description

The following are the different stages shown here:

Stage 1: Crawler requests URLs

Stage 2: Web content is downloaded

Stage 3. Crawled URLS are added to database engine

Stage 4: Crawled Web content is added to indexes

Stage 5: User makes search request

Stage 6: Queries database engine for results matching the query

Stage 7: Search results returned.

The major components in the search engine are illustrated through these seven stages. The main component block among this includes the following: Query servers, Database engine and input agents (crawlers). A search window is shown above. When a user makes a search request, the request pass through the query servers. These servers queries the database engine for results matching the query, which are then given to the database engine, where the crawled web contents are added to indexes, and then to the input agents where the crawler requests U R L to the rest of the web. The downloaded web content from the web is given to the input agents, and then to Database engine where the crawled U R Ls are added to database engine and the crawled web content is added to indexes. The search result is then returned and displayed on the search window.