Googlebot is the engine that drives Google Search. Crawler, Spider-the software systems that crawl the network and download the pages which are downloaded through links. The function of It is to discover the new and updated material and include it in the search index of Google. This way people can search and get results which would be relevant for them. Googlebot follows the robots.txt rules for how to crawl the pages. It is improved and subjects to development for efficiency in crawling and understanding types of content other than text and image. The owner of websites still needs to make their sites friendly for Googlebot, so it indexes and considers them for Serviced Rank.