Skip to main content

Patents about Google crawling

 

Google patents about crawling and indexing

Claim 1 of the patent US20060282494A1 - Interactive web crawling is as follows:



1. A method for crawling a web site, the method comprising:


    * providing a crawler having a plurality of modes of operation, including an automatic mode and an interactive mode;

    * operating the crawler in the automatic mode to crawl the web site;

    * detecting a structure on the web site that requires human interaction;

    * switching the crawler to the interactive mode;

    * prompting a user to interact with the structure;

    * receiving input from the user;

    * and continuing to crawl the web site in the interactive mode based on the input from the user.



The method described in Claim 1 allows a user to interact with the crawling process. For example, the user can specify which pages should be crawled, and they can also pause or resume the crawling process. This can be useful for web sites that are large or complex, or for web sites that require human interaction to crawl.


The method described in Claim 1 is a significant improvement over previous methods of crawling web sites. Previous methods of crawling web sites were typically automatic, meaning that they did not allow for user interaction. This could lead to problems, such as the crawler crawling pages that were not of interest to the user, or the crawler crawling pages that were not accessible to the user. The method described in Claim 1 solves these problems by allowing the user to interact with the crawling process.


Claim 2 of the patent US20060282494A1 - Interactive web crawling is as follows:


2. The method of claim 1, wherein the structure on the web site that requires human interaction is a dynamic structure.


The structure on the web site that requires human interaction is a dynamic structure. This means that the structure changes over time, such as a search results page or a news feed. Dynamic structures can be difficult to crawl automatically, as the crawler may not be able to keep up with the changes. The method described in Claim 2 addresses this problem by allowing the user to interact with the crawling process. This allows the user to specify which pages should be crawled, and it also allows the user to pause or resume the crawling process.


The method described in Claim 2 is a significant improvement over previous methods of crawling dynamic structures. Previous methods of crawling dynamic structures were typically automatic, meaning that they did not allow for user interaction. This could lead to problems, such as the crawler crawling pages that were not of interest to the user, or the crawler crawling pages that were not accessible to the user. The method described in Claim 2 solves these problems by allowing the user to interact with the crawling process.


Here are some examples of dynamic structures:


* Search results pages

* News feeds

* Product catalogs

* Social media feeds

* eCommerce websites


These structures are all dynamic, meaning that they change over time. This can make it difficult to crawl them automatically, as the crawler may not be able to keep up with the changes. The method described in Claim 2 addresses this problem by allowing the user to interact with the crawling process. This allows the user to specify which pages should be crawled, and it also allows the user to pause or resume the crawling process.

Comments

Post a Comment

Popular posts from this blog

History of Nnewi: The history of how Nnewi descended from Eri.

  The history of Nnewi   is filled with a lot of interesting events since they they are one of the descendants of Eri, son of Gad, son of Jacob.  The story of how Nnewi descended from Eri is a long and complex one, with many different versions. However, the most common version tells the following tale: Eri was a great Igbo leader who migrated to the area that is now Anambra State from the Middle East. He was accompanied by his wife, three sons, and one daughter. Eri's daughter, Adamma, was the ancestor of the Nnewi people. Adamma married a man named Nnobi, and they had a son named Nnewi. Nnewi was a great warrior and leader, and he led the Nnewi people to a new settlement in the area that is now Nnewi. The Nnewi people thrived under Nnewi's leadership. They became known for their skills in metalworking, pottery, and trade. They also became known for their strong sense of community and their commitment to traditional Igbo values. Today, Nnewi is a thriving city in Anambra State.
Post a Comment
Read more

The historical records of Nnewi

  The history of Nnewi : Nnewi, a vibrant city located in the southeastern part of Nigeria, has a rich history that spans several centuries. The origins of Nnewi can be traced back to ancient times, and its development over the years has made it one of the most industrious and economically prosperous cities in Nigeria. Here is a detailed history of Nnewi: Ancient and Pre-colonial Era: The earliest settlers in the region that is now known as Nnewi were believed to be of the Igbo ethnic group. The Igbo people have a long history in the southeastern part of Nigeria, and Nnewi is considered one of their ancient settlements. The exact date of the city's establishment is unknown, but it is thought to have existed for several centuries. Nnewi was originally a small village, with its inhabitants engaged in subsistence farming, hunting, and traditional crafts. The community was organized into several extended families, with each family having its own ancestral lineage and chief. Colonial Er
Post a Comment
Read more