Skip to main content

Patents about Google crawling

 

Google patents about crawling and indexing

Claim 1 of the patent US20060282494A1 - Interactive web crawling is as follows:



1. A method for crawling a web site, the method comprising:


    * providing a crawler having a plurality of modes of operation, including an automatic mode and an interactive mode;

    * operating the crawler in the automatic mode to crawl the web site;

    * detecting a structure on the web site that requires human interaction;

    * switching the crawler to the interactive mode;

    * prompting a user to interact with the structure;

    * receiving input from the user;

    * and continuing to crawl the web site in the interactive mode based on the input from the user.



The method described in Claim 1 allows a user to interact with the crawling process. For example, the user can specify which pages should be crawled, and they can also pause or resume the crawling process. This can be useful for web sites that are large or complex, or for web sites that require human interaction to crawl.


The method described in Claim 1 is a significant improvement over previous methods of crawling web sites. Previous methods of crawling web sites were typically automatic, meaning that they did not allow for user interaction. This could lead to problems, such as the crawler crawling pages that were not of interest to the user, or the crawler crawling pages that were not accessible to the user. The method described in Claim 1 solves these problems by allowing the user to interact with the crawling process.


Claim 2 of the patent US20060282494A1 - Interactive web crawling is as follows:


2. The method of claim 1, wherein the structure on the web site that requires human interaction is a dynamic structure.


The structure on the web site that requires human interaction is a dynamic structure. This means that the structure changes over time, such as a search results page or a news feed. Dynamic structures can be difficult to crawl automatically, as the crawler may not be able to keep up with the changes. The method described in Claim 2 addresses this problem by allowing the user to interact with the crawling process. This allows the user to specify which pages should be crawled, and it also allows the user to pause or resume the crawling process.


The method described in Claim 2 is a significant improvement over previous methods of crawling dynamic structures. Previous methods of crawling dynamic structures were typically automatic, meaning that they did not allow for user interaction. This could lead to problems, such as the crawler crawling pages that were not of interest to the user, or the crawler crawling pages that were not accessible to the user. The method described in Claim 2 solves these problems by allowing the user to interact with the crawling process.


Here are some examples of dynamic structures:


* Search results pages

* News feeds

* Product catalogs

* Social media feeds

* eCommerce websites


These structures are all dynamic, meaning that they change over time. This can make it difficult to crawl them automatically, as the crawler may not be able to keep up with the changes. The method described in Claim 2 addresses this problem by allowing the user to interact with the crawling process. This allows the user to specify which pages should be crawled, and it also allows the user to pause or resume the crawling process.

Comments

Post a Comment

Popular posts from this blog

The king of Nnewi

  The current king of Nnewi is His Royal Highness Igwe Kenneth Onyeneke Orizu III. He is the 20th monarch in the Nnofo royal lineage and has been on the throne since 1963. He is the longest-serving traditional ruler in Nigeria. Igwe Orizu is a highly respected figure in Nnewi and in the wider Igbo community. He is known for his wisdom, his leadership skills, and his commitment to promoting peace and development in Nnewi. He is also a strong advocate for the rights of traditional rulers in Nigeria. Under Igwe Orizu's leadership, Nnewi has become a major industrial and commercial center in Nigeria. The city is home to a number of thriving industries, including automobile manufacturing, plastics, and textiles. Nnewi is also a major center for the Igbo arts and culture. Igwe Orizu is a strong supporter of education. He has established a number of schools in Nnewi, including a university, a polytechnic, and a number of secondary schools. He is also a patron of the arts and culture, and ...
Post a Comment
Read more

The historical records of Nnewi

  The history of Nnewi : Nnewi, a vibrant city located in the southeastern part of Nigeria, has a rich history that spans several centuries. The origins of Nnewi can be traced back to ancient times, and its development over the years has made it one of the most industrious and economically prosperous cities in Nigeria. Here is a detailed history of Nnewi: Ancient and Pre-colonial Era: The earliest settlers in the region that is now known as Nnewi were believed to be of the Igbo ethnic group. The Igbo people have a long history in the southeastern part of Nigeria, and Nnewi is considered one of their ancient settlements. The exact date of the city's establishment is unknown, but it is thought to have existed for several centuries. Nnewi was originally a small village, with its inhabitants engaged in subsistence farming, hunting, and traditional crafts. The community was organized into several extended families, with each family having its own ancestral lineage and chief. Colonial Er...
Post a Comment
Read more

The Story of Eri

  Eri, son of Gad, is a legendary figure in Igbo history. He is said to be the founder of the Igbo people, and his descendants are believed to have spread throughout Igboland. Eri's story is told in various oral traditions, but there are some common elements. According to these traditions, Eri was a high priest who lived in Egypt during the reign of Joseph. When he foresaw that the Israelites would be enslaved by the Egyptians, he fled Egypt with a group of followers. They traveled through Sudan and down the Niger River, eventually settling in the area that is now known as Aguleri, in Anambra State, Nigeria. In Aguleri, Eri established a new community. He taught his people how to farm, how to build homes, and how to worship Chukwu, the Supreme Being. He also founded the Nri dynasty, which was a powerful religious and political force in Igboland for centuries. Eri's story is a foundational myth for the Igbo people. It tells of their origins, their migration to Igboland, and the ...
Post a Comment
Read more