Search engine development
During an orientation for new students at Stanford, he met Larry Page. The two men seemed to disagree on most subjects, but after spending time together they "became intellectual soul-mates and close friends." Brin's focus was on developing data mining systems while Page's was on extending "the concept of inferring the importance of a research paper from its citations in other papers". Together, they authored a paper titled "The Anatomy of a Large-Scale Hypertextual Web Search Engine".
To convert the backlink data gathered by Backrub's web crawler into a measure of importance for a given web page, Brin and Page developed the PageRank algorithm, and realized that it could be used to build a search engine far superior to those existing at the time. The new algorithm relied on a new kind of technology that analyzed the relevance of the backlinks that connected one Web page to another, and allowed the number of links and their rank, to determine the rank of the page. Combining their ideas, they began utilizing Page's dormitory room as a machine laboratory, and extracted spare parts from inexpensive computers to create a device that they used to connect the nascent search engine with Stanford's broadband campus network.
After filling Page's room with equipment, they then converted Brin's dorm room into an office and programming center, where they tested their new search engine designs on the web. The rapid growth of their project caused Stanford's computing infrastructure to experience problems.
Page and Brin used Page's basic HTML programming skills to set up a simple search page for users, as they did not have a web page developer to create anything visually elaborate. They also began using any computer part they could find to assemble the necessary computing power to handle searches by multiple users. As their search engine grew in popularity among Stanford users, it required additional servers to process the queries. In August 1996, the initial version of Google was made available on the Stanford Web site.
By early 1997, the Backrub page described the state as follows:
Some Rough Statistics (from August 29, 1996)
Total indexable HTML urls: 75.2306 Million
Total content downloaded: 207.022 gigabytes
...
BackRub is written in Java and Python and runs on several Sun Ultras and Intel Pentiums running Linux. The primary database is kept on a Sun Ultra series II with 28GB of disk. Scott Hassan and Alan Steremberg have provided a great deal of very talented implementation help. Sergey Brin has also been very involved and deserves many thanks.
- Larry Page pagecs.stanford.edu
BackRub already exhibited the rudimentary functions and characteristics of a search engine: a query input was entered and it provided a list of backlinks ranked by importance. Page recalled: "We realized that we had a querying tool. It gave you a good overall ranking of pages and ordering of follow-up pages." Page said that in mid-1998 they finally realized the further potential of their project: "Pretty soon, we had 10,000 searches a day. And we figured, maybe this is really real."
Some compared Page and Brin's vision to the impact of Johannes Gutenberg, the inventor of modern printing:
In 1440, Johannes Gutenberg introduced Europe to the mechanical printing press, printing Bibles for mass consumption. The technology allowed for books and manuscripts—originally replicated by hand—to be printed at a much faster rate, thus spreading knowledge and helping to usher in the European Renaissance ... Google has done a similar job.
The comparison was also noted by the authors of The Google Story: "Not since Gutenberg ... has any new invention empowered individuals, and transformed access to information, as profoundly as Google." Also, not long after the two "cooked up their new engine for web searches, they began thinking about information that was at the time beyond the web," such as digitizing books and expanding health information.
