« Proof! Baghdad Bob lives. His new job! | Main | More on sending video electronically »

April 19, 2003

From seach for extraterrestrials comes a search for Web sites

It's called distributed computing and it was made popular by the folks from SETI - the search for Extraterrestrial Intelligence. It "borrows" processor time from PC users when they're not at the keyboard to process data collected by the big radio telescope in Puerto Rico. Anyway, the same concept is not being used by a Web site search agent called Grub. Grub uses the power of distributed computing to build what it hopes will be the best search on the Web. It automatically crawls the Web in the background, borrowing your computer's spare clock cycles, so you won't even notice it's there.You download a little screen saver program, set the resources you'll allocate for the crawl, and it's ready to work. C|Net says Grub has operated under the radar since 2000, when it was founded in Oklahoma. A company called Looksmart acquired it this year and Grub's four-person team has moved to LookSmart's San Francisco headquarters.
To see how slick this is, try the Looksmart search page. It is very fast and, on first look, much more comprehensive than I thought.
Google has experimented with distributed computing, too, though this Grub initiative is the biggest such effort to date. The activity shows how the industry is looking to improved web searching as that "next big thing" killer ap. I have a newspaper column coming Monday on how even the big automobile companies are now using distributed computing, also known as computer harvesting.


in Internet | TrackBack (0)

Comments

Quick Links


    mike!

Google

Web This site

Site Credits