Belmont Club

By Richard Fernandez

Bio

Get Updates From Richard Fernandez
A Comment About

The rise of the meme

September 8, 2008 - 5:54 pm - by Richard Fernandez
Charles
2008-09-09 10:54:56

Starling
But there are so many such sites that wouldn’t it be prohibitively expensive for a pay-to-search service like Infovell to maintain subscriptions at all these sites? Or do they have some other ways of accessing the information that doesn’t cost them so much money?
//////////////
I know there is a lot more to the web than google indexes.

I don’t know how Infovell indexes sites that Google doesn’t index.

I do know that google’s spiders can’t get by certain kinds of url’s. Richard’s url is very spider friendly.

http://pajamasmedia.com/richardfernandez/2008/09/08/the-rise-of-the-meme/

But other kinds of urls baffle the google spiders. for example if you have strings that end like this: ?more=2078201
or others the long strings that require a www.notlong.com shorting service

It may well be that the new search engine has the ability to index urls that google can’t get at-and never mind subscription sites.