News Search
Topix.net Increases Number of Sources Crawled, More than 6000 Available
Topix continues to impress! After officially launching three weeks ago, the company has announced they’re now crawling more than 6000 sources, up from 3300 sources. Almost a 100% increase. Topix.net CEO Rich Skrenta was nice enough to provide us with a breakdown of sources by category:
24% Daily newspapers
19% AM & FM news radio stations
15% Weekly newspapers
15% B2B and consumer magazines
12% TV stations
9% College newspapers
5% Government websites
1% Weblogs
It’s good to see that Topix is including business press/trade publications and college newspapers in their crawl! Their “pre-built” pages on thousands of business topics are very useful. I’ve been using Topix.net quite heavily in the past few weeks and regularly turn-up USEFUL articles I don’t find elsewhere.

Skrenta also let us know that the Topix crawler is now able to navigate javascript and pages utilizing frames. You should also notice that the name of the news source is now being provided. Until today just the domain name was visible. You can learn much more about Topix.net in this overview article from earlier this month and a new article from J.B.’s Searchblog.

This entry was posted on Tuesday, March 30th, 2004 and is filed under Uncategorized. You can follow any responses to this entry through the RSS 2.0 feed. Responses are currently closed, but you can trackback from your own site.