More feedster.com sillyness

by R.I. Pienaar on 11. Nov, 2004 in Rantings

Somehow, more than any other online service, Feedster really annoys me. For the last few days I noticed some 404 error on their feed of the day feed. I really should have unsubscribed from it when I said I would, but then they fixed it.
So this is what happens, they seem to be returning error codes based on user agent:

Connected to feedster.com.
Escape character is ‘^]’.
GET /search.php?q=f-botd&limit=15&type=rss HTTP/1.1
Host: feedster.com
User-Agent: NewzCrawler/1.7 (compatible; MSIE 6.00; Newz Crawler 1.7; http://www.newzcrawler.com/ )

HTTP/1.1 404 Not Found

compare that 404 error with this:

Connected to feedster.com.
Escape character is ‘^]’.
GET /search.php?q=f-botd&limit=15&type=rss HTTP/1.1
Host: feedster.com
User-Agent: test

HTTP/1.1 200 OK

wtf? One less feed to worry about.

Tags:

One Response to “More feedster.com sillyness”

  1. Scott Johnson of Feedster 11. Nov, 2004 at 18:15 #

    Hi,
    Sorry about that. We’ve had major trouble lately w/ being overly crawled by major crawlers and its costing us tons of money in bandwidth so we’re fairly aggressivley banning bots and I must have mistaken NewzCrawler as a bot not an aggregator due to the name. I’ll take it out.
    Sorry we annoy you.
    S

Leave a Reply