This post originated from an RSS feed registered with Agile Buzz
by James Robertson.
Original Post: Aggregators that automatically download web pages?
Feed Title: Cincom Smalltalk Blog - Smalltalk with Rants
Feed URL: http://www.cincomsmalltalk.com/rssBlog/rssBlogView.xml
Feed Description: James Robertson comments on Cincom Smalltalk, the Smalltalk development community, and IT trends and issues in general.
Greg Reinacker (NewsGator author) has an interesting discussion on his site - should an aggregator download full content (even if the feed does not contain full content) for offline viewing? That's an interesting question. It would be simple to support such a thing in BottomFeeder, but - as Greg and others bring up on his site - that's going against the wishes of the content provider and starting to act more "robot" like. I think if I added that to BottomFeeder, I'd have to make sure that I respected robots.txt when doing so. It's an interesting crossing point for aggregators. Thoughts?