So what is that orange icon in your site? An RSS (Really Simple Syndication) feed is a simple way of subscribing to updates of your favourite web sites. Have a look at the RSS in plain English video by the Common Craft guys.
You can use Google Reader, your web browser (Firefox and Safari include a feed reader) or a host of other services for subscribing. Just look at the video for a reasonable explanation.