Grow your follower fan base by following other blogs. Find blogs that have similar interests and content and comment. The people who follow those blogs can become your follower too. Make sure you have a "Follow Me" button on your site to make it easy for everyone.
*Update: Just found a great article that emphasizes this concept. Check it out.