work your buns off advertising , when i started there was no facebook, not twitter, and barely internet back in 1996
blog, facebook, twitter. all great tools to get followers it falls on you to market your stream honestly. Also if you only have your stream running a few hours each day that often chases people away so make sure you tell them in you blog and other locations what times or days you have the stream up and running.
best of luck and happy streaming...