Yes, do it! That's a great question. I really like building a following first but at the same time, I see a lot of successful creators build their following and affiliate marketing at the same time. Go with your gut :)