If I am sensitive to dairy, should I avoid cheese, yogurt, and other dairy products?

Yes, if you are reactive to dairy, the most conservative approach would be to avoid ALL forms of dairy, including dairy products such as cheese, yogurt, whey protein isolate, etc.