Yoga is a type of exercise, it's mostly hard stretching. It's not spiritually dangerous in any way. Some people incorporate prayers and meditations into the exercise. It's not mandatory. Some people also do that with walking or jogging.
Of course, everything is spiritually dangerous if you're an ignorant dumbass.