Non-veg food can certainly linger the spiritual progression in man. It can also influence the subtle energy centers and inflict one's spiritual energy. But these are the mere cases in spirituality that are only concerned for the beginners. More details can be found at
Does Yoga Practice Require a Vegetarian Diet?