Not only but also. Sometimes we can be completely unconscious of the 'contents' of our Shadow Selves because of the way the 'processing' works. We have responses to everything that happens to us but we only become conscious of an extremely small percentage of it, the ego 'filters' out the rest. In the case of emotional trauma or danger our egos can literally 'collapse' so that the emotional response doesn't come into our awareness, but the unconscious still 'stores' it away until it can be resolved. Depending on the study, it can take somewhere between 90-120ms for the brain to process - or sometime never. We're all living in the past.

You can define your Shadow Self any way you want, but those unresolved issues we have can still be a part of us from childhood. And we all have PTSD of some description because we got born and grew up.

Edit: The use of the word 'label' is itself labelling, the question is what are the reasons you use it? Words and consciousness are in a symbiotic relationship, both from internal to external and external to internal.