What do you do when a crystal gives you negative feelings

[Sylmar]

I love Peridot. Even as a child I was attracted to it and I still am. There is something unique in that special color of green that you don't find in other crystals.

However, I have found that when wearing it as a pendant it brings out the negative in me. I get feelings of agitation and I'm getting shorttempered. It feels like it is colliding with something inside myself.

I've noticed that there are two kinds of people working with crystals. Those that say that when a crystals feels negative it's not meant for you and you should switch to another crystal that makes you feel better.
But also those that say that if a crystal gives you negative feelings it is working as intended and digging up old issues that should be dealt with. That bringing it up is a gift of the crystal so you can deal with it.

At the moment I don't know where I'm standing on this issue. I think I lean more towards the second view but sometimes taking a break with a crystal that is soothing. Sure would like to know how others see this.