In my learning spiritual entities can
only alter the gross/physical dimension by making use of a conduit (mostly incarnated humans).
By knowing the fields of the body of the conduit and their function, they can then perform things like telekinesis and teleportation. With those 'siddhis' they can move or ruin objects or make them disappear.
If this is the case with you, you can overcome this problem by being strongly aware of what's happening inside of you.
By doing this you will make it more and more difficult for entities to operate through you.
Eventually the problem will dissolve altogether.
Good luck!