Well you did the right thing to start with, by burning the ouija board in a fire. That seals the doorway to that other place. Often though trapping the entity here. Mostly though this is whwere they want to be, sometimes not though.
What did you do with the ashes? did you remove them from the house or are they still there. If still there might be to late now, but you need to get them out of the house and do a cleansing and scatter them.

Ouija boards themselves are not dangerous tools, however when you open one doorway you open a crack to many others also. You have to make sure that you as a person have no instability, as any form of fracture or hairline crack in your persona or emotions, spiritual nature can and will cause problems such as the ones you are experiencing. The only way around this is either with someone who is well versed in the occult, or a strong medium.
As both of these types of ppl have long years of training behind them, in one way or another.

But now you have this entity here, you are calling upon the wrong things to rid yourself. You are attempting to send it to the wrong place. So it will continue to refuse you. When you throw white light around you are doing nothing more than shining a bright light in to dark places. That is all white light is good for. It doesn't do what a lot of ppl think it does. It just shows us what is there. How to get rid of it though is another matter.

Calling on Arch Angels will do you no good, there are not of the order of Angel that is required to enforce a removal. It simply isn't their job and it won't be done.
A lot of ppl will differ with me on this, and that is their perogative.
The best Angel that you can call for in this case is Azazel.
How you choose to call upon this entity is your choice.