Blech. Please have a chat with husband when he is sober. Tell him in no uncertain terms that you have ZERO desire to drink, ever. The next time he and friend try to engage you this way, grab the kids, some overnight things, and leave. I hope you have a friend or parents you can stay with during these occasions.
Ideally, he will choose to drink when he is away from you from now on. You and the children really do not need to be near it. As for your "friend", you might want to rethink that friendship.
Hang in there...