I guess since a Backgammon game is a war, it's reasonable to have you on his enemies list.....:-)
So you will have to wait the war to over, for not being his enemy anymore.......

But a little more seriously what are the consequences of having you at his ememies list? If i remember correctly you can't send him a message but except this, is any other thing.........?