Not able to breakup with friends

So I went on a date with one of my Game Center friends and now I want it to be a strictly business relationship, but when I click "breakup" my contact list still says that we are together. Any ideas?

Thanks for your time!