Constantly going on dates

Not sure if this is just the game or if there's a glitch with my app, but I have to go on dates all the time. As soon as I finish a date and exit the restaurant/club, I get the "I miss you. Let's hang out" accept/decline phone call. I can't do anything else because I'm afraid if I decline the date, it will cause a break up.

Is there something wrong with my installation of the app or can I decline the date without consequences?