It all started with a card game and ended in a sexy time together