You need to click on the hand icon in the top right corner of the card to confirm your guess.

When you click anywhere else on the card, you add a tag with your name that shows to your teammates that you consider that word as the right answer.