Spurs duo Fareth Bale and Michael Dawson was sent off and Stoke was given a penalty in the match.
Ramos said: “It was a difficult match with two sent off and two penalites and injured players.
“It was possibly a penalty but for me the red card finished the match as it is impossible to play nearly all the match with one man less.
“We made a big effort in the first half but the second goal finished the game.”