The 20-year-old has impressed on loan at Championship side QPR this season.
“I’m excited about being here and proving that I’m good enough to play in the Premier League,” he said.
“That’s why Tottenham bought me from Sheffield United and that’s what I’m keen to show here at Villa.
“This is a great opportunity for me and I’m looking forward to taking it.
“I know several of the players here from England Under 19s and England Under 21s – Nathan Delfouneso, Ciaran Clark and Marc Albrighton.
“I’m sure those lads will help me to settle in and enjoy my time at Villa. I’m really keen to contribute and compete and prove myself here.”
“We’re pleased that Kyle will be with us until the end of the season,” added Villa boss Gerard Houllier.
“He is 20, an attacking full-back and a very promising young player. He will be a valuable addition to our defence.”
