Kinnear felt Emile Heskey did not deserve to be given a penalty early in the second half and also wanted a penalty of his own.
“I thought it was a certain penalty at the end with Andy Carroll,” Kinnear told the official Newcastle website.
“Steve Bruce also thought it was a stonewall penalty but in the end Andy has been booked which is very disappointing.
“Our lads gave their lot in the final stages and pushed on and I thought we could get an equaliser.
“Big Andy has changed the complexion of the game when he came on and did well to win the penalty which gave us that hope.
“If only the second one had been awarded we could be sat here talking about a draw.”
Sebastien Basson was sent off for the challenge that gave Emile Heskey the penalty.
“I thought the sending off was very harsh because Emile Heskey has waited until he was in the area and has gone down very easily,” Kinnear added.
“We’ll now be without Seb for Liverpool which is a blow, especially given Beye and Enrique are also missing.”
