The 30-year-old threw a coin at Burnley fans during a Carling Cup tie at Stamford Bridge.
It is likely that Drogba will be handed a three-match ban when the FA regulatory commission meets tomorrow.
A statement from Chelsea confirmed: “Didier Drogba has responded to the FA’s charge of violent conduct and will not contest it.”