The Blues only managed a 2-1 win at home over Romanian side CFR Cluj on Tuesday.
Chelsea finished second in the group, behind Italian side Roma.
“If we want to go all the way we have to really up our game,” Terry told ITV. “We are through to the knock-out stages now so we have to be on the ball home and away.”