Rodgers, who is a former Chelsea reserves manager, has impressed while in charge at Swansea.
Rodgers said: “For me the focus is on Swansea. I came here to do a job.
“The story for us all so far has been fantastic and I hope that will continue.
“If any of our fans are wondering about me and Chelsea, they need not panic.
“I am trying to build my career and not destroy it.”
He added on Chelsea’s sacking of Andre Villas-Boas: “It’s sad to see Andre depart.
“The transition that is needed at the club is very much evident and it’s a job that requires sensitivity about where the club is at.
“It’s about understanding and respecting what the players have done there and also having that ruthless streak to manage the club.
“I feel Andre tried to do those things but, for whatever reason, it just hasn’t worked out.
“There is so much going for Chelsea — it’s a terrific club,” he added.
“But you can’t continue doing what they do and have success. It does not work.
“The next manager who goes in there will have the same problems and issues.
“It’s a big job and demanding job — that’s how it is at the big clubs and that’s why the salaries are so high.
“It’s certainly going to be interesting to see what route they go down now.”