The Prime Minister also added he "would like to reduce the average age of his Cabinet".
When asked about ministers landing in controversies, he said "I can't say that I will be able to shut up every colleague in my cabinet."
Home Minister P Chidambaram, who was targeted by his own party, including Digvijaya Singh and Janardhan Dwivedi, got a vote of confidence from the PM. He "is doing an exceedingly good job and "he has my full confidence and support", Dr Singh said.
Singh also reacted to a Supreme Court order on distributing free grain to the poor, saying the courts should not get into policy formulation.