Obama said, he had no regret over his comments even though he was out of polls.
The poll found 37percent of Americans disapprove of Obama's comments supporting Muslims' and only 20percent approve.
Obama's support came from an unlikely source, former Bush administration Solicitor General Ted Olson, whose wife, Barbara, died on 9/11 on the hijacked plane that hit thePentagon.
"It may not make me popular with some people, but I think probably the President was right about this," Olson said on MSNBC.
New York Archbishop Timothy Dolan also said he liked the idea of Obama's concept.
Dolan recalled Jewish concerns when Carmelite nuns moved into a building near Auschwitz, the Nazi death camp, in 1984. Pope John Paul II interceded and asked the nuns to move, though a controversial cross remains.
"Keep the idea, move the address," Dolan said. "It worked there, might work here."