"We stand together to rebuff the stereotypes," Susan Lerner, New York director of the rights group Common Cause, told the crowd. "We reject the idea that any neighborhood in our great city is off limits to any particular group."
The rallies broke the taboo against politicizing of 9/11 anniversary and came against the idea of pastor Terry Jones' threat to burn the Koran if the mosque was not moved.
Protesters said that the attempt to prevent islamic culture near Ground Zero meant equating all Muslims with the terrorists in 9/11.
"The important thing here in New York is that it's not really about Ground Zero it's about the rising tide of Islamophobia. It's a form of racism that is suddenly OK," said Rebecca Vilkomerson, director of Jewish Voices for Peace.
After the 9/11 remembrance ceremonies, the rally will continue in support of mosque in Ground Zero, said the supporter.