Molotov cocktails were hurled at the four locations last night, with bombs damaging property but no serious injuries were reported.
The attacks took place in Queens area in which unidentified assailants threw homemade firebombs at a house used for Hindu worship services, Islamic centre Imam Al-Khoei Foundation, a home and a convenience store.
Police, who are yet to make any arrest, have released a sketch of a suspect caught on a surveillance camera at the Hindu temple.
The suspect is described as a 25-30 year old black man, 5 feet 8 inches tall, weighing 200 pounds and wearing a black jacket and a baseball cap.
A videotape has also been released showing a suspect appearing suddenly to lift his right arm to hurl a lit objective that strikes the temple and explodes in flames.
The New York Times quoted Ramesh Maharaj, 62, a Hindu priest who resides in the temple premises, as saying that he rushed from his bed to lawns to find the explosive burning harmlessly.
"The intention from the behaviour of the guy was to do destruction," Maharaj said.
Later, the entrance to the globally prominent Imam Al-Khoei Foundation was also hit by molotov cocktails while 100 people were inside.
Both the local Hindu and Islamic community leaders have said they were not afraid of such attacks.
New York Mayor Michael Bloomberg called the attacks unacceptable and said authorities are investigating the incidents.
"No matter what the motivation was of the individual who threw Molotov cocktails in Queens last night, his actions stand in stark contrast to the New York City of today that we've built together," he said in a statement.
Governor Andrew Cuomo said such attacks have no place in "our open and inclusive society and we must do all we can to ensure New York remains a safe and tolerant place for all."
Bloomberg said personnel from the New York Police Department's Hate Crimes Unit and detective squad are "moving at full steam" to investigate and also determine if there are any connections to incidents outside New York City.
A Fire Department official said the attacks damaged property but no one was injured.
Police said in three of the four attacks, Molotov cocktails were made using Starbucks bottles.
The Imam Al-Khoei Foundation has one of the most prominent Shia mosques in New York.
Police, who are investigating the attacks as hate crime, said callers informed them that they saw the assailants fleeing the scenes after hurling the firebombs.
They were looking at surveillance videos obtained from the bodega and one of the houses that were attacked.
The Islamic centre said on its website that two firebombs were "hurled at the main entrance" but "no major damage, no injury was caused by the blast."
It said the foundation "reiterates its resolve to continue to serve the community and to strive to bring love where there is hatred, light where there is darkness and enlightenment where there is ignorance."