"This tragic incident is all the more distressing as it took place on the first day of the Holy Eid Al-Adha marking the end of the annual Haj season," Xinhua reported quoting a statement issued here by Ban's spokesman on Thursday.
The secretary-general also extended his sincere condolences to the families of the victims and expresses his sympathies to all the governments concerned, the statement added.
The stampede happened amid a rush of the stoning as part of Haj rituals on Thursday. Muslim pilgrims throw stones on a wall representing devil.
This was the second major incident involving massive casualties this month in Saudi Arabia.
On September 11, over 100 pilgrims were killed in a crane crash at Grand Mosque of Mecca.