The Congress however termed his remarks "shameful"
Calling the Samajwadi Party supremo and his son Akhilesh as "bechare (helpless)", Gaur said: "What can Mulayam and Akhilesh do (to prevent rapes)?"
Talking to reporters, Gaur said that "rapes happen when a man loses his mental balance."
Mulayam Singh Wednesday courted controversy after he told reporters, who sought his comments on the Badaun rape case, to focus on doing their jobs. His remarks came after his son told reporters earlier that they should "Google" search the number of rapes happening elsewhere in the country and stop focusing on Uttar Pradesh.
Two minor girls were gang raped and hanged from a tree in a village in the Uttar Pradesh district, leading to widespread criticism of the state government over crime and violence against women.
Terming rape "a human perversion", Gaur said: "No one informs others before committing a rape, so that he can be apprehended. We can prevent someone (from driving) without a helmet on the streets to prevent accidents. There is no info about a potential rapist. It happens in an isolated area."
He added that "if a rape is committed and there is a report, then we can take action on it".
Gaur advised women to take up "Judo-Karate" in order to defend themselves.
Congress spokesperson Shobha Ozha castigated Gaur for his remarks.
"In the last few days, the way atrocities on women have increased rapidly and the way irresponsible statements have been made by our leaders like Akhilesh Yadav, Mulayam Singh Yadav and Babulal Gaur, it is very shameful," Ozha told reporters.
"Rapes, gang rapes are increasing rapidly in the country. In the last few days we saw in Uttar Pradesh, from Badaun to Bareilly, either women are raped, or gang raped, and afterwards, constant irresponsible, insensitive statements by the government are embarrassing us," she added.
Ozha alleged that Madhya Pradesh had the first rank when it came to number of rapes committed in a state and that over 31,000 rapes and gang-rapes have been committed in the state in the last decade.
Taking Gaur on for suggesting women should take up "judo-karate" to protect themselves, Ozha asked "Who will give training to a three year old girl and an 80 year old woman?"