The party also expressed displeasure over the "mujrewala" remark which was reportedly made by Shah against Haryana Chief Minister Bhupinder Singh Hooda during campaigning for the upcoming Assembly polls in the state.
"We cannot advise the president of BJP as to what company he should keep... (But) there is an old saying, birds of a feather flock together," party spokesperson Anand Sharma told reporters in reaction to the matter of Yadav joining Shah during campaigning in Haryana.
Almost a decade after he was thrown out by BJP over his controversial background, Yadav was seen sharing the dais with Shah on Monday.
Yadav had accompanied Shah to three places in Haryana to canvass for votes for BJP candidates ahead of the Oct. 15 Assembly elections.
On the issue of Shah's remarks directed at the Haryana Chief Minister, Sharma reacted sharply, saying, "I cannot respond to Shah by descending to his level and language. It is not possible for me to communicate in his language."
Shah's 'mujrewala' barb reportedly came at a rally in Hisar where he said that the Haryana chief minister has been dancing to the tune of the Congress high command in Delhi in order to save his chair.