"Pakistan is our neighbour and we want good relations with all our neighbours," Rajnath Singh said, responding to a media query on the repeated ceasefire violations by Pakistan.
"But the Pakistan government should also take initiative so that ceasefire violations do not take place," he added.
The home minister's comments come in the wake of Pakistani shelling along the international boundary in Jammu and Kashmir's Samba and Kathua districts that left at least six people injured.
Rajnath Singh said Prime Minister Narendra Modi shook hands with his Pakistani counterpart Nawaz Sharif during his oath-taking ceremony in May last year and conveyed that "we not only want to shake hands, but also want deeper ties".
"Despite that, why does Pakistan always violate the ceasefire," he asked.