Richard and Michael have been fighting a legal battle with Fernandes' wife for custody of the ailing former defence minister.
The two brothers had approached the Delhi High Court on Jun 9 for early disposal of the case in view of Fernandes' deteriorating condition.
Both brothers accompanied by Jaya Jaitley, Fernandes' close friend, had come to the 3-Krishna Menon Marg residence to collect books, furniture and paintings which they claimed belonged to them on Jun 30.
However, they were stopped by police from entering the residence as the caretaker of the house S D Singh restricted them to enter into the house.
"These people are defaming the legacy of Fernandes who never closed his doors to anybody," said Jaitley.
She said she had come to collect some paintings and furnitures with the approval of Leila Kabir but was stopped from going inside.
At the same time Jaitley acknowledged that Fernandes' wife did not agree to her claims on the furniture.
However, Singh said he had no objection in Jaitley coming inside but she should not be accompanied by the brothers.
Although the brothers got permission from the court to meet Fernandes, who is presently staying in Panchsheel Park with Kabir, on certain conditions.
"After meeting George this morning, we came here to collect some books and family photographs but we have been denied entry. It is highly objectionable. This is being done at the instance of Kabir," said the brothers.
Over a dozen policemen rushed near the residence soon after the arguments.
Police, however, refused to comment on the issue.