The leaders accused Jagan, a Christian by religion, of disrupting the sanctity of the Temple.
"If the government fails to take action against him, I will sit on silent protest at the temple," said V Hanumatha Rao, Congress leader and Rajya Sabha member, who set a one week deadline for action against Jagan.
"He is displaying his arrogance even before the God," he said.
P Sudhakar Reddy, Congress leader and legislator has demanded the government and Tirumala Tirupati Devasthanam (TTD) to order a probe into the matter.
Jagan who visited Tirupati on Wednesday refused to sign the register declaring faith in Lord Balaji kept for Non-Hindus.
According to Jagan, his father and former Chief Minister of Andhra Pradesh, late YS Rajasekhara Reddy signed the register in 2009 and hence there was no need for him to sign the register.
S Chandramohan Reddy, TDP leader blamed Jagan saying that he did not have any respect for any religion.