Darbari, who is the Joint Director General of the OC and considered to be close to Kalmadi, is being investigated in a six-month-old customs duty evasion case.
He is also accused in the Queen's Baton Relay controversy in which a large sum of money was paid to AM Films by the organizers of the Commonwealth Games.
An inquiry is currently advancing against him for allegedly smuggling a diamond from Dubai.
Darbari, who heads the OC's revenue and marketing units, is considered to be the second most powerful man in the Organizing Committee after Chief Suresh Kalmadi.
Kalmadi, however, earlier stated that action would be taken on Darbari after he receives notice from the Sports Ministry.
"I would strongly advise you that T S Darbari should be immediately relieved of all their duties in the OC," related Sports Secretary to Kalmadi in his letter.