The former CWG Joint Director had been asked to hand over charge to Additional Director General V K Saxena.
Sports Ministry ordered CWG OC to terminate Darbari long back and it aroused the issue again on Aug 6 as his presence is spoiling the image of CWG.
An inquiry, against Darbari, is processing in alleged corruption during the Queen's Baton Relay's launch in London.
According to OC chairman Suresh Kalmadi, Darbari oversaw the QBR preparations in London, which became the focal point of a corruption storm.
He also added that the controversy was followed by revelations that a little-known UK-based firm A M Films was paid lakhs of pounds for its "services" during the event.
But Times of India had claimed on Aug 9 that Kalmadi also were aware of the workings of A M Films and he himself had cleared the bill of the organization.