The Central Government has ordered the Delhi Gymkhana Club, one of India's oldest and most exclusive social clubs, to vacate its 27.3-acre premises in Lutyens Delhi by June 5.