The Calcutta High Court on Thursday declined to grant an interim stay on the West Bengal Assembly Speaker's decision to recognize rebel Trinamool Congress MLA Ritabrata Banerjee as the Leader of the Opposition.