The First Minister rejected calls from both Scottish Labour and the Conservatives to dimiss Mr Gray from his post.