A group of prominent Victorian agents has sensationally quit one of the state's largest livestock businesses in a move that has blindsided the industry.