Ruling party was deeply unpopular but threat of US tariffs combined with prospect of new leader spurs rise in polls