Exam results from areas which dropped English have declined, the education minister says, announcing the U-turn.