You're making the assumption that the change in absolute terms is entirely driven by deficient additions to the population. It's just as possible that some portion of the population lost their skill by allowing it to atrophy from underuse.