It could be as simple as an energy tradeoff. Our brains already consume a significant fraction of our daily calories, having them work harder might not improve our reproduction results sufficiently to balance the increased risk of starvation.