> Is Google just not able to compete with SEO tactics? Or are they over-excited about/reliant on ML/"AI" techniques that don't work well in practice?

Those SEO'd pages are optimized for generating revenue, so they're packed to the brim with Google ads and referral links.

Prioritizing such pages generates revenue for Google, too.