What I find is that Google is now still better for what I usually search (a mix of programming, gaming and random factoids) compared to Bing or DDG, but no longer by such a wide margin as it used to.
Best as I can tell, it’s because in the past Google constantly tweaked the parameters of their scrapers and models, in turn leading to SEO constantly having to re- and re-optimize, and making it difficult to artificially push your spam and crap content high. They must have stopped doing this, leading to this steady rise of generated spammy content, and now Google feels a lot like other search engines in that i have to very actively discard 80%+ of the results including the whole first page.
(edit)
I recommend reading the actual paper. Interesting though Google has gotten worse, it’s results are still massively superior to the competition. 9% spam compared to 31% for DDG and 23% for Bing. Damn. That’s still a huge difference, shit as nearly-10%-spam is. I would however say its increased percentage of social media results (11% vs 6% respectively 5%) is bad, but eh, I guess there are users to genuinely want to see those results. 🤷
No but it’s my gut feeling, and it matches with the temporal progress in the paper. Cannot truly know of course, but it’s what I would suspect.
The converse is that SEO spam has become better at the game than google, despite google’s best efforts. It’s a less comfortable thought because how could a bunch of unorganized distributed actors out compete the one of the world’s richest company at their bread and butter game. The alternative is that one of the world’s richest companies gave up playing their bread and butter game.
Per your edit, there might be a blind spot in the study. Consider when you’ve searched for a recipe, and the top result you find always starts with "My cousins showed up one day and I had to scramble to make something . . . ". A big story you don’t care about before you can get to what you want. That’s happening because Google is giving those kind of recipe posts a higher rank. Ironically, adding this human story to the post is there for the sake of robots, not people.
I wouldn’t classify posts like that as spam, exactly. I still find the recipe I want. But they do make the experience worse.
