Google will no longer back up the Internet: Cached webpages are dead. Google Search will no longer make site backups while crawling the web.::Google Search will no longer make site backups while crawling the web.

59 points

To be clear, Google will still be storing copies of the pages they crawl. They just won’t be making those copies available to end users.

permalink
report
reply
8 points

Absolutely. This is just locking off users access and is an example of enshittification. 0 benefit to users but benefits to Google (more click through to sponsored links, and blocking AI content crawlers probably)

permalink
report
parent
reply
46 points

Internet Archive busy at it.

permalink
report
reply
16 points

And Kagi search results have additional links to archived versions. It’s very useful.

permalink
report
parent
reply
26 points
*

Does anyone else remember growing up being told “watch what you put on the internet! it’ll be there forever!” Now it seems more and more like things out on the internet won’t be there forever unless someone specifically wants it to. I seem to having a harder and harder time digging up parts of the internet i remember from my childhood, the old parts are slowly being erased by entropy and lack of desire to keep them there.

permalink
report
reply
10 points

The internet has selective amnesia

permalink
report
parent
reply
5 points
*

I mean sure, searches are basically useless now and the internet is filled with ai and seo garbage, but most everything is also still out there /somewhere/, even if it may only be in like the archive of the NSA. Plus when ai gets a bit better certain people will probably be able to link everything you’ve ever said to your “advertising profile” (Google basically already does this). Plus I’ve been saying for years that soon enough there’ll be a facial recognition crawler app where you upload a photo of someone and it shows you every picture they’ve ever appeared in. Although with how good deep fakes are now this is arguably less concerning.

permalink
report
parent
reply
2 points

I’ve been wondering for a while now if we’re even getting real results or if the seo results have made crawlers (as we know it) largely redundant. I doubt google has any real incentive to move away from the model that is now in place, unless they do intend to launch a paid service (free from the above mentioned garbage) alongside the existing service should competitors like kagi present a real threat to their business.

permalink
report
parent
reply
18 points

Lemme guess… they are worried companies are using it to train ai, so better close it off so they control access to it

permalink
report
reply
2 points

Maybe, but it also kills one of the better paywall avoidance methods

permalink
report
parent
reply
6 points

This is the best summary I could come up with:


Google Search’s “cached” links have long been an alternative way to load a website that was down or had changed, but now the company is killing them off.

The feature has been appearing and disappearing for some people since December, and currently, we don’t see any cache links in Google Search.

Cached links used to live under the drop-down menu next to every search result on Google’s page.

As the Google web crawler scoured the Internet for new and updated webpages, it would also save a copy of whatever it was seeing.

That quickly led to Google having a backup of basically the entire Internet, using what was probably an uncountable number of petabytes of data.

In 2020, Google switched to mobile-by-default, so for instance, if you visit that cached Ars link from earlier, you get the mobile site.


The original article contains 438 words, the summary contains 139 words. Saved 68%. I’m a bot and I’m open source!

permalink
report
reply

Technology

!technology@lemmy.world

Create post

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


Community stats

  • 18K

    Monthly active users

  • 12K

    Posts

  • 541K

    Comments