Pretty much the question. I heard about Usenet a while back but never managed to wrap my head around it.
I’ll try to give an ELI5 kind of answer here.
Before the Internet, “networks” were mostly one-offs you would dial into with a modem. Big or small, users would dial into the systems to enjoy whatever content was available on them.
The Internet was created as a way to connect multiple, disparate network nodes like these. Now, instead of just letting people access your content, you could now let them access other people’s content as well.
There were lots of programs made to do this. IRC for chatting, Archie and Gopher for searching FTP sites for downloads you might want. There was also Usenet - a threaded discussion forum. The discussions looked a lot like Lemmy - there were subject lines and when you clicked on them there was threaded discussion you could read and participate in.
When this was all initially going on the Internet was mostly text-based. We may have been accessing Usenet from our Windows 3.1 laptops (I used a program called Agent), but all these programs were doing was trading text. Slowly though, bandwidth started creeping up.
As bandwidth began to creep up, people realized that huge text posts to Usenet could be used to post things like photos encoded to text. And thus was uuencoding born - and it didn’t stop at photos. But because Usenet posts are limited in size, big files would get posted as multiple parchives - in multiple sections/posts that could be stitched back together into a whole again.
It was in this way that Usenet - a system designed for conversation - became a way to trade files.
Meanwhile the web happened. Discussion quickly moved to the web because you didn’t have to download a separate program to view web forums. At the time, web forums were inherently inferior (they couldn’t do threaded discussion) but they were also inherently superior (they could be moderated). Yeah, Usenet was unmoderated and because of this it was basically a huge pile of dogshit by the time the web got huge.
Usenet did continue to flourish though - as this sort of Frankenstein file-sharing system. The problem is that most Usenet servers were hosted by ISPs because they wanted to host discussions - not file-sharing. So they shut their Usenet servers down. But the file sharing was just too useful to die, so dedicated Usenet providers popped up and picked up the slack where the local ISPs left off. It wasn’t hard. Usenet is just a protocol - anybody can adhere to it and create a node.
And clients changed too - from the readers I used like Agent, to new readers that recognized that people using Usenet aren’t looking for discussion anymore. They’re looking for an easy way to find the files they want and a program that will seamlessly stitch together all those PAR files behind the scenes for them to get it.
This was the purpose behind Newzbin, which was an elaborate way to access the remaining Federation of (now mostly dedicated, paid) Usenet servers and easily find and download all they had to offer. It was super easy and worked very well, so naturally, it was fucked into oblivion by Hollywood in 2010.
The great thing about Usenet though, is you can’t kill it by killing off one node. The other great thing is that it’s pretty stupidly complicated by today’s standards, so it still exists because it’s been largely forgotten while Hollywood focuses on stuff like torrenting.
If you want to access Usenet, you will need to purchase access to a company that runs a Usenet server and get client software that can help you find and stitch together those PAR files. I am out of the loop, so I am afraid I cannot help you any further with that. But hopefully if you know the history of it and how it works in theory, it should help.
Bravo! Outstanding explanation. I got lost on like the second sentence though. If you have the time, can you also ELI5
dial into with a modem
It’s a common enough expression but what does it even mean?
Wow, this caught me off guard. I read an article about kids being given old tech and they knew people waved Polaroids (even though it doesn’t enhance development) from pop culture. Are young people really unaware that we used to dial with a modem to connect to the net?
No I meant do analog modems use tones to transmit information, or how does it work?
Like what is the process of “dial with a modem to connect to the net”.
Watch Wargames. The main character uses the Ethernet somewhat realistically compared to more modern “depictions” of “hackers,” and has to use an absolutely ancient modem to connect to the network.
That I can help. Back in the day, to access someone’s else computer you literally hooked up yours to a phone line. Your desktop would then dial to some number you got that had another computer listening to answer, and they would start a “conversation”. Your computer sent what to us would sound like noise, the receiving computer would listen to that noise and answer back. Voilá, you’re connected to a network!
So TLDR an older version of fredivesrse and activity pub but without moderation and all instances are premium ?
It’s funny seeing this thread with it’s descriptions written as if describing the traditions of some long-gone ancient civilization.
I mean it’s… checks math… over 30 years old. That is ancient in technology timeline.
It’s an old federated message board system. Message boards are called “newsgroups “. It predates the web so it’s usually accessed via a special client app. To use it you’d need:
- A Usenet client app, called a newsreader. See Wikipedia. Many are probably abandoned by now.
- An account with a Usenet provider. A search engine will point you to several options. There used to be some free ones. If there still are, it would be a good way to try it out. But note that the free ones often don’t carry all of the newsgroups — they omit the binary groups, which are known to carry pirated software and, let’s say, diverse video content.
It’s federated? Okay, that makes a lot more sense. I thought usenet providers were like isps, connecting to a single, central host or something. I didn’t realize they were federated systems.
It’s really neat to think of Usenet as ‘federated’ considering that’s a new term for most of us.
My preferred options are: Binsearch, astraweb, and newsbin
You get what you pay for, a bargain IMHO
If I recall correctly, ISPs were often running their own Usenet servers. This meant that traffic didn’t leave their networks and thus they paid less network interchange fees.
These days maybe only niche ISPs in some parts of the world might be running Usenet servers. Majority of them are run by specific companies created specifically for the purpose.
Heh. I used to run leafnode as my own, in house, single person server.
I’m quite surprised to find out it’s still alive and maintained.
I’d add to this and say you need:
A Usenet client such as SabNZBD (like qbittorrent or similar downloading client, but for Usenet)
A Usenet provider such as Astraweb, Newshosting, UsenetServer, Easynews, etc (or a paid subscription giving you access to a number of servers, kind of like a private torrent site)
And a tracker or indexer such as NZBGeek, NZB Finder, omgwtfnzbs, DrunkenSlug, etc (similar to a library index that helps you find what you want in the sea of information)
You can set services like these up with programs that use these tools to pull what you want automatically, such as the Arrs (Sonarr, Radarr, Lidarr, etc) or you can manually search either the provider directly through their own search engine, or through an indexer’s refined search engine.
Get a free account from https://www.eternal-september.org/.
Then in the desktop version of Thunderbird , “Add a newsgroup account” with your login details from eternal september.
Find some groups to subscribe to. Try comp.lang.python for example. Once you subscribe you can see the posts inside it.
You’ll probably see lots of spam. To remove the spam you need to use Thunderbirds Message Filters functionality - remove all messages where their Message-ID header contains “googlegroups”.
Not having any experience with this I find it hilarious that most of the spam comes from googlegroups
Heh, yeah.
Google does a great job stopping spam in Gmail so they could stop it if they wanted but… Just haven’t. Super lame.
Usenet is a decades-old distributed message sharing system. It’s like an old school message board. To access it, you need a newsreader. Mozilla Thunderbird is one such example.
I have not accessed newsgroups in several years, so I don’t know how active it is today. But it used to be the go-to source for “warez” and bootleg media and porn. Oh yeah, and discussions threads on myriad topics. :)
Slashdot, digg, Reddit, lemmy, 4chan, etc. are all spiritual descendents of usenet.
The software tech for usenet is old, slow, and has a learning curve. You might find it frustrating to navigate and use. However, modern newsreaders probably hide some of the complexity.
Usenet has its own protocol (NNTP) where digests of messages get passed from server to server, eventually making it out to all (or most) servers that host a particular group (like alt, sys, gov, etc.). In essence, it’s a federated digital bulletin board of bulletin boards. Many servers don’t participate in some groups such as alt.binary.*.
Usenet pre-dates the world wide web, and even pre-dates Gopher. It was designed such that a Usenet server could spend most of its time disconnected from the Internet and accumulate local posts that would then be federated in a digest when the server dialed up and connected to other servers.
The main NNTP network eventually made its way to a centralized web-accessible service and most places that used to provide an NNTP server (which was most ISPs in the 90s) eventually shut their servers down and only provided gateway and email services.
The protocol still exists though, and there’s still a small connected network.
In reality, Lemmy is the spiritual descendant of Usenet.
It was designed such that a Usenet server could spend most of its time disconnected from the Internet and accumulate local posts that would then be federated in a digest when the server dialed up and connected to other servers.
…Would this have been local posts of an individual, or sometimes a group in a LAN or something? The way you describe it here puts me in the mind of recent stuff like Scuttlebutt, albeit that’s more clearly individual-focused.
What’s scuttlebutt?
And no, not individual and not LAN. WAN. A Usenet server could easily service hundreds of folks if not thousands. It would collect all their posts and then aggregate upwards.