cross-posted from: https://feddit.de/post/5294605
Youtube, for so many years, was just too good. Yes, they changed the 5 star rating system to likes and dislikes and a few years later disabled dislikes altogether, but their algorithm mostly digs up interesting content and it just works for creators and viewers.
This might change soon. Their new strategy to disallow ad-blockers will frustrate a certain kind of viewer. Those who dislike surveillance and like open-source tech, those who use uBlock Origin and know why.
Just like a few years ago mastodon suddenly reached a certain kind of popularity, because twitter had their first big fuckup, maybe Peertube is next. It certainly is the most polished decentralized solution that doesn’t use a blockchain. Creators or fans could easily host their own videos, fans can watch it, without ads.
PeerTube will not replace youtube. it cannot compete in either scale or creator compensation.
i don’t think people realize just how insane your infrastructure has to be to handle 30,000 hours of video being uploaded every hour.
Taking some simple napkin math, I have a 1min 1080p video downloaded from YT. It clocks in at 15MB.
So, Gamer’s Nexus has 2.6k videos. (That’s insane, btw, but fairly large channel, not even LTT size though).
Assuming just 1080p, and let’s say about 10min average per video. (Some are less, some are 40+), that’s 150MB per 10min video, and that means it’s 390,000Mb (or 380.86GB) for their collection. Assuming I’m wrong and the average is even half of that, and the average GN video is only 5 minutes that’s still 190GB. And that isn’t counting 4k, or the multiple other formats to optimize streaming (720, 480, 360, misc bitrates, etc)
And that’s just storage, not even taking into account compute! (Or egress, or transcriptions, or scaling, or…)
Really for something like Peertube to take off it will require each channel to spin up their own instance, which honestly is just another expense for them, one that Youtube does for them for free, plus Youtube offers to pay them. Which, would cut down on some of the chaff (only people who want to do it would do it), but yeah, I don’t think it’s going to replace YT at any point. Smaller channels can combine for sure, but there is definitely a threshold where it becomes extremely costly.
I’m all for the fediverse, but video streaming is freaking costly and expensive. There’s definitely a reason youtube has a monopoly on it. Now this isn’t to discourage, but more for anyone who may be thinking "yeah why doesn’t peertube just replace it?)
150MB per 10min video, and that means it’s 390,000Mb (or 380.86TB) for their collection.
Your overall point is fair, but your math here is off by a factor of 1000 - it would be around 380 GB.
It could be done if peertube used a scheme like BitTorrent. We are approaching a time where enough users have sufficient upstream bandwidth for video.
But then, even without hosting costs, creating videos takes much more time and effort than writing a short text.
Peertube does allow downloading from peers like bittorrent. But you still need to host the whole video, it only would alleviate data transfer. And I don’t think you’d want to not host the video and rely entirely on people sharing your video and continuing to seed it for it to be available. So for running a channel or sharing videos that you have produced you will still need to host the files somewhere.
This is something PeerTube already does. Viewers of a video will be a peer and so can other PeerTube servers also be for each others videos.
Bandwidth isn’t the biggest issue. Storage is. The video need to be stored somewhere and storage is expensive.
We need something like Siacoin, that’s easy to use and easy to donate or sell cheap storage.
Nice idea, but then everytime a video that contains anything licensed by the content mafia is uploaded (even partly), the user in question breaks that license opening themselves up to lawsuits.
In a perfect world where only properly free content is shared that model would work. But that is not how most content shared on YouTube looks like.
You are vastly overestimating the amount of storage you need since you are looking at some download which itself has to choose the encoding (which is independent of whatever youtube does: youtube absolutely crushes the quality).
Most estimates assume that youtube has 1 exabyte of storage, let’s say we buy this in bulk from retail (which we wouldn’t do: you wait as long as possible since storage prices are going down and retail stores would give you the finger if you ordered and exabyte worth).
Let’s take that number and run with it:
Buying retail, you can get Seagate Exos X20 20TB drives for 280€, 1 exabyte is 1Mio terabyte, meaning we have 1_000_000/20 * 280 = 14 Mio € (you’d need machines to put those into but you also wouldn’t buy the entire thing upfront, and using retail prices either).
Compute also isn’t that big of a deal if you do it correctly: the expensive part in video hosting is usually video encoding since to get small video sizes you need to spend compute beforehand to compress it.
However, you can shift this in significant parts to the user by implementing the transcoding in WASM and running this clientside (see e.g. https://www.w3.org/2021/03/media-production-workshop/talks/qiang-fu-video-transcoding.html) in that case users would compress locally in the browser before uploading (this presumably wouldn’t even take longer than normal uploads for most people since you trade off transcoding time against upload time).
There are still other compute expenses but those are much more limited.
These mechanisms don’t (at least to my knowledge) exist in peertube yet, but would be possible.
The actually expensive part is always the actual networking: Networking is one of the few things that actually get more expensive at scale due to the complexity explosion, rather than cheaper (e.g. having dedicated transcoding hardware drops in price per user since you have higher utilization).
Networking quickly runs into bottlenecks where you have to account for all the covariances between datasets in the network.
Basically to increase the amount of e.g. storage available everything in the network needs to be increased (from the local machines connections, over the cables and switches up to routers and outgoing connections) due to you increasing the density at one point, you have to increase the network everywhere.
That’s why networking dwarfs everything: you just get crushed by networking being the bottleneck between your increasingly dense devices.
The clue behind peertube is that this is not as extreme of an effect due to
- federation (certain connections just aren’t dense due to the overall network topology being distributed)
- torrents
The latter is the important part: instead of having network cost rising (super) linearly to the amount of users you have it rise linearly to the amount of simultaneous unique videos.
This is a much smaller number which means you do not need to compete in that space, which is the dominant cost factor. (if you have a method where one user can retain the video and share it without actively watching that same video, you can probably get real-world sublinear scaling)
Mind you, the costs involved here are still large, but not insurmountably large, especially considering there is not one unique organisation that would have to pay for the entire thing and its not an upfront expense. Fundamentally though the system is built such that it won’t be crushed as users flood into the network.
Yeah, storage and bandwidth are massive considerations and there’s no way Peertube can handle it. And each channel running their own instance actually makes it worse, since you’re going to have smaller entities who can’t take advantage of deals that larger companies can make for hardware, data centers, bandwidth, etc. Plus, if you’re having to run your own instance to have a channel, then you’re not just focusing on creating videos for the channel, now you’re also a system architect, sysadmin, etc. It makes it a massive barrier to entry, and one that only tech enthusiasts will even consider tackling.
But even say that happens: a bunch of people running their own instances for their channel. Where are they hosting it? Are they purchasing their own hardware? Running their own data centers? They’re most certainly not running it out of their home. The overhead for that kind of operation is massive. What you’ll end up with is a bunch of people running their instances on AWS or some other PaaS provider. And then you’re right back to the problem you’re trying to solve with a distributed service: that the service is consolidated on one platform (even if it doesn’t appear that way to the end user). Sure, AWS et al aren’t dictating the terms of service for your Peertube instance, but the instance is dependent on that platform.
On top of all that, you have the issue of monetization. How are you going to make money from your channel? Peertube doesn’t have the kind of infrastructure of advertising etc. that YT has.
You also have another massive issue: legal. YT spent over a decade going through the courts with the MPAA, RIAA, et al fighting about copyright issues. Google has massive amounts of money and was able to weather that fight. But it’s competitors didn’t. Which is why you don’t have Vimeo stars, for example.
Running a YT channel is a massive time, energy, and money sink. Add all of these other considerations to it, and it’s an impossible task. It’s hard to think someone would could see PT as a viable alternative. Google destroyed all of the competition (or let attrition do it for them), and pulled the ladder up behind them.
I didn’t even think about the personal risk, which I do know because I run a lemmy instance. You hit the nail on the head, I either see it as:
- Individual creators host their own, where they can host all they want, but there is no money to be made, in fact there is only money to be lost, so it’d end up being an insane amount of ads and sponsored content
- Group servers like we have, but they’re only good until a tipping point to be honest, if they started getting a fraction of youtube content we’ll see them lock down uploads, and most will shut down if they get hit by one of the acronym agencies.
I love the fediverse, but I was a professional in the video world too, and video is heavy. Everything about it is crazy, take all the scaling problems and quadruple them. I hope peertube can find something that works
380 GB in storage for multiple years of contents is really not much. I archive that amount every 2 months.
The real problem is serving all that content to the viewers, and the first bottleneck is usually the upload bandwidth.
I think the more interesting number would be to know how much data would it be to upload an average sized video to every viewer of it.
Using your example of a 15 MB video, serving that to 300.000 viewers means uploading roughly 4,5 TB data, plus some for technical data (TCP/IP and HTTP headers and such). For every (average) video! Now that’s a lot!
Fortunately PeerTube helps with that: viewers will automatically upload their downloaded chunks of the video to the others currently viewing it, so in the end the server needs somewhat less bandwidth usage.
Other than that, it would be the perfect place where channels could team up to host shared instances for themselves, or every channel their own one but with redundancy set up, so that their friend channels could also chip in with the bandwidth when needed.
Who said it needs to compete in scale as a single entity? PeerTube was never planned to be run by a single large provider
PeerTube will be a real competitor to YouTube when the Year of the Linux Desktop happens.
Well, that’s perfect, because that’s going to be [insert next calendar year here].
I feel like all of these fediverse platforms are going to suffer from the same issue.
I searched up peertube and clicked on the peertube link. No where was there a “recommend videos” feed or “upload videos” or “create account” and the first link to a peertube platform is a cliche “rebellion” something or other.
These things will never see mass adoption if they aren’t approachable to the casual browser. It sucks, but the average user would rather give their data to Google or watch 25sec of ads before each video then try to figure out fediverse. Especially since when you do figure it out, there isn’t any good content yet.
- diode.zone
- tilvids.com
- conf.tube
- cliptube.org
- media.privacyinternational.org
- makertube.net
- video.blender.org
- vidcommons.org
- share.tube
Just to name a few I think have nice videos right on their start page.
You can only make it so easy… If you want a centralistic platform with algorithmic recommendations, use YouTube… Emancipating oneself is work. But I’d agree onboarding for new users could and should be easier.
You don’t need a centralized platform to have recommendations.
You just let users choose some tags and go from there. Each server will surface different videos, but if they all pull from everyone they’re federated with it would be a lot more accessible pretty quickly. And let users opt in/out of watch history tracking to feed their suggestions.
It won’t have the potential YouTube does, but YouTube’s so compromised on intent that it could easily be better in practice if content availability were the same (which is obviously way off).
I’m not sure if Peertube perhaps already does that. There are tags to a video and it shows related videos. But I don’t know how it calculates that.
I don’t think Peertube stores interests of the users, yet. That would be a possible solution. But it also requires the user to put something in or some tracking of their activity.
Edit: Misunderstood you, corrected my comment.
If you have a bunch of people guess how many M&M’s are in a jar you can average the guesses and you’ll come very close to the correct amount. A recommendation system can be very democratic in that way. When reddit still had their public API I would take advantage of this fact and use it to decide if something was a “deal” or not on PC parts. I was tracking the prices of computer ram at the time as an experiment. It worked very well. If they are federated properly, then their content can be filtered and appear on an instances front page.
I replicated your experiment. Top link seaching for peertube is https://peertube.tv/videos/
There are at least videos listed. But they are 80% by the same channel and mostly about cars/EVs with a few other tech things. Immediately i think “this is for a certain type of person” and that aint me.
They really need to mix up their front page to show some sort of diversity. Should not repeat the same creator over and over again. Surely there are 10-15 people on all of pt that could be highlighted.
No, because:
-
Content creators want to monetize their videos, even if it is shit monetization.
-
Users and content creators want discoverability.
They can monetize their videos on PeerTube, can’t they? It has built-in Liberapay support
I havent noticed any liberapay support on peertube channels. I can’t find any information on liberapay on peertube either, could you share some links?
Hmm, sorry, I have probably remembered it incorrectly.
I remember seeing a liberapay-yellow button below the bottom right of some videos, but now I can’t anything about it either.
It seems there’s no liberapay integration, however there’s a support button if the channel sets it up. It can show arbitrary text, like links to liberapay and similar.
Here’s an example, and mentioned in the FAQ here
peertube is never gonna be a replacement for youtube, it’s good as a “upload random stuff you made” platform but modern youtube is so detached from that
Mastodon might never replace twitter but it’s still a cool platform with a similar use case.
I guess it depends on what you use it for.
I have two use cases, personally.
-
How to videos for stuff I don’t know how to do. Like, fix a leaky spigot or something like that.
-
Following content creators.
I could see PeerTube being fine for #1, but I don’t see it ever being positioned as a viable option for those who want to generate reasonable profit for their content. Would be happy to be proven wrong though.
I think PeerTube could possibly work for streamer VOD channels, since a lot of them probably keep them locally for archival/backup purposes, anyway. I’ve seen people mention thar PT uses BitTorrent for streaming videos to other users – I think that could work for this particular purpose
