Plugins can add controls and it can download videos, but plugins can’t interact with videos directly I think.
Maybe use the Youtube API closed captions and figure out the patterns for ads that way?
Of course they can interact with it just fine, look at “sponsorblock” plug-in. It would also solve this problem completely. It already exists and works well, it just isn’t “AI” nonsense.
You are missing the point that sponsorblock only works without AI because everyone gets the same video delivered. Once they have targeted ads of variable length and amount you need someone to watch your specific version of the video and do the tagging where the ads ans sponsors are. You could pay someone to do it for you but that is expensive and very slow. Or you can train a ML model to recognize the patterns and tag it for you hopefully pretty fast.
Yes, that is adding controls and using a database from the SponsorBlock server.
What I mean is a plugin cannot see the video. Like you can’t write
if(screen == adScreen) {
then skipToNextSegment();
}
The plugin isn’t reading the video, it is getting info from a database. For AI or machine learning to work ad injection, which might change for every user, doing what SponsorBlock is doing is not enough.
