The Meta leak that changes everything. This is a must read article (no affiliation).
https://www.semianalysis.com/p/google-we-have-no-moat-and-neither
Wild that it’s mentioned multiple times in here how the large data sets aren’t really an advantage. Reminds me of Nate Silver’s The Signal and the Noise. Sounds like Google and OpenAI have a lot of noise right now.
Wow this is eye opening I had no idea the open source stuff was so good.
It’s not, this method of analysis is terrible, they’re just asking gpt4 to grade the responses, not actually testing anything beyond that.
That doesn’t necessarily invalidate the point they’re making. Other forms of analysis, strikingly, provide pretty much completely equivalent results.
Which one is the open source one? Llama?
I’d love to try to run this on my home server. For some reason, chatgpt always errors out in my from my windows computer. I’m not sure why. It works fine in Linux, Mac, and iPhone. But my work is on windows.
