In 15 words: deep learning worked, got predictably better with scale, and we dedicated increasing resources to it.
Are you sure about that Sam? Because one, you’re the snake oil salesman writing this and I wouldn’t trust you as far as I can throw you, and two, yeah maybe it scales predictably but the prediction is that training the next generation for marginal improvement will cost an exponential 100 billion (and that is taking your Microsoft discount for compute into account). You’re hitting a wall hard and the profits are still not in sight. This avenue of progress is a dead end and Sam knows it, because OpenAI is selling PPU’s instead of stock and looking to Saudi investment. Don’t get stuck with the bag folks, the few thousand days Sam claims to need aren’t survivable.
First of all, you make a great point.
Second of all, that quote made me laugh out loud. “In 15 words”? Why is that even there? I saw Sam sitting there with Word open, cursor blinking at the end of his sentence about how deep learning worked, wondering how to make it more impactful. So he copies the sentence and pastes it into a chatgpt box and asks, “how can I make this hit differently?” and chatgpt, in all it’s gptness, responds: “try counting the number of words in the sentence and throwing that in front.”
