Fucking do it. Anything that takes down Nvidia’s CUDA Monopoly has my full support.
As a general rule, don’t use a corporation’s language. Languages, and their reference implementation, should be truly independent.
Edit: To be clear, programming language.
Corporation? I’m not anti business, far from it. But I have an interest in economics as well as technology. We need effective markets. CUDA is an example of a market problem caused by a corporation’s own language. It has screwed up competition.
Squish them like bug. Show me you can do it, AMD.
AMD seems to be doing great: https://seekingalpha.com/article/4718576-amd-stock-ai-accelerators-drive-revenue-and-margin-outlook-upgrade-buy
Down 6% YTD and a market cap of 1/12 of their only competitor isn’t “doing great.”
Anything to help them take on Nvidia and stay competitive is a good move. However, I wish they would also announce a recommitment to driver and software stability. I had to move to Nvidia for my workstation rig after having constant stability issues with numerous AMD cards across multiple builds. I can handle a few rough edges or performance that isn’t top-of-the-line but I can’t put up with constant crashes ad driver timeout errors. It’s annoying in games and devastating when I’m working.
I wish their GPU line received even a portion of the polish and care that their CPU line did.
As a Linux user, I had to trade in my Nvidia laptop for one with an AMD GPU due to how unstable the Nvidia drivers were and how many problems they were giving me. With the AMD laptop, I have had zero issues.
I did the same move for similar reasons! Although I still keep windows around on another SSS - and even the Windows Nvidia drivers were being funky for me.
Nvidia shares a lot of logic between their Windows and Linux driver as far as I’m aware, so I suppose it makes sense.
Damn, I’ve had the exact opposite experience. I had to move away from a 1080 Ti that I was having constant instability with, even after I went back to the retailer and got a new card.
Unfortunately at the time, AMD didn’t have anything performance competitive. But it was worth the downgrade for the better drivers.
I had to move away from a 1080 Ti that I was having constant instability with, even after I went back to the retailer and got a new card.
Was it the card or was it something else? Any chance you have a 13th or 14th gen Intel CPU?
The annoying part is their drivers are stable…sometimes.
Its an endless game of seeing if any specific version is broken in a way that annoys you and rolling back if you find an issue.
Not exactly a premium experience.
Even on Linux where their drivers are supposed to be better, my 7900XTX has been crashing randomly for at least a month and it was only fixed in the latest 6.10.9 kernel release yesterday.
Yeah I’ve heard the ‘AMD drivers are better!’ thing for Linux and have always been confused since I’ve had no issues with nVidia cards on Linux or Windows related to driver issues.
AMD stuff on the other hand, has been a mess non stop, except for my ROG Ally for some reason which is fine?
In short: computers suck and are unpredictable, or something.
This checks out after what they recently did to the ZLUDA project. As an owner of an AMD gpu I agree that ROCM support is really bad. It works half of the time and fairly poorly.
Even worse on Linux. Even worse on more exotic distros like Bazzite where I still can’t get koboldcpp to run, which was already kind of a hassle on my previous distro.
Yeah I hear ya. How do you happen to be running it? I use NixOS and its a challenge there for me but I found atleast some success using docker since the dependencies are so out of control for AI at the moment.
Also give Ollama-rocm + Open Webgui a shot as an alternative to koboldcpp if you cant get atleast some text generation to work because that is the only thing I have got working with rocm.
The trick to nixos, in this instance, is to use a python venv. Python dependencies are fickle and nasty in the first place, triply so when talking about fast-churning AI code, I tried specifying everything with nix, I succeeded, and then you have random comfyui plugins assuming they can get a writeable location by constructing a path from comfyui’s main.py. It’s not worth it: Let python be the only dependency you feed in, let pip and general python jank do the rest.
At the moment I just don’t. I got kobolcpp to run through distrobox / boxbuddy but I can’t get it to compile with rocm, so I can only use CPU generation, which is abysmally slow. Might go back to NovelAI when they release their new model if I can’t find a solution.
CDNA is actually DNA made using RNA as a template. Very important for the viral ecosystem.
