I’d like to swap my spinning disks with SSD drives. I have the new disks and they’re just larger than the old ones. My configuration is a RAID-5 with 3 disks (and one hot spare). Can I hot swap a single disk (HDD to SSD), wait for the new disk to rebuild, then repeat?
I’m thinking that I’d mark down the hot spare, replace it with an SSD, mark the SSD as hot spare, mark HDD 1 as “bad” causing the hot spare to activate, then repeat for the other 2 HDDs. I don’t have a lot of experience with RAID, but did perform a single disk swap once with success.
If this is a bad idea, why? What’s the best way to upgrade?
I’m not sure if this is the right community for this question. If not, please guide me to the right one.
First thing, back up your data in case something goes south.
With that out of the way, I have done this exact thing many times with both zfs and an array managed by mdadm. Depending on the filesystem on top of your raid array, there may be some additional commands you’ll need to run to extend your partition to use all of the available space in your larger array. You do have to wait between each disk swap to wait for the array to rebuild so it might be quicker to just make a backup, remove the old drives, and build a new array with your new drives and then copy the data back over. That being said, it is fun to hot swap all of those disks and not lose any data or have downtime assuming everything goes smoothly.
Yes, it’s a bad idea to do it this way. The most likely time a RAID array will fail is during a rebuild as that is a whole bunch of drive activity over a sustained timeframe.
Better to perform a backup or copy, power down, remove all the old drives, install the new ones, power back up, configure a new array (most people recommend to use RAID 6 at a minimum, no hot spare, so you have two drive redundancy) then restore or copy back the data.
This way you can also keep the old drives as a cold backup of sorts, potentially reimporting the configuration if needed.
The safest way is to make a backup and restore it to the new array.
Your way sounds pretty fun though. I’m sure the firmware will complain, but once you have a solid backup you can go nuts!
Also consider a solution such as Bachefs - RAID is cool and all, but this will get you most of the way there too. (Decide on the data safety for yourself but I’m running a 90tb pool with 24tb of metadata / cache on SSD)
Do you really need the RAID online all the time? Because if you can afford to shut it down for a few hours, it is way less work to do a backup, and then build a new RAID with your SSDs.
I’m not sure if the RAID controller will like two different kind of drives. I’d check the docs if it says something.
You might also want to check that your controller really supports hot-swapping. Not all do.
