It’s certainly a good way to hide a service from family/friends/flatmates but cannot be relied on for security on its own. Especially for SSH I see no real security benefit for it over just public key authentication, and the stated added complexity just makes it impractical in most cases.

I really cannot see a scenario (risk management-wise) where it is more than just a thing you set up for fun.