Never had the PS Vita. But I had the normal PSP Slim which was an amazing handheld!
I’ve recently started playing on my PSP slim again, it’s a neat wee device especially when loaded up with 32gb of games, a 12ish hour internal battery, and a USB-C port so I can charge it with the same cable as my phone!
Had a ton of great first-party releases back in the day, it emulates everything up to the PS1 and some DOS games like Fallout pretty well, and the homebrew scene is still quite active - the CFW/launcher I use gets new features every few weeks and a few of the games like NZ:P still have regular updates.