I played around with the vocaloid software a few years ago and that shit is fucking complicated.
It’s not just dragging a midi file in and hitting play, you have to hand sculpt every syllable and every fricative throughout the entire performance. It can take literal days when you account for all of the backing tracks and everything else.
Add in synchronizing that to a video and doing all of the mocap and digital effects compositing for that fuck that noise.
I’ve done some very basic shit with vocaloid 6, UTAU/OpenUTAU, and DeepVocal and they’re definitely something above my pay grade in terms of difficulty.
I’ve never managed to get a single song out because of tuning the voice and getting the lyrics/timing/note pitch just right. It’s fun but not for the average person who will just give up after a while, like me.
