Initially there was a difference for me, but now I can switch from one to another without a problem if I need to work on laptop keyboard for some reason.

Hi, I have only tried using joystick as mouse and improve that. While doing this I found one suggestion how to do what you are looking for here: https://www.reddit.com/r/olkb/comments/vgo39f/qmk_simple_question_is_it_possible_to_use/

You might find this interesting as well: https://github.com/qmk/qmk_firmware/blob/master/docs/feature_pointing_device.md#advanced-drag-scroll

BTW, are you creating custom keyboard (your own) or you just chosen something with joystick?

I did that almost one year ago https://blog.ffff.lt/posts/morsilka/ . Anyone can do it as code is available :-)

Still your keyboard has two times more buttons than the one I have created https://blog.ffff.lt/posts/morsilka/ . On serious note, I like screen in your keyboard.