It might be a chicken and egg type of problem, but for me it is more about content.
Right now it is mostly just games, but i actually don’t think that is enough to go mainstream. At least on the consumer side i think it needs more diverse content, like maybe live events like concerts and sport events, tours of special places and maybe even regular house viewings.
Actuallly thinking about it, the main issue might be that the content for VR needs to be specifically made. Smartphones for example could take advantage of already existing use cases (websites, mail, text/voice messages and so on). And additionally had more intersections with existing technology.