For "3D" video should have initially of stereoscopic content, i.e. the material shot with two cameras for left and right eyes. The only way.
Alternatively, it is possible to achieve the "simulated" depth spec. algorithms that movement in the picture trying to "guess" where an object is and simulate depth. But the quality of such 3D video is even worse than the original 2D since the depth of the "sails" and only worsens the viewing experience.
Under the "VR" video usually refers to panoramic 360° video, sometimes stereoscopic ("3D") video. Well, there are also - need initially the content relevant.