The University of Toronto working on the concept of Direct Manipulation through video player Dimp.

It enable you to drag things on the video screen to move the video back and forth rather than just using scroll bar. You can drag the video areas without changing the outcome , watch the video here.