C++ video handling

What is the easiest method for reading in the raw data (raw RGB image data for each frame) from a video file, in C++.

I really would appreciate some good detailed responses, or helpful links. I intend to manipulate the data using inline assembly.

I am using microsoft visual C++ 2010 express.

If you want to manipulate the frame, OpenCV is a good tool. Here you have a pointer to read video.

You could use DirectShow for this purpose. There are many add-ons available to help you render most of the video formats. It also supports rendering images from webcams AFAIK. The other alternative would be to use MediaFoundation SDK that comes with Windows SDK 7.0. MediaFoundation SDK will supersede DirectShow in future.