One of the easiest ways to install Rails on Windows is by using RailsInstaller. It contains everything you need to create a new Rails application. You do not have to install the individual components separately.
The latest RailsInstaller is 3.4.0. Make sure you are using this version as it has fixed a few issues from previous releases.