Gaming Performance - OpenGL
Moving on to OpenGL and Quake 4, we'll be able to see how well NVIDIA and AMD have done in building their own OpenGL ICD (installable client driver) for the API. This is more taxing on hardware vendors, because Microsoft's implementation of OpenGL is just a wrapper around DirectX. By default, unless an ICD is used, OpenGL applications cannot talk directly to the hardware.
We did have some issues with Quake 4 as well. We were unable to get the application to run stable with multi-core support enabled, so we tested without this option. Even on Windows XP we see much higher numbers during CPU limited testing with this option enabled, but we will have to do without for a while. It isn't clear whether this is a problem with the game, with Vista, or with OpenGL, but hopefully it will be resolved (preferably sooner rather than later).
As expected, OpenGL performance is much worse both in CPU limited and GPU limited cases. The reason the low end AMD cards look better off here is that their performance is simply bad across the board. NVIDIA seems to perform closer to XP in general here, and both companies are saying that performance will improve over time. GPU limited performance does seem to improve over CPU limited performance, indicating that driver overhead on the CPU is a major factor contributing to the reduced frame rates.
Now let's take a look at how Vista x64 compares. This will actually serve as a good test of how well NVIDIA and AMD have implemented their x86 and x64 versions of their OpenGL ICD as well.
Again, the low end AMD cards just look like they are doing better because they perform poorly in general. In CPU limited cases, x64 actually seems to perform better than under 32-bit Vista, and even GPU limited performance is very close between the Vista versions. This could indicate that AMD and NVIDIA's OpenGL ICDs benefit from 64-bit processing, even if the game itself does not. However, unlike Oblivion, the performance of Quake 4 in Windows Vista is substantially slower than under XP, sometimes as much as 30% slower.
Last up for Quake 4 is resolution scaling.
While it's very clear that XP is a better option for OpenGL apps right now, there are no real scaling surprises. The CPU performance/driver overhead seems to be a bigger factor in reduced Vista scores than the actual GPUs, as the scores tend to get closer in GPU limited situations.
Gaming Performance - x64
Finally, we have Half-Life 2: Lost Coast with its native 64-bit application running under Vista x64. Is it worth it? We're only providing resolution scaling results for this game.
Clearly the 64-bit application runs slower than the 32-bit, especially at CPU limited resolutions. Even the games we tested running under WoW in 32-bit mode on Vista x64 showed better performance parity with Vista x86 and Windows XP. While the resources are there to offer better performance with more registers and better memory management (especially on systems with more than 4GB of RAM), there is clearly something that's lacking here. It is likely that Valve has more work to do on their 64-bit Source engine, but we can't rule out Vista x64 as a factor altogether.
We had hoped to see better performance from a native 64-bit game, but it looks like we'll have to wait longer until game developers figure out how to capitalize on the extra resources available under Vista x64 without adversely affecting performance.
Moving on to OpenGL and Quake 4, we'll be able to see how well NVIDIA and AMD have done in building their own OpenGL ICD (installable client driver) for the API. This is more taxing on hardware vendors, because Microsoft's implementation of OpenGL is just a wrapper around DirectX. By default, unless an ICD is used, OpenGL applications cannot talk directly to the hardware.
We did have some issues with Quake 4 as well. We were unable to get the application to run stable with multi-core support enabled, so we tested without this option. Even on Windows XP we see much higher numbers during CPU limited testing with this option enabled, but we will have to do without for a while. It isn't clear whether this is a problem with the game, with Vista, or with OpenGL, but hopefully it will be resolved (preferably sooner rather than later).
As expected, OpenGL performance is much worse both in CPU limited and GPU limited cases. The reason the low end AMD cards look better off here is that their performance is simply bad across the board. NVIDIA seems to perform closer to XP in general here, and both companies are saying that performance will improve over time. GPU limited performance does seem to improve over CPU limited performance, indicating that driver overhead on the CPU is a major factor contributing to the reduced frame rates.
Now let's take a look at how Vista x64 compares. This will actually serve as a good test of how well NVIDIA and AMD have implemented their x86 and x64 versions of their OpenGL ICD as well.
Again, the low end AMD cards just look like they are doing better because they perform poorly in general. In CPU limited cases, x64 actually seems to perform better than under 32-bit Vista, and even GPU limited performance is very close between the Vista versions. This could indicate that AMD and NVIDIA's OpenGL ICDs benefit from 64-bit processing, even if the game itself does not. However, unlike Oblivion, the performance of Quake 4 in Windows Vista is substantially slower than under XP, sometimes as much as 30% slower.
Last up for Quake 4 is resolution scaling.
While it's very clear that XP is a better option for OpenGL apps right now, there are no real scaling surprises. The CPU performance/driver overhead seems to be a bigger factor in reduced Vista scores than the actual GPUs, as the scores tend to get closer in GPU limited situations.
Gaming Performance - x64
Finally, we have Half-Life 2: Lost Coast with its native 64-bit application running under Vista x64. Is it worth it? We're only providing resolution scaling results for this game.
Clearly the 64-bit application runs slower than the 32-bit, especially at CPU limited resolutions. Even the games we tested running under WoW in 32-bit mode on Vista x64 showed better performance parity with Vista x86 and Windows XP. While the resources are there to offer better performance with more registers and better memory management (especially on systems with more than 4GB of RAM), there is clearly something that's lacking here. It is likely that Valve has more work to do on their 64-bit Source engine, but we can't rule out Vista x64 as a factor altogether.
We had hoped to see better performance from a native 64-bit game, but it looks like we'll have to wait longer until game developers figure out how to capitalize on the extra resources available under Vista x64 without adversely affecting performance.
105 Comments
View All Comments
Zak - Thursday, February 1, 2007 - link
I've finally got around to installing RC2 last week: Dell Inspiron 2GHz CoreDuo, 2GB RAM, 7200RPM HD, 256 Nivdia video. Vista is slow, network transfers are 50% slower or so than in XP, GUI is sluggish and all the improvements are pretty annoying. Interface is too busy and overdone. A simple copy message contains a long unnecessary explanation of what's about to happen. Even after turning off the security features one can't escape the annoying popups and messages. And my hard drive was crunching non-stop all day, I can't even imagine what it does to battery life. I haven't had a virus or spyware in years and I don't see any compelling reasons to switch to Vista. I haven't even tried any multimedia features as none of my DVD and video playback software worked properly and I will not use WMP if my life depended on it, so I can't comment nt on DRM and stuff but I've had enough after few days and restored my XP image back to the laptop. If MS tries to force this on people as its, without major improvements, I see Apple and Linux getting lots of switchers. But them XP was bad at first too so maybe Vista will become usable with SP2:) I myself will desperately look for an alternative to Vista. I don't play games that much any more so this won't be "a must" for me.Z.
Zebo - Thursday, February 1, 2007 - link
I'm very afraid Zak. I will upgrade due to Microsoft forcing the issue on us gamers with dx10 vista only but with total dread. I may have to start listening to those console fans and linux fans after all. But the lack of TBS games kills consoles for me...SIGH..I totally agree with you about Virus and spy/malware issues. All are resolved or blocked with free third party apps many years now for anyone with the slightest clue. Same goes for Firewall/searching and other features MS lists on their "100 advantages" site. Vista is just late to the party with what we all know how to do and cripples your computer performance and makes everything so dumbed down visually and practically.
mlambert890 - Saturday, February 3, 2007 - link
You guys must be using a different OS. I havent heard of anyone with this dismal of an experience at all. If you hate the UI, just run it in legacy mode and it will look like XP. Disable all of the security add ins and they ARE gone. Ive take a Vista machine and set it up to the point that the person using it had no real clue it was Vista but did notice that their laptop seemed quicker.Have fun on Linux though. Linux is a LOT easier to use/live with than any MS OS! (I need an eyeroll smiley here)
jonp - Monday, February 5, 2007 - link
I would be interested to know if you have installed and worked with SUSE 10.2? as I assume your "...a LOT easier..." is sarcasm.kalrith - Thursday, February 1, 2007 - link
The second sentence of the third paragraph states, "The reason the low end AMD cards look better off here".I think you meant ATI instead of AMD.
kalrith - Thursday, February 1, 2007 - link
Another typo is in the last sentence on the first page. It says, "What's a question we hope to answer..." What's should be That's.JarredWalton - Friday, February 2, 2007 - link
Technically, ATI is now AMD, which is why we are now referring to the cards as AMD cards. Same thing as ATI, but since they were bought out.... :)kalrith - Friday, February 2, 2007 - link
You're right...I completely forgot about that.stash - Thursday, February 1, 2007 - link
WMDC was RTM'ed yesterday: http://www.microsoft.com/downloads/details.aspx?Fa...">http://www.microsoft.com/downloads/deta...0-af33-3...stash - Thursday, February 1, 2007 - link
Which common 3rd-party apps are you referring to here?