Gaming Performance - OpenGL
Moving on to OpenGL and Quake 4, we'll be able to see how well NVIDIA and AMD have done in building their own OpenGL ICD (installable client driver) for the API. This is more taxing on hardware vendors, because Microsoft's implementation of OpenGL is just a wrapper around DirectX. By default, unless an ICD is used, OpenGL applications cannot talk directly to the hardware.
We did have some issues with Quake 4 as well. We were unable to get the application to run stable with multi-core support enabled, so we tested without this option. Even on Windows XP we see much higher numbers during CPU limited testing with this option enabled, but we will have to do without for a while. It isn't clear whether this is a problem with the game, with Vista, or with OpenGL, but hopefully it will be resolved (preferably sooner rather than later).
As expected, OpenGL performance is much worse both in CPU limited and GPU limited cases. The reason the low end AMD cards look better off here is that their performance is simply bad across the board. NVIDIA seems to perform closer to XP in general here, and both companies are saying that performance will improve over time. GPU limited performance does seem to improve over CPU limited performance, indicating that driver overhead on the CPU is a major factor contributing to the reduced frame rates.
Now let's take a look at how Vista x64 compares. This will actually serve as a good test of how well NVIDIA and AMD have implemented their x86 and x64 versions of their OpenGL ICD as well.
Again, the low end AMD cards just look like they are doing better because they perform poorly in general. In CPU limited cases, x64 actually seems to perform better than under 32-bit Vista, and even GPU limited performance is very close between the Vista versions. This could indicate that AMD and NVIDIA's OpenGL ICDs benefit from 64-bit processing, even if the game itself does not. However, unlike Oblivion, the performance of Quake 4 in Windows Vista is substantially slower than under XP, sometimes as much as 30% slower.
Last up for Quake 4 is resolution scaling.
While it's very clear that XP is a better option for OpenGL apps right now, there are no real scaling surprises. The CPU performance/driver overhead seems to be a bigger factor in reduced Vista scores than the actual GPUs, as the scores tend to get closer in GPU limited situations.
Gaming Performance - x64
Finally, we have Half-Life 2: Lost Coast with its native 64-bit application running under Vista x64. Is it worth it? We're only providing resolution scaling results for this game.
Clearly the 64-bit application runs slower than the 32-bit, especially at CPU limited resolutions. Even the games we tested running under WoW in 32-bit mode on Vista x64 showed better performance parity with Vista x86 and Windows XP. While the resources are there to offer better performance with more registers and better memory management (especially on systems with more than 4GB of RAM), there is clearly something that's lacking here. It is likely that Valve has more work to do on their 64-bit Source engine, but we can't rule out Vista x64 as a factor altogether.
We had hoped to see better performance from a native 64-bit game, but it looks like we'll have to wait longer until game developers figure out how to capitalize on the extra resources available under Vista x64 without adversely affecting performance.
Moving on to OpenGL and Quake 4, we'll be able to see how well NVIDIA and AMD have done in building their own OpenGL ICD (installable client driver) for the API. This is more taxing on hardware vendors, because Microsoft's implementation of OpenGL is just a wrapper around DirectX. By default, unless an ICD is used, OpenGL applications cannot talk directly to the hardware.
We did have some issues with Quake 4 as well. We were unable to get the application to run stable with multi-core support enabled, so we tested without this option. Even on Windows XP we see much higher numbers during CPU limited testing with this option enabled, but we will have to do without for a while. It isn't clear whether this is a problem with the game, with Vista, or with OpenGL, but hopefully it will be resolved (preferably sooner rather than later).
As expected, OpenGL performance is much worse both in CPU limited and GPU limited cases. The reason the low end AMD cards look better off here is that their performance is simply bad across the board. NVIDIA seems to perform closer to XP in general here, and both companies are saying that performance will improve over time. GPU limited performance does seem to improve over CPU limited performance, indicating that driver overhead on the CPU is a major factor contributing to the reduced frame rates.
Now let's take a look at how Vista x64 compares. This will actually serve as a good test of how well NVIDIA and AMD have implemented their x86 and x64 versions of their OpenGL ICD as well.
Again, the low end AMD cards just look like they are doing better because they perform poorly in general. In CPU limited cases, x64 actually seems to perform better than under 32-bit Vista, and even GPU limited performance is very close between the Vista versions. This could indicate that AMD and NVIDIA's OpenGL ICDs benefit from 64-bit processing, even if the game itself does not. However, unlike Oblivion, the performance of Quake 4 in Windows Vista is substantially slower than under XP, sometimes as much as 30% slower.
Last up for Quake 4 is resolution scaling.
While it's very clear that XP is a better option for OpenGL apps right now, there are no real scaling surprises. The CPU performance/driver overhead seems to be a bigger factor in reduced Vista scores than the actual GPUs, as the scores tend to get closer in GPU limited situations.
Gaming Performance - x64
Finally, we have Half-Life 2: Lost Coast with its native 64-bit application running under Vista x64. Is it worth it? We're only providing resolution scaling results for this game.
Clearly the 64-bit application runs slower than the 32-bit, especially at CPU limited resolutions. Even the games we tested running under WoW in 32-bit mode on Vista x64 showed better performance parity with Vista x86 and Windows XP. While the resources are there to offer better performance with more registers and better memory management (especially on systems with more than 4GB of RAM), there is clearly something that's lacking here. It is likely that Valve has more work to do on their 64-bit Source engine, but we can't rule out Vista x64 as a factor altogether.
We had hoped to see better performance from a native 64-bit game, but it looks like we'll have to wait longer until game developers figure out how to capitalize on the extra resources available under Vista x64 without adversely affecting performance.
105 Comments
View All Comments
LoneWolf15 - Thursday, February 1, 2007 - link
Firefox runs just fine on Vista. I've been running versions of it (both 1.5x and now 2.x) on Vista since RC1 (I've tested Beta 2, pre-RC1, RC1, and am running RC2 on a spare box).While IE is fast at loading pages on Vista, I've never been able to get used to IE7's UI. After trying to keep my beta-testing experience as MS-app-oriented as possible, I couldn't and loaded FF.
Aikouka - Thursday, February 1, 2007 - link
I have to say, LoneWolf, that I agree with you when it comes to IE7 on Windows XP. I installed it and it simply didn't fit at all. Although, for some reason, IE7 doesn't seem weird on Vista at all. It's probably because of how Windows Explorer also looks the same (lack of a menu bar).Also to go along with LoneWolf, I have had no issues with Firefox (2.0.0.1) in Vista so far :).
Spacecomber - Thursday, February 1, 2007 - link
I didn't see this covered in my first pass through this article, but I was interested in learning more about the potential impact of MS's new Universal Audio Architecture on gaming performance, which I recently saw covered in a http://www.dailytech.com/Underneath+Microsofts+Uni...">DailyTech news item.quanta - Friday, February 2, 2007 - link
There is NO performance to speak of, because Vista does not support hardware DirectSound acceleration. Alchemy only works on X-Fi, so anything older is useless.Cygni - Thursday, February 1, 2007 - link
One thing ive really been wondering about is what MCE is like in Vista? The article briefly mentioned TV Tuner support worked fine, but was MCE tried? Was it different? How was its performance under Vista? For me, thats the deciding factor.Anand Lal Shimpi - Thursday, February 1, 2007 - link
I'll be doing a look at MCE in Vista as soon as we get a system in house with the ATI TV Wonder Digital Cable Tuner (formerly known as OCUR). I'm hoping that this will happen in the coming weeks.Take care,
Anand
Aikouka - Thursday, February 1, 2007 - link
Anand, doesn't that digital tuner require some special sort of hardware to run? I believe I remember a thread on the forums (under Video if I remember correctly) that discussed how it won't run on every system regardless of how powerful they are.One thing I'm curious of... does Windows Vista's MC application have the same tuner restrictions as MCE's MC application? Because I originally purchased a TV Wonder Pro awhile back for normal use, and now it sits in my MCE machine dormant, because MCE doesn't support it (although open source MC-esque applications do). If it weren't for the nice ATi RF remote, I probably would've sold it already for one that works in MCE :P.
Ryan Smith - Thursday, February 1, 2007 - link
To be honest, I have never more than glanced at MCE, as I don't have a HTPC to make much use of it. I could tell you a bit about it, but I'm not really qualified to go in-depth about it, so we left it out.Myrandex - Thursday, February 1, 2007 - link
same here too. I used to run XP64 full time but then switched to MCE for the MCE app. I am really interested in Vista x64 with MCE and I would have loved to see something about it.ATWindsor - Thursday, February 1, 2007 - link
I really hope there is som driver-issue that explains the poor network-performance in this test, XP is already pretty bad in this regard, one of the big things with Vista is that the network performance should be better.And furthermore i have two questions: The search, does it support network-drives? Search Desktop for XP does not...
Is there software raid-5 support in Vista?
A few disappointing things with Vista:
- Still the 255-charachter-limit, that is really annoying.
- Still an enormously primitive file-copying-application. This is basic important stuff that should be better.
AtW