Networking Benchmarks
Just to get a quick idea of what these new features can do, we ran our usual networking benchmark suite on a pair of ASUS P5B-Deluxe motherboards using both the on-board PCI and PCIe connected gigabit network controllers (Marvell 88E8056 and 88E8001 respectively). We used two tests for this, a multiple small file transfer test consisting of about 450 files totaling 600MB, and a large file transfer test consisting of a pair of ISO images totaling 3GB. In order to keep the load on our D-Link Gamer Lounge router consistent, we also had the WMV-HD version of Terminator 3 streaming in the background. We tested Windows XP SP2 for a base score, followed by Vista with Compound TCP switched on and off.
Unfortunately for Vista, neither test is particularly favorable. Compared to XP when Compound TCP is disabled, Vista is anywhere between 25% and 50% slower than XP in terms of the total time required for these tests. Without the ability to separate Vista's networking stack from the drivers for our NICs, it's impossible to tell if this slowdown is the fault of the networking stack being worse for this situation, or if the Vista drivers for this line of Marvell NICs are not quite as tuned, so as a comparison to XP this test is inconclusive. Either way, for this particular setup Vista ends up being slower at file transfers than XP.
The one bright spot however is that when enabled, Compound TCP is clearly having some effect even on our low-latency network. The 5% or so boost in Vista's low scores won't bring it back above XP, but it clearly proves that Compound TCP does have a real-world effect on performance. This will be something we will be able to talk more about as Microsoft perfects this algorithm set for the release of Longhorn Server later this year. Hopefully, the relatively slow performance we're seeing right now is being caused by drivers rather than by Vista's "new and improved" networking stack. We will definitely keep an eye on networking performance over the coming months, as most of the people we've talked with expected Vista's networking performance to be faster than XP's.
Just to get a quick idea of what these new features can do, we ran our usual networking benchmark suite on a pair of ASUS P5B-Deluxe motherboards using both the on-board PCI and PCIe connected gigabit network controllers (Marvell 88E8056 and 88E8001 respectively). We used two tests for this, a multiple small file transfer test consisting of about 450 files totaling 600MB, and a large file transfer test consisting of a pair of ISO images totaling 3GB. In order to keep the load on our D-Link Gamer Lounge router consistent, we also had the WMV-HD version of Terminator 3 streaming in the background. We tested Windows XP SP2 for a base score, followed by Vista with Compound TCP switched on and off.
Unfortunately for Vista, neither test is particularly favorable. Compared to XP when Compound TCP is disabled, Vista is anywhere between 25% and 50% slower than XP in terms of the total time required for these tests. Without the ability to separate Vista's networking stack from the drivers for our NICs, it's impossible to tell if this slowdown is the fault of the networking stack being worse for this situation, or if the Vista drivers for this line of Marvell NICs are not quite as tuned, so as a comparison to XP this test is inconclusive. Either way, for this particular setup Vista ends up being slower at file transfers than XP.
The one bright spot however is that when enabled, Compound TCP is clearly having some effect even on our low-latency network. The 5% or so boost in Vista's low scores won't bring it back above XP, but it clearly proves that Compound TCP does have a real-world effect on performance. This will be something we will be able to talk more about as Microsoft perfects this algorithm set for the release of Longhorn Server later this year. Hopefully, the relatively slow performance we're seeing right now is being caused by drivers rather than by Vista's "new and improved" networking stack. We will definitely keep an eye on networking performance over the coming months, as most of the people we've talked with expected Vista's networking performance to be faster than XP's.
Facebook
Twitter
RSS
105 Comments
View All Comments
Lifted - Thursday, February 1, 2007 - link
That's odd. I can search network drives using XP Pro. Maybe it's a Pro vs. Home issue?
Was also wondering about the network test myself. 10MB/s file copy on XP Pro seems abysmally slow when using gigabit NIC's. Just testing right now I about 35MB/s between a pair of 5 year old servers (dual Xeon 1GHz) with Intel GB NIC's. I haven't checked transfer rates with XP as I'm on a 10/100 switch at the moment, but I can't believe it's really THAT much slower than 2003.
Aikouka - Thursday, February 1, 2007 - link
I remember running a gigabit cross-over (CAT6) cable between my roommate's computer and my computer in college. We achieved about 33MB/s (through FTP) running Windows XP Professional on each. So I'd say that you'd probably see about the same speed if you were running a gigabit switch.mjz - Monday, February 5, 2007 - link
i think windows xp sets a limit when downloading from another computer to 33MB/s..Nehemoth - Thursday, February 1, 2007 - link
Same here.I just wanna Vista for the improve TCP/IP Stack, now I'll wait for SP1
tallsummi - Thursday, February 1, 2007 - link
I'll wait for SP2 of vista and then go for it..keitaro - Thursday, February 1, 2007 - link
Perhaps Microsoft should have copied the idea from Novell's SUSE Linux Desktop (powered by XGL and compiz). The compiz software package (compositor and window manager) comes with its own alt-tab that surpasses Flip 3D in every way. http://www.novell.com/products/desktop/features/xg...">See here for a look at what XGL and compiz can do.mlambert890 - Friday, February 2, 2007 - link
I think that xgl crap is an overenginered waste that adds 0 productivity. Flip 3d gives you the one thing you need - a live shot of running apps. Who the hell needs some spinning cube? And look how bad video playback perf is in that Novell demo...bleh... I dont feel myself drawn back to 1992 when I lived and breathed Novell; sorry...
Locutus465 - Friday, February 2, 2007 - link
I dont' know, personally I like flip 3d better..archcommus - Thursday, February 1, 2007 - link
The article makes me a bit sad about Vista. It made me realize - wow, yeah, it really IS a shame that Vista doesn't totally smash OS X Tiger given how long it's been in development and how long Tiger has been out for. I guess they just got in such a rut of catch-up that not many new revolutionary features could be developed.In particular, I'm disappointed with how similar (and ugly) certain aspects of Vista look compared to XP, for example the quick launch area, system tray, clock, and the overall taskbar. With the exception of the Start buttion being replaced by an "orb," it looks EXACTLY the same as XP, and this could have been and should have been revamped to improve productivity. Quick launch is just...stupid, and ugly. All it is is additional shortcuts, and they waste taskbar space. I think a small menu that appears and disappears on the fly would be nicer. I'm not sure what improvements to suggest for the taskbar, all I know is, with how pretty the rest of the OS looks, the application blocks down there just look out of place. Same with the system tray icons.
Explorer is better though and the transparency is great. It's too bad x64 performance and drivers aren't up to snuff yet.
thebrown13 - Thursday, February 1, 2007 - link
Microsoft has to cater to about 349852395472039 more software programs.That's why. Updates, bug fixes, feature designing, it all takes A LOT longer than with an OS with 5 people that use it, like Apple.
We're lucky the mainstream OS isn't MUCH farther behind.