Ryzen 7000 I/O Die: TSMC & Integrated Graphics at Last

We’ll start our look at the Ryzen 7000 silicon with the glue that holds the chip together: the I/O Die (IOD). Whether it’s a 7600X or 7950X – one CPU chiplet or two – every Ryzen 7000 processor gets one of AMD’s new IODs.

As with the Ryzen 3000/5000 series, the IOD is a die separate from the CPU core chiplets that hosts everything that isn’t the CPU cores or their associated L1/L2/L3 caches. By producing a 2 or 3 chiplet-based solution rather than a single monolithic die, AMD is able to put silicon that doesn’t require cutting-edge performance on a cheaper process node, while enjoying the yield advantages that come from smaller chiplets and older, more mature nodes.

And yet with that said, for the Ryzen 7000 series it’s AMD’s IOD that’s getting the biggest upgrade. Previously produced on GlobalFoundries’ 14nm/12nm process node, for Ryzen 7000 the IOD has made the leap to TSMC. The new IOD is made on TSMC’s 6nm process, a generation behind the 5nm node used for the CPU chiplets themselves, but a generation (and then-some) ahead of GlobalFoundries’ smallest node.

With AMD no longer tightly bound to GloFo with wafer share agreement exclusivity requirements, AMD is now free to produce chips like the IOD where they see fit. And with AMD also doing very well as a company in the last few years, they do not need to produce IODs at GloFo to meet their purchase requirements with the fab.

The jump to TSMC 6nm brings several advantages to AMD’s central chiplet. The much smaller process node allows for significantly more transistors – 3.4B on a 122m2 die, 63% more than before – which AMD can invest in new features such as integrated graphics. As well, the more efficient process node brings down the power requirements of the IOD, especially in near-idle situations, though AMD is relying on a lot more than process nodes here.

In terms of functionality, the IOD first and foremost is responsible for the CPU-side implementation of all the new features of the AM5 platform. So PCIe 5.0 root complexes, DDR5 memory support, updated display I/O, and more are implemented here. Relative to the Ryzen 3000/5000 IOD then, there is almost nothing here that AMD hasn’t touched in some function; even the USB controllers and infinity fabric have been altered for this generation of processors.

Ryzen 6000 Mobile’s Legacy: Power Control and Pluton

Outside of the obvious gains from moving to a smaller process node, the Ryzen 7000 IOD has also given AMD a chance to implement everything they’ve learned in the past 3 years about power control and power optimizations from the Ryzen mobile lineup. Since the previous-generation IOD was launched for the Ryzen 3000 family in 2019, AMD has launched the Ryzen 6000 Mobile CPU, a monolithic die design that went all-out on power efficiency improvements in a bid to catch up to Intel. Ryzen 6000 Mobile introduced power features such as SVI3, which have since been ported to the Ryzen 7000 design, and principally show up as parts of the IOD.

This was especially easy for AMD as the IOD is made on the same 6nm process as the Ryzen 6000 Mobile chips. Which means that the new IOD has been able to implement many of the same power gating, power binning, deep sleep modes, clock gating, and power state features that were first introduced for mobile. Which is to say that AMD has put a lot of hard work into keeping the IOD from working hard.

The Ryzen 7000 also inherits many of the basic security features of the Ryzen 6000 Mobile platform. AMD is still using their own Arm-based security processor within the IOD. And the new chip is compliant with Microsoft’s Pluton initiative as well – with all the mixed responses that will undoubtedly come from that.

Ryzen 7000 Becomes Whole: Integrated Graphics At Last

Of the additional 1.31B transistors in AMD’s new IOD, the single biggest spend against that budget comes from the long-awaited inclusion of integrated graphics on high-end Ryzen desktop parts. Up to this point, AMD’s high-end consumer Ryzen processors have not included integrated graphics; both the early monolithic parts and later chiplet-style parts have forgone them for cost and integration reasons. But now with AMD’s modern RDNA 2 graphics architecture and TSMC fabrication process, AMD has finally seen the (ray traced) light, and is building a small GPU block into the IOD to offer integrated graphics throughout the Ryzen 7000 product stack.

To be sure, this iGPU is not a very powerful one – and it’s not meant to be. With just 2 CUs (technically a single RDNA 2 dual compute unit), it offers one-sixth the number of CUs on AMD’s top-end Ryzen Mobile APUs, or in the bottom-of-the-stack discrete Radeon RX 6400. So this is not a configuration meant to replace AMD’s traditional APUs in laptop or desktop scenarios. None the less, it is a full implementation of the RDNA 2 architecture – ray tracing and all – in a very low performance configuration.

AMD GPU Specificaiton Comparison
  AMD Radeon Graphics
(Raphael)
AMD Radeon 680M
(Rembrandt)
AMD Radeon RX 6400
Stream Processors 128
(2 CUs)
768
(12 CUs)
768
(12 CUs)
Boost Clock 2200MHz 2400MHz 2321MHz
Peak Throughput (FP32) 0.56 TFLOPS 3.7 TFLOPS 3.6 TFLOPS
Memory Clock DDR5-5200 LPDDR5-6400 16 Gbps GDDR6
Memory Bus Width 128-bit 128-bit 64-bit
Infinity Cache N/A N/A 16MB
Manufacturing Process TSMC N6 TSMC N6 TSMC N6
Transistor Count N/A N/A 5.4B
Architecture RDNA2 RDNA2 RDNA2
GPU Raphael Integrated Rembrandt Integrated Navi 24

The idea behind including an iGPU here is to offer a basic implementation of modern graphics across the entire Ryzen 7000 lineup. Even though it’s not very fast, 2 CUs running at up to 2.2GHz is going to be fast enough for desktop work – and maybe even some very light gaming. This makes the high-end Ryzen chips suitable for desktop work and inclusion in OEM desktop systems without a discrete GPU, a market segment that AMD was previously locked out of and Intel enjoyed free reign. And even for users who are bringing their own GPU, an integrated GPU makes troubleshooting all the easier, as now it doesn’t require a separate video card to merely boot a system.

Besides enabling basic pixel processing, the other major function of the Ryzen 7000 iGPU is to enable all of the video decoding and video output functionality expected from a modern GPU. As this part is derived from the integrated GPU that when into Ryzen 6000 Mobile (Rembrandt), it comes with a very familiar feature set. That includes AV1, HEVC, and H.264 video decoding, as well as HEVC and H.264 video encoding.  And, as AMD is keen to point out, these video encode/decode blocks remain accessible even with a discrete GPU in play; so unless a user outright disables the iGPU, every Ryzen 7000 system will have access to a modern suite of video encode and decode features.

Meanwhile on the display controller side of matters, this is the block that’s enabling Ryzen 7000 CPUs to drive up to 4 4K@60Hz displays. The iGPU display controllers can drive HDMI 2.1 up to its maximum 48Gbps data rate, or it can drive a DisplayPort 2.0 output at up to the UHBR10 data rate (a feature not even found on NVIDIA’s forthcoming RTX 40 series cards). And as mentioned previously when talking about motherboards and chipsets, motherboard vendors will have the option of exposing these DP outputs either via USB-C alt mode, or by implementing fixed DisplayPorts. All of which, in turn, can be used as active display outputs even if a discrete video card is installed, via AMD’s new hybrid graphics mode.

All told, AMD is taking a similar tack as Intel here with their desktop CPUs. Most (but not all) Intel desktop parts contain a basic UHD-class integrated Xe-LP GPU, which Intel does for many of the same reasons as AMD now is. AMD has a leg-up on Intel in as much as they offer a newer architecture and features to much, such as AV1 decoding. But we’ll have to see where performance lands; 2 Radeon CUs is low enough that these parts may not even catch up to Intel’s 32 EU integrated graphics.

AMD Infinity Fabric: Faster Flowing, Narrower Going

The last major functional update to come with AMD new IOD is the Infinity Fabric, AMD’s die-to-die interconnect. On the chiplet-based Ryzen desktop parts, IF is used to provide a low-latency connection between the IOD and the CPU core chiplet(s) on the package.

For the Ryzen 7000 series, AMD has done some further engineering work to reduce the power costs of the IF links, and thus improve the overall power efficiency of the link and reduce the data movement power penalty for using a chiplet-based approach. The most significant thing here is that AMD has doubled the IF link frequency, but cut the physical width of the IF link in half. As a result, Ryzen 7000’s IF links offer the same bandwidth as on Ryzen 5000,

According to AMD, this refactoring is because AMD’s engineers found that, contrary to conventional wisdom, they could save power running a narrower IF link at a higher frequency. Which is to say that, even though higher frequencies are normally power prohibitive, in the case of IF it’s just powering the physical links themselves which is the most expensive part. Part of that shift, in turn, comes from the fact that the newer process nodes have allowed AMD to run the IF link at a lower voltage,

Finally, further reducing AMD’s power consumption here, the IF links on the Ryzen 7000 now support multiple power states, versus the binary on/off states of the IF links on Ryzen 5000 and earlier. This gives AMD a nice middle ground to save power in lighter load situations, by being able to use intermediate states rather than running at full-power just to have an IF link active.

And while this leaves AMD with an obvious (if more power-hungry) route to take for more IF bandwidth in the future should they need it, for now the company intends to stay pat. According to AMD’s engineers, the amount of bandwidth supplied by the Ryzen 7000 IF links, though virtually identical to the amount of bandwidth on the Ryzen 5000 links, is still enough to meet AMD’s die-to-die bandwidth needs – even with extra memory bandwidth afforded by the switch to DDR5.

DDR5 & AMD EXPO Memory: Memory Overclocking, AMD's Way Zen 4 Architecture: Power Efficiency, Performance, & New Instructions
POST A COMMENT

205 Comments

View All Comments

  • Silver5urfer - Tuesday, September 27, 2022 - link

    Intel won't sell new mobos. They already have Z690 saturation. Barely anyone will get Z790. AMD on the other hand will continue to sell new boards, the quarter is not based on the Client only. It will include the HPC. Intel lost money there, and AMD won't be losing because Genoa is on track and SPR XEON is delayed.

    AMD AM5 is not just hey this thing is fast and just for gaming. It will be a socket that is going to last until Intel Nova Lake launches that is next 2 Intel sockets. That is a huge advantage for a small price for paying customers now.

    Also why is everyone chanting same BS that GN Steve did with AMD boards are too expensive, did you see how Z690 was at when it launched same thing it was expensive ? And DDR4 boards are worse quality and features than the premium cut DDR5. Then Intel launched B660 and AMD's B650/E is also coming. So nope that BS argument about Mobo pricing is too much thrown around. Once the B650 launches by that time 13th gen will hit Retail market and new GPUs as well. And it's November season and in America the Black Friday sales will kick in and see price cut for all products we are seeing now.

    So ultimately AMD is not going to lose money.

    The biggest BS from a smart customer pov is with Intel LGA1700 EOL and the whole socket bending crap, it's like AM4's unreliable IMC and poor IODie with it's issues. AM5 needs to prove itself but given how they removed the IF from memory clocks I can bet it won't have the issues from AM4.

    X3D is a niche market it won't be chart topper for sales at-least if it's again 7800X3D single SKU. Same for KS bin. It depends on how AMD will execute, idk why every single AMD fan says X3D is going to do something if AMD can clock it this high and also allow tuning then it will be a true gen refresh to compete vs Meteor Lake else it will be just a Gaming Juggernaut.
    Reply
  • nandnandnand - Tuesday, September 27, 2022 - link

    @Silver5urfer rumored to be 3 SKUs, including a 7900X3D, and +30% average performance instead of 15%. I guess that would be a result of improved latency, bandwidth, no voltage/clock decreases, etc. Reply
  • Silver5urfer - Wednesday, September 28, 2022 - link

    A 7950X3D means it will have extreme high heat because not only single cache stack you are adding 2 stacks atop the CCDs, how will AMD able to remove that ? Unless the way Cowos TSMC Stacking is technically changed OR they have to lap out the IHS internally to reduce the thickness and compensate the high heat transfer. The current IHS is thick due to many reasons one can assume - The LGA1718 stability, Chiplet integrity with high heat and pressure of HS and cooler compat and it causes the heat density increase, which is why 95C.

    I really think a 7800X3D is the only way for AMD even though rumors mention 3SKUs because a total SKU refresh totally cannibalize the entire 7000 lineup, because a 7600X is to get best gaming out of AM5 with cheaper option almost at more than 1/2 the price reduction vs a top end R9. And R7 7900X is basically an all rounder like 5900X best for gaming and production now you add the Cache block it would have to fight with 7900X.

    Voltage reduction was done on Zen 3 because AMD shoved 1.4v through all Ryzen 5000 processors, insanely high and IODie was also on high voltage, causing all that instability add the 1.3v bin silicon, everything gets better including the heat density. Zen 4 TSMC 5N is much better because it's just 1.2v now at high clock rate. The voltage is not an issue anymore, the design of the Zen 4 itself is like this, how AMD intended to breathe fire at 95C even for 7600X is the hint.
    Reply
  • nandnandnand - Wednesday, September 28, 2022 - link

    Heat was never the problem for the 5800X3D. It was only voltage, due to using an immature 3D (2.5D) chiplet technology that could not be run at the higher voltages. So I don't think the 7950X3D can't happen. If they have to drop voltages and clocks again, then hopefully the cache has improved.

    I think AMD should do at least a 7950X3D and 7800X3D. They can prevent cannibalization by giving it a healthy price bump. Probably +$100 to the 7950X3D, +$50 to the 7800X3D, and let the 7700X price drift lower. 7900X3D doesn't make sense, and people would love a 7600X3D but AMD would not.
    Reply
  • nandnandnand - Tuesday, September 27, 2022 - link

    @Hifihedgehog OP compared 7000X3D to the 13900KS, that's what I addressed. Reply
  • Hifihedgehog - Tuesday, September 27, 2022 - link

    Wrong: the i9-13900K is less than $600. The 7950X is going to have to have its price lowered, especially with the price of DDR5 and the motherboards simply off the charts. And good too: Lisa Su needs to be running a price war and not pretend that her company has more market share. Reply
  • The Von Matrices - Tuesday, September 27, 2022 - link

    A price war doesn't benefit AMD when they are supply constrained by TSMC and selling every chip they can manufacture. There's a reason that AMD doesn't offer any products in the <=$100 CPU market right now and it isn't because they don't want to make money. Reply
  • Hifihedgehog - Tuesday, September 27, 2022 - link

    https://download.intel.com/newsroom/2022/2022innov... Reply
  • dwade123 - Tuesday, September 27, 2022 - link

    Overheated and overpriced. Don't let those scumbags tell you that "95C is normal" because it's not. Avoid at all cost! Reply
  • Thanny - Tuesday, September 27, 2022 - link

    Running the memory at JEDEC speeds is definitely the wrong choice for a review. While it may be true that most people don't set the memory profile in the BIOS, none of those people read CPU reviews. Essentially every person who would read this reviews will be setting memory to the XMP/EXPO settings.

    So you're essentially invalidating your test results for the only people who see them.
    Reply

Log in

Don't have an account? Sign up now