Comments on: How MCR Memory Can More Than Double HPC And AI Performance https://www.nextplatform.com/2024/10/04/how-mcr-memory-can-more-than-double-hpc-and-ai-performance/ In-depth coverage of high-end computing at large enterprises, supercomputing centers, hyperscale data centers, and public clouds. Tue, 08 Oct 2024 11:18:23 +0000 hourly 1 https://wordpress.org/?v=6.7.1 By: Tom Miller https://www.nextplatform.com/2024/10/04/how-mcr-memory-can-more-than-double-hpc-and-ai-performance/#comment-237089 Tue, 08 Oct 2024 11:18:23 +0000 https://www.nextplatform.com/?p=144778#comment-237089 Do the two ranks that operate simultaneously with MRDIMM fill different 64 byte cache lines or does each rank fill half of one 64 byte cache line?

Do MRDIMMs and Xeon 6 processors support chipkill ECC where one DRAM chip can fail completely and the ECC bits reconstruct the data in the one failed DRAM chip?

]]>
By: Rumi https://www.nextplatform.com/2024/10/04/how-mcr-memory-can-more-than-double-hpc-and-ai-performance/#comment-236991 Tue, 08 Oct 2024 02:27:51 +0000 https://www.nextplatform.com/?p=144778#comment-236991 I will be more interested in reading testimoniails from CSPs running really challengeing AI inferencing tasks – definitely more convincing.

]]>
By: Bhanu Jaiswal https://www.nextplatform.com/2024/10/04/how-mcr-memory-can-more-than-double-hpc-and-ai-performance/#comment-236945 Mon, 07 Oct 2024 16:16:04 +0000 https://www.nextplatform.com/?p=144778#comment-236945 In reply to Eric Olson.

MRDIMM is a JEDEC standard. MRDIMMs are supported by broad memory ecosystem. Intel has taken the lead in supporting this memory technology with recently launched Xeon 6 CPUs with P-cores.

]]>
By: Slim Albert https://www.nextplatform.com/2024/10/04/how-mcr-memory-can-more-than-double-hpc-and-ai-performance/#comment-236775 Sat, 05 Oct 2024 21:17:53 +0000 https://www.nextplatform.com/?p=144778#comment-236775 In reply to Eric Olson.

I’ve been mildly confused (too?) about this fast moving tech, but sure like the HPCG uplift from MRDIMM. In its performance comparison of MRDIMM vs DDR5, Phoronix notes that “Granite Rapids is the first platform supporting MRDIMMs” (Micron 64GB 2RX4 PC5-8800X-HA0-1110-XT modules in their tests), and so one can’t really say much about how well it does in AMD products (in real life) at this stage — though one would expect similar benefits in AMD CPUs that do support the tech ( https://www.phoronix.com/review/intel-xeon6-mrdimm-ddr5 ).

The confusing bit(s) to me is that I thought it was MCRDIMM that would befit Granite Rapids, as developed jointly by SK Hynix, Renesas, and Intel, back in December 2022 ( https://news.skhynix.com/sk-hynix-develops-mcr-dimm/ ).

Then, in April 2023 we learned that AMD and JEDEC were developing a new industry standard for DDR5 memory called MRDIMMs which had similar goals to MCRDIMM, but that might be different, incompatible, and aimed at years 2030+(?) ( https://www.techpowerup.com/306762/amd-and-jedec-create-ddr5-mrdimms-with-17-600-mt-s-speeds and https://www.tomshardware.com/news/amd-advocates-ddr5-mrdimms-with-speeds-up-to-17600-mts ).

And then, in August 2024, we learned that Micron and Intel were bringing MRDIMM modules to market right there and then ( https://www.eetimes.com/micron-intel-bring-mrdimm-modules-to-market/ ).

And now, as noted earlier, we learned last week that Granite Rapids indeed uses/supports MRDIMMs in real life, today (to great effect). This begs questions of whether there’ll eventually be a separate MCRDIMM product, if this is actually different from MRDIMM, and will Turin support MRDIMM? etc …

]]>
By: Eric Olson https://www.nextplatform.com/2024/10/04/how-mcr-memory-can-more-than-double-hpc-and-ai-performance/#comment-236718 Sat, 05 Oct 2024 00:33:57 +0000 https://www.nextplatform.com/?p=144778#comment-236718 Though not labelled as such, this reads like an Intel-sponsored post. Especially since the use of MRDIMM technologies in Epyc Turin are not mentioned nor any non Intel points of comparison. Besides AMD, what’s IBM doing with memory these days?

]]>