Overview
Skip begins by explaining the three main types of memory involved in the current shortage. RAM allows computers and other devices to operate software, while flash memory stores data after a device has been turned off. High Bandwidth Memory, or HBM, is a faster and more powerful form of memory that is essential for running artificial intelligence systems and large language models.
Skip and Samantha then look at why HBM production is reducing the supply of traditional memory. Producing one wafer of HBM can use the same manufacturing resources as three wafers of standard RAM. As demand for AI infrastructure increases, memory manufacturers are therefore moving more of their production capacity toward HBM.
They also discuss the role of major technology companies such as Amazon Web Services, Alphabet, Meta, Microsoft, and Oracle. These companies are investing heavily in data centers, which require large amounts of HBM. This demand has encouraged manufacturers to prioritize the AI market over the consumer electronics market. The episode also examines Micron’s decision to close its Crucial consumer memory brand and redirect resources toward HBM production.
Next, Skip explains how HBM has disrupted the traditional boom-and-bust cycle of the memory chip industry. In the past, higher prices encouraged manufacturers to expand production. Once the new production capacity became available, supply increased and prices fell. However, strong and continuing demand from the AI industry has changed this familiar pattern.
Finally, Skip and Samantha examine the consequences for businesses and consumers. Contract prices for RAM increased by between 90 and 95 percent, while flash memory prices rose by 75 percent. Delivery lead times have also extended beyond 58 weeks, and some manufacturers must pay for their orders in advance. These pressures are raising the cost of any product that requires computer memory.
