The fundamental limit for AI chips from both Nvidia and rivals like Advanced Micro Devices is how well the computing parts of a chip can talk to the memory chips where an AI model lives and feeds data to the computing chip. Nvidia and AMD solve the problem by encircling their computing chips with expensive high-bandwidth memory chips.