GPU AI của NVIDIA gặp tắc nghẽn dữ liệu, Samsung V10 NAND hỗ trợ CMX
Các máy chủ AI chứa GPU NVIDIA đang gặp tắc nghẽn do lượng dữ liệu Key-Value (KV) cache quá lớn, yêu cầu giải pháp Context Memory Storage (CMX). Samsung đang cung cấp NAND V9 cho NVIDIA và đang sản xuất hàng loạt V10 để giải quyết vấn đề này.
AI servers housing a boatload of NVIDIA GPUs were previously able to handle tons of temporary context data known Key-Value (KV) cache, but the astronomical scale of this data has started bottlenecking the chips, necessitating the need for Context Memory Storage (CMX), which is exactly where Samsung comes into play. A new report states that the Korean giant is already supplying tons of V9 NAND to NVIDIA for this purpose, with V10 undergoing mass production. While these shipments should remove the context data limitations from GPUs, it’s other companies and consumers that’ll bear the brunt, as there will be little […] Read full article at https://wccftech.com/nvidia-ai-gpus-face-data-bottleneck-will-require-samsung-v10-nand-for-cmx-storage/