Nvidia, You’re Late. World’s First 128GB LLM Mini Is Here!

In the video “Nvidia, You’re Late. World’s First 128GB LLM Mini Is Here!” by Alex Ziskind, the spotlight is on the GMK Tec EVO-X2, a mini PC that boasts 128GB of RAM and is designed for local large language models (LLMs) and machine learning tasks. The video compares this new powerhouse to Nvidia’s delayed DGX Spark, emphasizing its affordability and performance capabilities. Ziskind delves into the technical specifications, including the AMD Ryzen AI Max Plus 395 chip, memory configurations, and the machine’s ability to handle demanding AI workloads, while also discussing the implications of static memory partitioning and potential future improvements in software support for AMD’s architecture.