The Semiconductor Observation Series: Is Groq’s LPU Chip a Revolutionary Breakthrough in AI Inference Computing?
Groq’s Stunning Emergence Time flies, and many of you may remember that last year, in January and February, an AI company with a rather peculiar name, Groq, made headlines with its self-developed LPU (Language Processing Unit) chip system, showcasing extreme low-latency and high-performance inference on the Llama2 70B model (with actual performance exceeding GPU clusters … Read more
