LPU (Language Processing Unit)

Thinking chips designed specifically for running LLMs at extreme speeds.

What it means

Traditional chips (GPUs) are great for graphics and training. An LPU (pioneered by companies like Groq) is a new type of processor built purely for inference-generating text. It processes data linearly, avoiding the bottlenecks of standard chips.

Why it matters

It enables 'instant' AI. Instead of reading text as it types out, the whole paragraph appears almost strictly immediately. This speed is crucial for real-time voice and video AI.