This chip startup just raised $135M on a bet that AI’s biggest bottleneck isn’t compute — it’s memory - BERITAJA

Every clip you inquire ChatGPT a question, your petition triggers a information relay race. Information leaves memory, passes done a CPU for preprocessing, travels to a GPU for dense computation, and past makes its measurement backmost — and that full travel repeats for each azygous connection the AI generates.

The bottleneck is structural — it intends routing done immoderate of the about costly and power-intensive chips successful the manufacture connected each azygous request. That inefficiency is precisely what XCENA, a startup pinch offices successful South Korea and the U.S., is trying to solve. The four-year-old startup has designed a spot that places compute capabilities overmuch person to DRAM — the fast, short-term representation chips that shop information a processor is actively utilizing — allowing regular information operations to beryllium handled adjacent memory, without the costly information trips betwixt CPUs, GPUs, and memory.

If it useful astatine scale, the implications for AI infrastructure costs could beryllium significant, which mostly explains investor enthusiasm about the country. Indeed, XCENA conscionable raised $135 cardinal successful a Series B astatine a valuation of $570 million, bringing its full raised to $185 million.

XCENA CEO Jin Kim co-founded the startup successful 2022 alongside CTO Dohun Kim and CPO Harry Juhyun Kim, each veterans of Samsung and SK Hynix, the representation giants that proviso chips powering Nvidia’s GPUs. “CPUs and GPUs person some gotten smarter complete the decades. Memory ne'er did. XCENA wants to alteration that,” Kim said successful an question and reply pinch TechCrunch. “The caller emergence successful representation prices and related stocks points to a broader displacement successful AI infrastructure toward memory-centric architectures,” he added. (This month, the 3 companies that predominate the world representation spot marketplace — Samsung, SK Hynix, and Micron — each crossed a trillion-dollar valuation for the first time.)

XCENA is betting its business connected the thesis that “inference isn’t conscionable a compute problem; it’s progressively a representation scaling problem,” said Kim.

XCENA’s chip, the MX1, connects to the CPU done CXL (Compute Express Link) — fundamentally a dedicated definitive lane betwixt the processor and representation — processing information earlier it ever needs to time off the representation module. It brings compute to the data, not the different measurement around. The institution claims that what utilized to require 10 servers could perchance tally connected conscionable one.

“While GPUs excel astatine matrix multiplication — the dense mathematics down AI exemplary training — overmuch of the surrounding information orchestration, including preprocessing, KV cache guidance [the strategy that stores anterior speech discourse truthful a exemplary doesn’t person to reprocess it], and information caching, still runs connected CPUs. Our spot handles those tasks straight wrong the representation module itself,” Kim said.

Demand for representation solutions has surged since the 2nd half of past year, and the institution believes the timing is moving successful its favor.

Conversations pinch respective world representation vendors are successful early stages, though Kim declined to sanction them. The company’s perfect customers are hyperscalers spending tens of billions a twelvemonth connected AI infrastructure, wherever moreover a mini summation successful representation ratio could mean hundreds of millions successful savings.

The MX1 is still a prototype. Mass accumulation chips are scheduled to rotation disconnected Samsung’s foundry lines by the extremity of 2026, pinch the institution expecting to make gross starting successful 2027.

While neural processing portion (NPU) makers are competing to situation Nvidia for training workloads, XCENA is targeting the memory-intensive furniture that sits underneath each of it.

XCENA’s closest rivals see Astera Labs and Marvell, some Nasdaq-listed companies moving connected next-generation representation connectivity. Marvell is simply a large, established subordinate already moving successful the aforesaid space, Kim said, adding that the differentiator comes down to intelligence property. “We person thousands of cores,” Kim said. Based connected nationalist specs, Marvell’s attack relies connected a fistful of general-purpose cores by comparison.

Those cores are built connected RISC-V — an open-source spot creation blueprint — and optimized specifically for information processing, pinch each halfway deliberately kept mini and efficient. Beyond the cores themselves, XCENA designs its ain soul representation hierarchy, interconnect bus, and DRAM controller — a level of vertical integration that about spot companies, including larger rivals, typically outsource.

Seoul-based VC firms Altinum and IMM Investment co-led the Series B round, on pinch Corstone Asia and existing investors SBI Investment and Mirae Asset Capital. The company, which has much than 90 unit crossed offices successful Pangyo, a tech hub extracurricular Seoul, and successful Sunnyvale, is besides successful conversations pinch world investors about further funding.