The PC industry is warming up to a new sweet spot: PCs incorporating AI capabilities. Intel and Microsoft—the primary beneficiaries of the PC revolution—are now pushing PCs with AI-enabled CPUs and AI-powered software assistants, respectively, to move AI applications from the cloud to the PC realm.

According to Intel CEO Pat Gelsinger, will make AI services cheaper, faster, and more private than using services based in cloud-centric data centers. “You’re unleashing this power for every person, every use case, every location in the future,” he said at the CES 2024 in Las Vegas.

ntel’s Meteor Lake laptop CPU has incorporated an NPU to support third-party AI software features. Its archrival in the PC hardware space, AMD, has also been shipping AI PC processors. Next, Nvidia showcased three new GPUs—RTX 4060 Super, RTX 4070 Ti Super, and RTX 4080 Super—for AI-ready laptops at a virtual event before CES 2024.

Figure 1 Meteor Lake CPU has incorporated an NPU to support AI applications. Source: Intel

Besides AI-ready processors, memory chipmakers like Micron, Samsung, and SK hynix are also eyeing AI PCs to enable AI accelerators to run powerful assistants on personal computers. New laptops currently come with as much as 8 MB of RAM, and it’s likely to double in Windows-based AI PCs. In fact, a large language model  running an AI assistant could require more than 16 MB of memory.

Take the example of the Llama 2 family of AI models created by Meta, which requires nearly 30 GB of RAM for its modest variant. Moreover, the amount of memory in AI PCs will likely increase with the availability of more powerful AI accelerators and processors.

Figure 2 Copilot AI assistant is built around OpenAI’s GPT-4 model. Source: Microsoft

At the moment, consumers are only warming up to AI personal computers, and it’ll take a while before more native applications are made available for AI PCs. However, both hardware and software for AI PCs will become more powerful over time, and that’s good news for semiconductor devices like CPUs, GPUs, and DRAMs.