Understanding AI performance and how NVIDIA RTX AI PCs take it to another level

AI is changing the game when it comes to the specifications we consider when determining how fast a PC is. Sure, things like GHz, Gbps, and MT/s are going to remain important for general use of the system, but with AI features on board, some new metrics are coming into play. You’ll hear about TOPS (Trillions of Operations Per Second), tokens, and even image generation speed, and NVIDIA RTX AI PCs are leading the charge to show you what you can do with all those TOPS. Let’s dig into what all that means for you.

In order to take advantage of AI, whether it’s image generation, text summarization, or any of the many new features rolling out at a blistering pace, you need a certain level of performance. That’s just the performance that TOPS is there to measure. Those TOPS are integer math operations processed by chips on the system. That speed can come from a dedicated NPU (Neural Processing Unit), CPU, GPU, or a combination of components working together to process the math operations. NVIDIA RTX AI PCs already have a huge leg up here, as they offer substantial speeds in that department. 


(Image credit: NVIDIA)

At a speed of 40 TOPS, a  system that meets the speed threshold to handle the text generation and analysis features of Microsoft’s new Copilot+. If a system offered significantly lower TOPS, the user experience could be hampered by incredibly slow responses from the AI assistants tools, which should feel as quick as interacting with another human. 

Source link