AI has taken off as an important, differentiating capability in all industries, and the hardware required to run AI is rapidly evolving. The technology industry is often very focused on the exponential growth in size that the most advanced AI models are going through. The discussions are about tens of billions of parameters, reducing precision, expanding memory, high-performance computing (HPC)–like needs for AI training and inferencing, and racks of accelerated servers. In reality, this extraordinary scale of AI computing is the exception, especially in the enterprise.
IDC – Why Developing and Deploying AI on Workstations Makes Sense
