Dive Brief:
- Nvidia is releasing a technology demo that lets users customize a chatbot with locally hosted content on Windows PCs, called Chat with RTX, the company said Tuesday in a blog post.
- Using Nvidia’s AI platform, RTX, users can connect PC files as a dataset to fuel open-source large language models, granting more contextually relevant responses to queries, according to Nvidia. The tool supports various file formats as well as information from YouTube videos or playlists, which users can include by providing URLs.
- While still in its early stages, the company is aiming to entice security-conscious enterprises. The tool runs locally on Windows RTX PCs and workstations rather than cloud-based LLM services, which lets users process sensitive data without sharing it with a third party or connecting to the internet.
Dive Insight:
As enterprises run up against an impending PC refresh cycle, executives are weighing device upgrade costs against the near-term benefits of emerging products, including the AI PC.
Just as software providers rush to embed generative AI in solutions, hardware vendors are enhancing products to better support AI use.
AMD, Intel and Nvidia designed chips to run generative AI on PCs and workstations. PC manufacturers, including Dell, HP, Lenovo and Samsung, also released AI-optimized products in recent months.
Microsoft even laid out plans to add a Copilot key to new Windows 11 PCs and upcoming Surface devices. While not exactly a hardware upgrade, the key signals Microsoft’s desire to shift user behavior toward onboard AI tools.
Vendors are hoping demand for AI-ready PCs can shake a persistent decline in shipments as technology executives grow more interested in how locally-hosted AI computing can benefit the business.
AI PCs will enter the IT shopping list this year with even more growth on the horizon. AI-optimized PC shipments are projected to triple in the next few years, capturing nearly 60% of the overall PC market by 2027, according to IDC.
