Run and install AI models on your Windows PC with Microsoft Foundry Local

Microsoft Foundry Local lets you run large language models (LLMs, text-generating AI models) and speech models directly on a Windows PC without sending prompts to the cloud. The runtime handles model downloads, hardware acceleration, and inference (the process of generating a response from a model) on your device. You do not need an Azure subscription. Foundry Local is part of Microsoft Foundry on Windows, alongside built-in Windows AI APIs and Windows ML. This article covers what it does, what hardware you need, how to install it, and where it fits compared to other local AI options. Source

Read the full article at the source.