Menu

Post image 1
Post image 2
1 / 2
0

Using Azure Local Foundry CLI with PowerShell

DEV Community·Olivier Miossec·18 days ago
#GVNstbIZ
#post#azure#ai#powershell#model#foundry
Reading 0:00
15s threshold

Inference costs are climbing. Anthropic, OpenAI, and Microsoft have all tightened their token quotas this year. The era of subsidized generative AI is quietly ending. Not every task needs a frontier model. Burning cloud tokens on a formatting job or a quick summary is just a waste of money. Privacy and data protection add a second constraint. Some workloads simply can't leave your perimeter. This include European users, where RGPD is enforced. The EU Cloud act will soon add more constraints. That's where local models come in. Ollama is one of the best reference, solid API, runs well with tools like OpenCode and come with plenty of models. When I got a new laptop with an NPU chip, I took Microsoft Local Foundry for a spin. The premise is simple: run inferences locally with an AI accelerator, no more cloud provider in the loop. Local Foundry ships as an SDK (Windows, Linux, macOS) and as a CLI (Windows and macOS) in preview. This post focuses on the CLI.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.

Read More