Menu

Post image 1
Post image 2
Post image 3
Post image 4
Post image 5
Post image 6
Post image 7
Post image 8
Post image 9
Post image 10
Post image 11
Post image 12
Post image 13
1 / 13
0

Yes, local LLMs are ready to ease the compute strain

theregister·Brandon Vigliarolo·22 days ago
#1MIPXZIZ
#ai#x2f#openai#anthropic#aiandml#right
Reading 0:00
15s threshold

AI + ML Anthropic might be thinking about space to ease its computing burden, but Claude Code on your laptop is way more practical KETTLE We've been experimenting with LLMs for a while here at  The Register,  and if you ask our systems editor Tobias Mann and senior reporter Tom Claburn, locally installed coding assistants have actually become so good they could relieve some of the compute load that's pushing AI companies to raise their prices. This week on The Kettle, host Brandon Vigliarolo is joined by Mann and Claburn to discuss their work with locally-hosted LLMs, why we're revisiting the topic at all, how to do local LLMs safely, and whether there's orbital relief coming for the compute crunch.  You can listen to The Kettle  here , as well as on  Spotify  and  Apple Music , or read the full transcript of this episode below. ® --- Brandon (00:01) Welcome back to another episode of T he Register 's Kettle podcast.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.

Read More