Menu

Post image 1
Post image 2
Post image 3
Post image 4
1 / 4
0

We have many questions about OWC's new Stack AI speed booster

Reading 0:00
15s threshold

The OWC Stack AI promises to make local processing of large LLMs easier by somehow inflating your Mac's GPU memory across Thunderbolt. We have questions. The majority of the AI industry consists of the big AI players, including OpenAI , Perplexity , and Anthropic , among others. However, using them can become expensive, especially for people with massive workloads and enterprise clients. One way to trim the bills is to bring it locally, with AI models being used on a computer instead of a server. The problem there is the expense of the hardware needed for it. And, there are privacy concerns for cloud-based models too. You can buy a Mac mini and load a model onto it, but you will be hit by a memory limitation. Since the entire model has to be held in memory, the amount installed limits the size of model you can use. There are workarounds to this limitation, such as projects involving multiple Macs connected over Thunderbolt 5 to share memory and compute performance.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.

Read More