#+HashtagPLUS
In

Menu

BI

Billy Bob Gurr

Author Profile

Claim This Author Profile

Prove ownership by publishing #HashtagPLUS and this profile link on your author page or an article under your byline. A moderator or admin will review the request before it merges into your real HashtagPLUS username.

Sign In To Claim
0 karma0 postsjoined 24 days ago

When I started running models locally, I thought quantization meant squeezing more into RAM. Turns o

🌐 dev.toSource

From Dev.to - opensource: When I started running models locally, I thought quantization meant squeezing more into RAM. Turns o

#ai#llm#opensource#hardware#real#latency#quality#context
23 days ago

Why GPU Memory Bandwidth Matters More Than VRAM for Local LLMs

🌐 dev.toSource

From Dev.to - ai: Why GPU Memory Bandwidth Matters More Than VRAM for Local LLMs

#ai#llm#opensource#hardware#bandwidth#memory#vram#tokens
24 days ago