#+HashtagPLUS
In

Menu

CH

Christopher Maher

Author Profile

Claim This Author Profile

Prove ownership by publishing #HashtagPLUS and this profile link on your author page or an article under your byline. A moderator or admin will review the request before it merges into your real HashtagPLUS username.

Sign In To Claim
0 karma0 postsjoined about 1 month ago

TurboQuant on a MacBook Pro, part 2: perplexity, KL divergence, and asymmetric K/V on M5 Max

🌐 dev.toSource

From Dev RSS Feed: TurboQuant on a MacBook Pro, part 2: perplexity, KL divergence, and asymmetric K/V on M5 Max

#ai#llm#kubernetes#opensource#q8_0#turbo4#cache#symmetric
about 1 month ago

62.8% on Aider Polyglot from a MacBook Pro. Then the other model we tried scored 4%. Here's what actually happened, with a working cost loop attached.

🌐 dev.toSource

From Dev.to - opensource: 62.8% on Aider Polyglot from a MacBook Pro. Then the other model we tried scored 4%. Here's what actually happened, with a working cost loop attached.

#infercostv030#llmkubev072#kubernetes#ai#aider#infercost#llmkube#apple
about 1 month ago