Originally published on Medium . I was 3am browsing Reddit when I stumbled upon the LocalLLaMA subreddit. I'd heard of it, but never really looked into it. The top post was about someone using LocalLLaMA for text summarization. I was skeptical. I mean, how good could it be? Here's the thing... I've been working on a project that involves a lot of text data. We're talking millions of documents. And I've been using a bunch of different models to try and make sense of it all. But nothing seemed to be working that well. So, I decided to give LocalLLaMA a shot. Nobody talks about this, but the first time I tried to use LocalLLaMA, I failed miserably. I mean, I couldn't even get it to install properly. I was trying to use the pre-trained model, but it just wouldn't work. I spent hours debugging, but nothing seemed to work. I learned this the hard way... don't try to use a new AI model when you're tired. Take a break, come back to it later. Anyway, the next day I tried again, and it worked like a charm.…