Menu

Post image 1
Post image 2
1 / 2
0

Hit 73% accuracy on the classifier, which is probably fine for now

DEV Community: nlp·Sastra kasra·3 days ago
#30FYfxei
#dev#anyway#classifier#accuracy#mostly#fine
Reading 0:00
15s threshold

So I finally got the topic classifier to a place where it doesn't actively embarrass me — 73% accuracy on the validation set, which is honestly higher than I expected after three weeks of mostly guessing. I used LangSmith for the eval runs mostly because I saw it mentioned in a thread here and the logging UI saved me from going blind in the terminal. The dataset is still a mess — had to relabel about 600 examples by hand after realizing our previous annotator was marking "technology" as "science" about half the time, which explained a lot. The weird part is that I'm now unsure whether 73% is actually enough for the MVP demo next Friday. Maybe it's fine and I'm overthinking it. The classifier works fine on clean inputs but I'm watching it choke on typos, which feels solvable but also not something I want to debug on a deadline.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.

Read More