Menu

Post image 1
Post image 2
Post image 3
1 / 3
0

I Built a Local-First Alternative to LangSmith After Spending $200 Debugging a Pipeline I Couldn't See | Shivnath Tathe

DEV Community·Shivnath Tathe·21 days ago
#hfhDmm4P
Reading 0:00
15s threshold

Last month I spent $200 on OpenAI tokens debugging a RAG pipeline. I had no idea which step was eating my budget. LangSmith would have helped — but I didn't want to send my prompts to a cloud service just to debug locally. So I built opensmith. What is opensmith? A local-first LLM pipeline tracer. Zero cloud. Zero setup. Everything stays on your machine. pip install opensmith Enter fullscreen mode Exit fullscreen mode How it works One decorator: from opensmith import trace @trace ( tags = [ " rag " , " production " ]) def pipeline ( query : str ): docs = retrieve ( query ) return generate ( docs , query ) Enter fullscreen mode Exit fullscreen mode That's it. opensmith captures: Function name, inputs, outputs Latency in milliseconds Token usage per step Cost estimate Errors with full stack trace Parent-child relationships for nested calls The dashboard opensmith ui Enter fullscreen mode Exit fullscreen mode Opens at localhost:7823 . Live WebSocket updates, search, filters, charts. No account needed.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.

Read More