Menu

Post image 1
Post image 2
Post image 3
Post image 4
Post image 5
1 / 5
0

Source Score: Using AI to automate addition of new sources

DEV Community·Amit Singh·21 days ago
#SY0pFLQf
Reading 0:00
15s threshold

This post is a continuation of a microservice I've been building. You can check out my last post in the series here . Automate News Source Ingestion with Firecrawl, OpenRouter, and GitHub Actions TL;DR : I turned a manual, copy‑paste routine for adding news outlets into a fully automated, monthly GitHub Actions workflow. The pipeline scrapes a ranking page with Firecrawl, extracts clean URLs using three free‑tier LLMs on OpenRouter, generates Source YAML files, and opens a PR that lands these sources straight on the live dashboard post merge. How it all began When I first ingested sources in source‑score database I seeded it with five manually‑added outlets. It was enough to verify that the endpoints work, but I kept thinking about the “real” world: the top global media brands that people actually read. I wanted the repo to stay fresh without someone constantly creating PRs to add new sources.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.

Read More