Show HN: Real-time system that tracks how news spreads across 200k websites
13 by antiochIst | 3 comments on Hacker News.
I built a system that monitors ~200,000 news RSS feeds in near real-time and clusters related articles to show how stories spread across the web. It uses Snowflake’s Arctic model for embeddings and HNSW for fast similarity search. Each “story cluster” shows who published first, how fast it propagated, and how the narrative evolved as more outlets picked it up. Would love feedback on the architecture, scaling approach, and any ways to make the clusters more accurate or useful. Live demo: https://ift.tt/suXRQyT
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment