Passive Policy Intelligence (PPI)
This project addresses Problem Statement 1: Information Management by automating the daily search, ranking, and archiving of policy-relevant content.
By Ricardo Chejfec
The Problem
Policy analysts manually track dozens of sources (government portals, think tanks, research institutions, media outlets) to stay current on their mandates. This creates two problems:
- Time waste: Hours spent searching for updates that may not exist
- Missed signals: Critical information buried in high-volume feeds
The Solution
An automated passive listener that ingests, ranks, and archives policy intelligence without manual searching. The system:
- Ingests articles daily from a user-defined list of websites
- Ranks content by semantic similarity to user-defined policy topics
- Filters using source-aware thresholds to surface relevant intelligence
- Delivers daily updates (Microsoft Teams, Email) and searchable archive (this demo, Microsft Power BI).
This demo has monitored 50+ sources daily for the past month, ranking content against four hypothetical policy topics. See the sources page for the full list.
How It Works
The system operates as an automated passive listener that continuously monitors policy-relevant sources and surfaces what matters most:
Daily Monitoring: The system checks 50+ trusted sources (think tanks, government sites, research institutions, news outlets) through RSS feeds and Google Alerts. No manual searching required.
Smart Ranking: Instead of simple keyword matching, the system looks for similarities in meaning. You define your policy focus areas in plain language (called "semantic anchors"), and the system measures how closely each article relates to those topics using a 0-1 similarity score.
Intelligent Filtering: Not all sources are equal. The system applies different thresholds based on source type - research from think tanks needs a lower similarity score to surface than a news article, ensuring important research doesn't get buried by daily news cycles.
Flexible Delivery: Results are delivered through daily Microsoft Teams notifications, email summaries, or this searchable web portal. All original content stays archived for later reference.
Why It Matters
Saves Time: Instead of manually checking dozens of websites daily, analysts receive a pre-filtered digest of the most relevant content. The work happens quietly and automatically before the workday starts.
Catches Important Signals: High-volume news feeds often bury important research. The system's intelligent filtering ensures you don't miss critical publications from relevant sources.
Maintains Control: You decide which sources to monitor and which topics matter. Every ranking is transparent - you can see exactly why something surfaced in your digest. The system recommends; you decide what to read.
Stays Secure: The system can run entirely on your own infrastructure with no data leaving your network. All processing happens locally using open-source tools.
Builds Institutional Knowledge: Everything gets archived with searchable metadata, creating a long-term reference library for policy research and tracking how issues evolve over time.
Explore the Portal
📊 Daily Review
Recent 3-day digest showing top-ranked articles across all semantic anchors
Passive Policy Intelligence | Built with Observable Framework