Build a multi-site content aggregator with Google Sheets & custom extraction logic

An intelligent web scraping workflow that automatically routes URLs to site-specific extraction logic, normalizes data across multiple sources, and filters content by freshness to build a unified article feed.

What Makes This Different: - Intelligent Source Routing - Uses a Switch node to route URLs to specialized extractors based on source identifier, enabling custom CSS selectors per publisher for maximum accuracy - Universal Fallback Parser - Advanced regex-based extractor handles unknown sources automatically, extracting title, description, author, date, and images from meta tags and HTML patterns - Freshness Filtering - Built-in 45-day freshness threshold filters outdated content before saving, with configurable date validation logic - Tier-Based Classification - Automatically categorizes articles into Tier 1 (0-7 days), Tier 2 (8-14 days), Tier 3 (15-30 days), or Archive based on publication date - Rate Limiting & Error Handling - Built-in 3-second delays between requests prevents server overload, with comprehensive error handling that continues processing even if individual URLs fail - Status Tracking - Updates source spreadsheet with processing status, enabling easy monitoring and retry logic for failed extractions

Key Benefits of Multi-Source Content Aggregation: - Scalable Architecture - Easily add new sources by adding a Switch rule and extraction node, no code changes needed for most sites - Data Normalization - Standardizes extracted data across all sources into a consistent format (title, description, author, date, image, canonical URL) - Automated Processing - Schedule-based execution (every 4 hours) or manual triggers keep your feed updated without manual intervention - Quality Control - Freshness filtering ensures only recent, relevant content enters your feed, reducing noise from outdated articles - Flexible Input - Reads from Google Sheets, making it easy to add URLs in bulk or integrate with other systems - Comprehensive Metadata - Captures full article metadata including canonical URLs, publication dates, author information, and featured images

---

Who's it for

This template is designed for content aggregators, news monitoring services, content marketers, SEO professionals, researchers, and anyone who needs to collect and normalize articles from multiple websites. It's perfect for organizations that need to monitor competitor content, aggregate industry news, build content databases, track publication trends, or create unified article feeds without manually scraping each site or writing custom scrapers for every source.

How it works / What it does

This workflow creates a unified article aggregation system that reads URLs from Google Sheets, routes them to site-specific extractors, normalizes the data, filters by freshness, and saves results to a feed. The system: