Crawl websites & answer questions with GPT-5 nano and Google Sheets

Web Consultation & Crawling Chatbot with Google Sheets Memory

Who is this workflow for? This workflow is designed for SEO analysts, content creators, marketing agencies, and developers who need to index a website and then interact with its content as if it were a chatbot. ⚠ Note: if the site contains many pages, AI token consumption can generate high costs, especially during the initial crawling and analysis phase.

---

1. Initial Mode (first use with a URL)

When the user enters a URL for the first time:

1. URL validation using AI (gpt-5-nano). 2. Automatic sitemap discovery via robots.txt. 3. Relevant sitemap selection (pages, posts, categories, or tags) using GPT-4o according to configured options. (Includes “OPTIONS” node to precisely choose which types of URLs to process) 4. Crawling of all selected pages:

Downloads HTML of each page. Converts HTML to Markdown. AI analysis to extract:

Detected language. Heading hierarchy (H1, H2, etc.). Internal and external links. Content summary. 5. Structured storage in Google Sheets: