Automate document ingestion & RAG system with Google Drive, Sheets & OpenAI

1. Overview

The IngestionDocs workflow is a fully automated document ingestion and knowledge management system built with n8n. Its purpose is to continuously ingest organizational documents from Google Drive, transform them into vector embeddings using OpenAI, store them in Pinecone, and make them searchable and retrievable through an AI-powered Q&A interface.

This ensures that employees always have access to the most up-to-date knowledge base without requiring manual intervention.

------------------------------------------------------------------------

2. Key Objectives

- Automated Ingestion → Seamlessly process new and updated documents from Google Drive.\ - Change Detection → Track and differentiate between new, updated, and previously processed documents.\ - Knowledge Base Construction → Convert documents into embeddings for semantic search.\ - AI-Powered Assistance → Provide an intelligent Q&A system for employees to query manuals.\ - Scalable & Maintainable → Modular design using n8n, LangChain, and Pinecone.

------------------------------------------------------------------------

3. Workflow Breakdown