WhatsApp AI agent that understand text, image , audio

Overview 📌

This template is a multimodal WhatsApp assistant that understands text, images, and audio, aggregates media inputs, and returns intelligent replies using Google Gemini. It can fetch knowledge from Google Docs, log conversations into Google Sheets, and respond via WhatsApp — all orchestrated inside n8n.

Features ✨

Multimodal input handling: Receives images and audio from WhatsApp, analyzes them, and sends contextual responses. 🖼️🎧

Audio transcription: Converts voice messages to text for analysis. 🔊➡️📝

Image analysis: Extracts objects/labels/text from images to inform responses. 🖼️🔍

Knowledge fetch: Pulls relevant documents from Google Docs for richer answers. 📄📚

Conversation logging: Appends each interaction to Google Sheets for auditing or analytics. 📈