Extract and verify book titles from bookshelf photos using GPT-4o and Google Books

Use Case: Analyze images with multiple subjects. In this use case I have a bookshelf and am extracting and verifying book titles/authors from a bookshelf photo.

How it works: 1) Webhook receives an image url from a front end in which a user can upload a picture. - In this use case, it is an image of a book shelf. 2) Edit Field (Set): Saves image in a consistent location so AI can find it. 3) Analyze Image: Image is analyzed. - Extracts titles from the book spines 4) Code: Splits extracted subjects to single item to be able to validate each item separately. - Books are individualized to their own entity 5) HTTP Request validates each subject. - Queries Google Books to validate books in case only partial titles were found. 6) Edit Field (Set): Tidies the result. 7) Code: Aggregates and deduplicates - Titles and authors are aggregate into a list 8) Respond to Webhook returns list to front end

How to use: Use with a frontend that can capture images and receive back the result. For this use case Supabase was used to store images from which the image analyzer could reference.