workflows.fit
Back to n8n workflows
n8n templateFreeBy Adam Janes

Automate LLM testing with GPT-4 judge & Google Sheets tracking

How it works - The workflow loads a list of test cases from a Google Sheet (previous results stored from an LLM) - For each test case, we execute a call to an LLM judge in parallel (using HTTP Request + Webhook nodes)...

Data & StorageProductivityDevelopmentCore NodesAILangchainMergeOutput Parser Structured
Loading interactive preview...

Template notes

How it works - The workflow loads a list of test cases from a Google Sheet (previous results stored from an LLM) - For each test case, we execute a call to an LLM judge in parallel (using HTTP Request + Webhook nodes) - The judge uses the Input, Output, and Reference Answer fields from the spreadsheet to mark each LLM response as Pass/Fail - The results are logged into a separate sheet in the same Sheets file.

Set up steps: - Add your credentials for Google Sheets and OpenRouter (or replace the OpenRouter node with your favourite chat model). - Make a copy of the example Sheet to populate it with you own test data. - Run the workflow with the Execute Workflow button next to the Manual Trigger node.