Generate rotating user-agents and proxy IPs for scraping APIs
✨What it does Useful for scraping only/API data. This workflow will give you the ability to bypass the IP address limitation control of some publicly available APIs by using a different couple of "user-agent" and "IP ...
Template notes
✨What it does
Useful for scraping only/API data.
This workflow will give you the ability to bypass the IP address limitation control of some publicly available APIs by using a different couple of "user-agent" and "IP address" for each call to the targeted API.
You can therefore place this workflow before any HTTP request node.
1) Generate over 9000 different user-agents that can be used randomly (or not) into each one of you API call.
Example of user-agents it can provide with for Chrome web browser :
"Mozilla/5.0 (Windows NT 11.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/134.0.6998.166 Safari/537.36"
"Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:146.0) Gecko/20100101 Firefox/146.0"