Ranter
Join devRant
Do all the things like
++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatar
Sign Up
Pipeless API
From the creators of devRant, Pipeless lets you power real-time personalized recommendations and activity feeds using a simple API
Learn More
Comments
-
Try a proxy switcher...I remember a tool called multiproxy from back in the days...changed IP (proxy) on every mouse click...
-
K-ASS25457y@teganburns wait... Don't scrape.... Is there a way to get the data without scraping the website?
-
C0D4669027yIf your scraping data, and they don’t have an API, limit your requests per minute so your not seen as an abusive visitor.
Otherwise you’ll need to get a few proxies involved and jump between them per n requests. -
Maybe have a look at those scraping services like mozenda...
Tip: you can scrape the mozenda tool as well, ;) -
K-ASS25457y@C0D4 I've done that before actually, the limiting part. I think now I just need to find a way to change my IP every other 10 minutes
-
ChangeIP-12yTry Hotspot Switch IP! Is a new free app for Android which allows You to change your hotspot IP remotely via built in web server, or automatically using timer(so yes, You can change your ip every other 10 minutes). You can find it on Google Play!
Related Rants
Is there a way to dynamically change your IP address while scraping website so that you don't get blocked cojstantly
question
scraping
ip
python