Do all the things like ++ or -- rants, post your own rants, comment on others' rants and build your customized dev avatarSign Up
Try a proxy switcher...I remember a tool called multiproxy from back in the days...changed IP (proxy) on every mouse click...
@teganburns wait... Don't scrape.... Is there a way to get the data without scraping the website?
C0D4567103yIf your scraping data, and they don’t have an API, limit your requests per minute so your not seen as an abusive visitor.
Otherwise you’ll need to get a few proxies involved and jump between them per n requests.
Maybe have a look at those scraping services like mozenda...
Tip: you can scrape the mozenda tool as well, ;)
@trubesv if they do that will be really nice. Unfortunately they don't