Dec-11-2019, 04:53 AM
HI,
Actually, I am scrapping a website in python using selenium and beautiful soup, and I am able to scrape it as well but many times it happens that while I am running the code, the website shows a blank screen and it displays a message as well, something like unusual activity.
I have used sleep time around 10 sec but nothing will work. I have heard about IP rotation but not able to use it in my algorithm.
anticipating for suggestions.
Actually, I am scrapping a website in python using selenium and beautiful soup, and I am able to scrape it as well but many times it happens that while I am running the code, the website shows a blank screen and it displays a message as well, something like unusual activity.
I have used sleep time around 10 sec but nothing will work. I have heard about IP rotation but not able to use it in my algorithm.
anticipating for suggestions.