Hi, I am using landing page template I bought from a developer a while back and I send traffic to it from Instagram. Whenever a visitor inserts his Instagram username in my page, the page crawls/scrapes his Instagram profile to extract data like avatar, number of followers and his posted images (which will be used later).
Not long ago Instagram imposed a limit and blocks scraping after a certain number of tries and I have to bypass this limit by doing it though proxy. So I need:
- my landing page template adjusted so each consecutive user query is done through a new proxy (from a specific proxy list I provide - 5 at the beginning)
- if the scraping fails it might be because of two reasons: username is typed wrong, or Instagram blocked scraping. We have to do a check at this point using a popular Instagram username like [login to view URL] If scraping still does not work I need it to send me an email -> and then use a backup proxy. If scraping works on the popular account, then do username is wrong message to the visitor.
- if the backup proxy also fails I need it to send me another email.
- I also need the scraping to be done through browser emulation because it looks Instagram allows more scraping to be done from each proxy in this way.
I'm looking for a web developer with which I can collaborate closely on other future projects as well. This is just the first from a series of jobs I need done.
Bu iş için 20 freelancer ortalamada $72 teklif veriyor
Hello, sir Thank you for your job posting. I am an expert with web scraping with python selenium, scrapy and beautifulsoap and nightmarejs. Also I am very familiar with proxy. I have developed many scripts that get dat Daha Fazla
Hello nice to meet you... How are you. I am senior web developer with 7 + years . The developer that you find is me. Please contact me. Thank.
Hi There! I have more than 8-year experience in this field. Would you please share more details about the project? I am really interested to work with you for long. Best Regards, Abhishek