We are looking for a freelance web developer to conduct basic tech stack audits on 22 e-commerce websites. Part of your task will be to determine which protections are in place to prevent an automated web crawler from accessing it at scale.
For each website, a report detailing the following information has to be provided:
1) Information regarding the general tech stack
a) Does the site utilize a known shop infrastructure (e.g. Shopify, Magento, etc.)?
b) What technology is used (analytical software, css, html, js, etc.)? List technologies
c) Are there measures in place to enable the site operator to detect whether a crawler/bot is
active on the site (e.g. through an analysis of user patterns)?
d) Is there a way to programmatically access individual product pages on the site (e.g. through a non-randomized product identifier in the URL, underlying APIs, etc.)
2) Information on Captchas
a) Does the site utilize Captchas?
i) What kind of Captcha system is in place? Please provide screenshots.
ii) Under which conditions is the user prompted with a Captcha?
3) Accessibility in different regions
a) Can the site be assessed from any country or is it region locked? Use a VPN to check the accessibility from at least five countries from five continents (Germany being a hard requirement) and provide the following information.
i) Which countries have you checked?
ii) From which countries was access to the site denied?
4) Call limits before access denial
a) Does the site block access for a given IP address after it has been called a certain number of times? Check whether accessing each site up to 1 Mio. times will lead to a blockage of the used IP address. The site requests have to be equally spread out over a time frame of 90 minutes. The exact number of required accesses for each website will be provided later.
i) If the IP address gets blocked, how many accesses did it take to reach this point?
Bu iş için 11 freelancer ortalamada €203 teklif veriyor
Hi, i m very interested for this kind of job and i am expert web developer and i can implement the tech feature, just knock me via chat, Thanks Rashedul