Given a URL, and list of websites, the app has to find the URL in the list of websites. Basically it will download pages of each website, based on the depth, and see if the link is present. When the present sign of link is found, the link is noted in the db and next website is then searched.
The app should allow the provision to specify the depth to search and number of threads. Number of threads will be used to download multiple pages at a time, so analysis can be done faster.
Once it completes the check on all websites, it should save the report in the app directory in excel / csv format with filename as
[url removed, login to view]
Need this done quickly.