I am looking for a program that crawls/scrapes all MLM replicated websites
to get the FIRST NAME, LAST NAME, PHONE NUMBER (WITH AREA CODE), the WEBSITE URL OF THE MEMBER (which is the long url where the data of each member was extracted from), the EMAIL (if the email exists), and the STATE.
The software must be able to pull all of the data from BOTH types of URLS listed below.
The first type of URL are those MLM companies that use the “?this=this&that=that&id=” format and then they display the number of the affiliate after the equal sign. The second type of URL is one that displays the username of the affiliate after the main MLM website’s URL. It would need to crawl through all the usernames and all the ids, extracting all the data.
1. [url removed, login to view]
2. [url removed, login to view]
This software must allow me to type in any URL and then click “Start". Then the script would go through and pull the data from every affiliate of that website that I have entered and I would be able to export the data into a comma delimited CSV file that has the appropriate column titles at the top with one member’s information per row. It would have to scrape an unlimited # of affiliates/members on each website URL.
In order to accomplish the first type of URL, please include two optional fields. Optional fields are “Start with id#” and “End with id#”. This is so I can manually enter a selected range of ids to extract from any URL that has id #s
Thanks a lot!