Data Mining

This Job is to scrape course data from college websites put the data of each college into an excel document. This job should be completed within a day. College 1- Emory 1) Go to: [login to view URL] 2) Select "African American Studies" 3) Click the link to: 000: Intro To Afric Amer Studies 4) For each of the courses, collect the "Course Title", "Course Number", and "Credits" for all the courses in the subject and put it in an excel file. As an example, the first course in the art subject would be: Course Title: Intro To Afric Amer Studies Course Topic: Introduction to African American Studies Course Number: AAS 100-000 Credits: 4 5) Repeat these steps for every course and every department. 6) Delete any repetitive courses. College 2 - University of Pittsburgh 1) Go to: [login to view URL] 2) Only for the Fall 2010 Semester, go through each department in the School of Arts and Sciences, College of Business Administration, College of General Studies, Honors College and other programs, and collect the following data on each of the courses: the "Subject", "Catalog Number", "Title" and "Credits/Units". As an example, Title: Introduction To Afrcna Studies Subject: AFRCNA Catalog Number: 0031 Credits: 3 3) Repeat these steps for every course and every department. 4) Delete any repetitive courses. College 3 - Binghamton University 1) Go to: [login to view URL] 2) Select Fall 2010 and click submit 3) In the subject field, select: "AAAS - Asian Asian Am Study" and for all the other fields leave the default selection "All" and then click "Class Search". You will see a listing of courses. The first course listed should be "East Asian Civilizations (LEC) - 10020 - AAAS 106A - A 0" 4) As an example for all the other courses, for "East Asian Civilizations" you should collect the following data and put them in seperate columns on the excel sheet: Course Title: East Asian Civilizations Course Code: AAAS 106A Course Credits: 4.000 Course Type: LEC Associated Term: Fall 2010 Levels: Undergraduate 5) Repeat this for all the courses in the database. (There are about 9552 courses in the entire database.) College 4- Boston U 1) Go to: [login to view URL] 2) In the semester dropdown, Select Fall 2010. In the the class subject dropdown select "any", and click the go button that is on the right hand side of the subject field. 3) For each class listed from this search, collect "Title", "Cr Hrs", and "Course". To find the "course" for a class, click the link in the "class column" and you will see the "Course" and "Title". 4) At the bottom of the page, there will be a button that says "continue subject listing". Click that button, and continue scraping the classes until there are no more classes are displayed. College 5- BYU 1) Go to: [login to view URL] 2) Select ACC Accounting 3) You will see a list of courses displayed. 4) For each class listed from this search, collect "Course Title", "Credits", and "Course Title". 5)As an example, the first two courses listed are: Course Code: ACC 200 Course Title: Principles of Accounting Course Credits: 3.0 Course Code: ACC 241 Course Title: Business Law Course Credits: 3.0 6) Repeat these steps for all "Courses" in all "Teaching Areas" Budget : 80 USD