Devam Ediyor

Automated Web Scraping Based on Google Search

Develop an AUTOMATED method to create a database of pages that are the result of a Google search, the the text on those pages, and links from those pages and their text.

I want a database of pages that come from this general method:

1) run Google searches on these search terms: [register OR registration "emergency notification"] in several passes:

- run one search each for [register OR registration "emergency notification" link:xxxxxxxxx] where xxxxxxx is replaced with each of the following domains.

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

- run one search each for [register OR registration "emergency notification" xxxxxxxxx] where xxxxxxx is replaced with each of the following exact words.

CityWatch

FirstCallNetwork

CodeRed

Everbridge

TwentyFirst Century

Rave

Deltalert

OneCallNow

RapidNotify

Nixle

Swift911

Cassidian

BlackboardConnect

These searches should be as exhaustive as possible. So when google says "In order to show you the most relevant results, we have omitted some entries very similar to the XX already displayed. If you like, you can repeat the search with the omitted results included." You should repeat the search will the omitted results included.

2) For each of the searches, store the following as columns or fields in an excel spreadsheet or database format we agree on (rows will be each of the results on the google search):

- the link or search term (so they can all be identified separately)

- the URLs that google provides

- all of the text on the page for each URL

- all of the source of the page for each URL

- the date of the page if available

This attachment shows example records of what I want with added comments.

There will be 26 searches in all:

register OR registration "emergency notification" link:citywatchonline.com
register OR registration "emergency notification" link:coderedweb.com
register OR registration "emergency notification" link:alertregistration.com
register OR registration "emergency notification" link:everbridge.net
plus 9 more with the link: operator

and

register OR registration "emergency notification" "CityWatch"
register OR registration "emergency notification" "FirstCallNetwork"
register OR registration "emergency notification" "CodeRed"
register OR registration "emergency notification" "TwentyFirst Century"
plus 9 more with just the added search term.

Beceriler: Veri Madenciliği, Web Scraping

Daha fazlasını görün: swiftreach getrave, web searches database, spreadsheet on web page, nixle, google search the web, everbridge, create a web page with google, century link, century 25, spreadsheet google, google search on, google excel spreadsheet, google web search google search, google search web, web scraping excel, url scraping, Search on Google, mining from web, Google search, google search result, c++ text mining, create google spreadsheet, google text data, net data scraping, search terms

İşveren Hakkında:
( 84 değerlendirme ) Charlotte, United States

Proje NO: #4438972

Seçilen:

wbslivera

Hello, I can help you. thanks

5 gün içinde 210$ USD
(3 Değerlendirme)
2.8

4 freelancer bu iş için ortalamada 168$ teklif veriyor

ActualCreative

I have already made a google scraper tool. I can complete this project for you easily.

in 5 gün içinde210$ USD
(2 Değerlendirme)
3.2
fhasanbd

I can do this for you.........thanks

in 5 gün içinde250$ USD
(9 Değerlendirme)
3.2
pabloz1974

I can do that. I made similar projects

in 3 gün içinde110$ USD
(2 Değerlendirme)
1.9
kami7644

ready to start work

in 3 gün içinde100$ USD
(6 Değerlendirme)
1.7