Broken link checker

$30-250 USD

Tamamlandı

İlan edilme:

yaklaşık 9 yıl önce

$30-250 USD

Teslimde ödenir

The idea: a 'tool' that checks the web for outgoing broken links on a website Steps: 1. User specifies a target keyword 1.1 script scrapes Google search results 1.2 script that follows every link it finds on the target website and registers when a link is broken (status 404 and only external DO FOLLOW links) 2. it inserts the data into a database (e.g. microsoft access) - the data needed would be: 2.1 the url of the page where it found the broken links, as well as the website domain age, Google PR, Alexa ranking 2.2 the url of the broken page (status 404) 2.3 an email address if found on the contact page Please let me know 'how' you would approach this project.

Data Mining

Data Processing

Web Search

Proje No: 7249515

Proje hakkında

7 teklif

Uzaktan proje

Son aktiviteden bu yana geçen zaman 9 yıl önce

Biraz para mı kazanmak istiyorsunuz?

E-posta adresi

Freelancer'da teklif vermenin faydaları

Bütçenizi ve zaman çerçevenizi belirleyin

Çalışmanız için ödeme alın

Teklifinizin ana hatlarını belirleyin

Kaydolmak ve işlere teklif vermek ücretsizdir

Seçilen:

@sby

A proposal has not yet been provided

$166 USD 1 gün içinde

5,0

(6 değerlendirme)

4,2

7 freelancer bu proje için ortalama $261 USD teklif veriyor

@Sonatic

First of all I want you to keep in mind that if you're going to to scrape google you'll need proxies. A lot of proxies. Also multithreading, response validation, some kind of background task runner and supervisor in case that you wanna get something stable enough. You'll need to limit the link crawling depth for websites at most to 3. I can provide you all of about, even proxies. Needs to be discussed.

$277 USD 3 gün içinde

5,0

(2 değerlendirme)

2,3

@ExpertScraper1

I work with some useful tools which is check websites broken. I am a professional data supplier now. My skills and services include: - Web scraping - Data entry - Data mining - Data processing - Excel - MySQL - Oracle - etc. Hope my skill and work can help you with your business. Thanks.

$80 USD 3 gün içinde

5,0

(3 değerlendirme)

1,9

@FabioFelgueiras

Hi, i can do this lets chat about it .........................................................................................................

$555 USD 15 gün içinde

0,0

(0 değerlendirme)

0,0

@mihairapciuc

Hi, I've done some scrapping projects before and I would handle this task by making a simple php frontend that calls a phantomjs scrapper behind the scenes. This scrapper will parse the google search resuls as well as any additional websites required for collecting the data you need. I know from experience that getting the domain age may be tricky because not all registrars use the same format in their whois protocol search results and some don't even have a publicly accesible whois address.

$277 USD 3 gün içinde

0,0

(0 değerlendirme)

0,0

@razvand70

Hi, expert web/data scraper here with over 17 years experience in programming and RDBMS - please see my reviews. I'm using Mozenda and Perl for this kind of jobs. My offer is 20 usd (without fees) per 1 000 records. I'm able to extract data fast.

$250 USD 3 gün içinde