Devam Ediyor

Simple scraper for a website

Bid Requirement: Provide a short description of your proposed approach, including which technology/language you want to use

Project Overview:

- Build a web scraper tool that will enter an address into a specified website, pull fields from the resulting page, and then save the data to our local DB (See the attached PowerPoint screenshots for the website and the specific fields required)

- We prefer a solution using a .NET windows application, but we are willing to consider other approaches

- The tool must include a scheduling feature to run once per day

- You must deliver a simple install package with clear instructions for installation and testing

Language Requirement: You must be able to communicate by email or Skype chat (text) in English

Details:

1) Our environment is Windows Server 2008 operating system, SQL Server 2008 DB (also must work with Windows 7 and SQL Server 2008 Express)

2) You must comment all functions in English

3) Tool must include a variable to set max number of records to scrape per run. Example: if we set this to 100, and we schedule the scraper to run once per day, then the scraper will attempt to process 100 records per day

4) Tool must include a time delay variable to set how often we attempt to scrape a record. Example: if we set this to 10 seconds, then the scraper will delay 10 seconds between each address it tries to process

5) The addresses to process will be stored in our local DB in a table like the schema shown below. The results should also be written to this table. Note: you can modify the schema if necessary, but you must get our approval for the changes.

create table [url removed, login to view] (

AddressID INT NOT NULL IDENTITY (1,1) PRIMARY KEY,

County_And_State VARCHAR(1000),

Status VARCHAR(max) NOT NULL, --Status of the record: 'Queued', 'Completed' or 'Error'

Input_StreetNumber VARCHAR(100), --contains the street number to enter on the website

Input_StreetName VARCHAR(1000), --contains the street name to enter on the website

Result_Address VARCHAR(1000),

Result_City VARCHAR(1000),

Result_State VARCHAR(10),

Result_Zip VARCHAR(100),

Result_SalePrice float,

Result_SaleDate smalldatetime,

Result_Owner VARCHAR(1000),

Result_Assessment_Date smalldatetime,

Result_Assessment_Land float,

Result_Assessment_Use float,

Result_Assessment_Improvements float,

Result_Assessment_Total float,

Result_Assessment_Reason VARCHAR(1000),

Result_ErrorDetails VARCHAR(MAX) --text from any error messages received on the website

)

7) If an address has not been processed, the Status field should say 'Queued'. If a record is processed without an error, the Status should say 'Completed'. Else if a record is processed but there is an error, the Status should say 'Error'.

8) Only addresses with County_And_State = 'Prince William, VA' should be processed. NOTE: in the future we want to add additional counties to this project and each county will have a different website to scrape

Beceriler: .NET, SQL, Web Scraping

Daha fazlasını görün: work for a website, windows 8 website, powerpoint error, how to get to powerpoint, how to get powerpoint, how to get a powerpoint, how can we create website, c language overview, c for int, 4 tries, sql server max, set max schedule, powerpoint overview, max sql server, how to pull data from a website, william, website scrape, va english, tries, simple language, simple 15, scraper, scrape website, save our environment, prince

İşveren Hakkında:
( 3 değerlendirme ) Fort Mill, United States

Proje NO: #709694

Seçilen:

hoangngocit

I have had a demo for this project. Looking forward to working with you.

2 gün içinde 50$ USD
(3 Değerlendirme)
2.6

20 freelancer bu iş için ortalamada 175$ teklif veriyor

srinichal

I will use .Net for carrying out this task

in 5 gün içinde220$ USD
(88 Değerlendirme)
7.0
SigmaVisual

We can help in your project, please check PMB and our ratings/reviews to get idea of our experience.

in 5 gün içinde225$ USD
(57 Değerlendirme)
6.6
ASYanush

Good day! We are the team of developers from Eastern Europe. We can do this job. Thank you!

in 2 gün içinde150$ USD
(7 Değerlendirme)
6.4
tamrakar81

Hi, Please check PM . Thanks, Tamrakar

1 gün içinde 250$ USD
(42 Değerlendirme)
5.4
manageo

Hi I have a perfect solution for your needs, please read the pmb

in 2 gün içinde50$ USD
(22 Değerlendirme)
4.4
extract2project

Hi, Please check pmb

1 gün içinde 200$ USD
(4 Değerlendirme)
3.7
rizwanfpak

Please check your [url removed, login to view]

in 7 gün içinde150$ USD
(3 Değerlendirme)
3.4
Ravilochna

Please view my PM.

in 5 gün içinde200$ USD
(5 Değerlendirme)
3.4
TheOneInfo

Hi, I can do this job well, I have good experience in Web Scraping/Mining, web automation and html parsing in .net, and very good exp with scrapping data from property sites like [url removed, login to view], [url removed, login to view], Daha fazlası

in 7 gün içinde300$ USD
(2 Değerlendirme)
3.1
AnySolutioner

Hi, i am ready to start ur project. Please check ur PM. Best regards...

1 gün içinde 170$ USD
(3 Değerlendirme)
3.0
jinho

Sound great. This project is similar to what I'm doing. I use .Net and SQL Server. See my small demo here [url removed, login to view]

in 5 gün içinde180$ USD
(1 Değerlendirme)
2.0
Ventura123

i have something already built for this...

1 gün içinde 300$ USD
(1 Değerlendirme)
2.0
sayli2

I am expert in .[url removed, login to view] check PMB for [url removed, login to view]

in 7 gün içinde149$ USD
(4 Değerlendirme)
1.8
jasonyet

I don't think it is a hard job, to achieve a excellent performance, I prefer to use Twisted framework (from Python). If you wish, I can provide a demo for it.

1 gün içinde 30$ USD
(0 Değerlendirme)
0.0
gscoders

please check PMB.

in 5 gün içinde200$ USD
(0 Değerlendirme)
0.0
rkfuturetech

Hello, We are interested to work with you and ready to start project on immediate basis. Please check PMB for more detail. Regards, Bhavik

in 4 gün içinde200$ USD
(0 Değerlendirme)
0.0
sharphorse

Please check PM

in 5 gün içinde150$ USD
(0 Değerlendirme)
0.0
OptimalSoftware

i have very good experience on web crawling and i already had developed alot of this tools.

in 10 gün içinde100$ USD
(0 Değerlendirme)
0.0
techwelfare

We can develop as per your requirement. u could check that out. we can work till your satisfaction. -- Please check My PMB

in 12 gün içinde222$ USD
(1 Değerlendirme)
0.0