Kapalı

Web Scraping Engine - 5 Sites Initially

We are launching a new aggregation service for specialty financial data. The service will work just like Yodlee but serve different data related to financial transactions. All sites are secured with credentials, which we will store, and some have challenge questions.

We need a web scraping engine developed that can operate in real time and in batch. The engine must be able to scale to an enterprise level and be multi-threaded. We will store the user credentials so the engine must be able to cycle through different credentials to gather the data for that user and populate a database. Some of the sites are not straight-forward and use Ajax and other technologies that make scraping more difficult. For this project we will want five sites scraped initially but will add many more if the engine works properly.

In short, we are looking for web scraping experts that can develop not only the initial product but also help maintain it and add sites. We can provide some initial site credentials as samples if you like.

We have developed a proof of concept using the technologies listed below but we are open to whatever works.

Selenium Webdriver

PhantomJSDriver

C#

Webscraping

MSSQL

Entity Framework

Asp.NET MVC

Asp.NET Web API

HTML Agility Pack

ITextSharp

Beceriler: Veri Madenciliği, Web Scraping

Daha fazlasını gör: yodlee help, webscraping service, web scraping c#, web scraping api, web framework ajax, data web scraping, data mining data scraping service, data challenge, concept challenge, challenge web, challenge sites, a web service for scraping, asp net scraping, asp.net experts, asp net experts, ajax web framework, webdriver selenium, web technologies 2014, mvc entity framework, entity framework mvc, asp.net mvc ajax, data mining service, Webscraping, web scraping service, web api

İşveren Hakkında:
( 2 değerlendirme ) Alpharetta, United States

Proje NO: #6523536

Bu iş için 25 freelancer ortalamada $581 teklif veriyor

mantislin

Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi

in %bids___i_period_sub_35% gün içinde573%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(203 Değerlendirme)
7.2
webscrapinggurus

I specialize in web scraping jobs like this. You can see on my profile that I have completed many similar jobs. I can have this project done properly and in a timely manner.

in %bids___i_period_sub_35% gün içinde1578%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(61 Değerlendirme)
7.0
srinichal

I am an expert in crawling and willing to discuss in depth about the project details and deliver the same.

in %bids___i_period_sub_35% gün içinde526%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(63 Değerlendirme)
6.7
uumarkhalid31

hi, i am expert in web scraping and interested in this project, let me do this work with perfection, accuracy and according to your requirements, plz contact with me so we can discuss further about the project and plz Daha Fazla

in %bids___i_period_sub_35% gün içinde263%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(213 Değerlendirme)
6.8
uumairkhalid

Hi.. Expert Web Scraper & Data Minor here. I have done too many similar project in past. Having best scraping tools and experience i assure you 100% accurate and good quality work. I have too too scraping experience. Daha Fazla

in %bids___i_period_sub_35% gün içinde555%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(158 Değerlendirme)
6.9
mmadi

Hi, Iam interested in your project and I will be happy to do that for you. I have rich experince in scrapping curl regular expressions Dom and Selenium RC. I worked for [url removed, login to view] and [url removed, login to view] search Daha Fazla

in %bids___i_period_sub_35% gün içinde500%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(6 Değerlendirme)
5.9
Yknox

I'm interesting your project very well I'm a Good C/C++, C#, PHP, Web Scrap, Compiler-Compiler expert. I understand your req exactly. I m quite well experienced in these jobs, for example Fifa auto buyer etc. So Daha Fazla

in %bids___i_period_sub_35% gün içinde500%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(26 Değerlendirme)
6.1
aoefmpes

Hello Sir, I have much experience on web scraping and data mining . I have worked on many project using Selenium Webdriver, Phantomjs, C# and other scraper engine . I use selenium and Phantomjs to scrape data from Daha Fazla

in %bids___i_period_sub_35% gün içinde511%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(55 Değerlendirme)
5.8
iDivya

Hello, Thank you for inviting me to bi on your project. I have expertise in most of the technologies you've listed - and have vast experience is scraping off sites of differing structures and complexities. Do se Daha Fazla

in %bids___i_period_sub_35% gün içinde555%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(18 Değerlendirme)
4.9
mkhrsunil

Hi, I can develop excel based VBA scrapper in any technology (Java or Ajax based), auto login and logout with pop-up data I have already developed gmail auto login crawler - please visit my profile Please shar Daha Fazla

in %bids___i_period_sub_35% gün içinde250%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(8 Değerlendirme)
4.5
dabing1205

I am an scrapy expert, and have many scrapy experience here. I am interested in your project and have another whole toolset for your project, please contact me through your PM and discuss more details for your project, Daha Fazla

in %bids___i_period_sub_35% gün içinde555%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(12 Değerlendirme)
4.6
RajHeartbeat

A proposal has not yet been provided

in %bids___i_period_sub_35% gün içinde555%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(14 Değerlendirme)
4.8
bob1982

Hi, I have great experience in website data extraction. i have done the extraction of many sites like [url removed, login to view],[url removed, login to view],[url removed, login to view],[url removed, login to view],[url removed, login to view],[url removed, login to view] and many more i have read th Daha Fazla

in %bids___i_period_sub_35% gün içinde555%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(12 Değerlendirme)
4.5
Ibrahim33

Hello Dear my name is Ibrahim Ragab I'm Professional English-Arabic translator , creative Arabic writer and Communication [url removed, login to view] I'm an administrative assistant specializes in all kind of data entry ser Daha Fazla

in %bids___i_period_sub_35% gün içinde388%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(12 Değerlendirme)
3.5
DuPingPing

A proposal has not yet been provided

in %bids___i_period_sub_35% gün içinde555%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(2 Değerlendirme)
2.5
palinco2003

I am a professional and an experienced academic and web market researcher, fully proficient in marketing and research writing styles. I can find the minuet information from the web; I have an excellent record of accomp Daha Fazla

in %bids___i_period_sub_35% gün içinde444%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(9 Değerlendirme)
3.1
canuckcoder

Hi there. I have a lot of experience with this sort of project. I've created a lot of robust multiprocess web automation console apps for everything from as simple as scraping data to complicated tasks on various socia Daha Fazla

in %bids___i_period_sub_35% gün içinde777%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(2 Değerlendirme)
2.4
hjkaye

I operate a consultancy based in Australia, with an office in Israel. We are experts in IBM technology and have built a web data mining application that can handle more than 90% of current web formats. It is extremel Daha Fazla

in %bids___i_period_sub_35% gün içinde400%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(1 Yorum)
2.0
cracken

I can parse 20K data profile or higher per day depending on the requirements. Besides, I can used Python APIs like BeautifulSoup, multiprocessing/Pool and urllib2 for efficient processing and fast turn around time for Daha Fazla

in %bids___i_period_sub_35% gün içinde555%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(4 Değerlendirme)
2.1
phoenixtechnoin

​ ​​​​​​Current WEB SCRAPING Jobs:​​ ​https://www.freelancer.com/projects/Write-Whatsapp-Bulk-Messaging-Software.html ​https://www.freelancer.com/projects/XML/Trulia-source.html​ ​https://www.freelancer.com/pr Daha Fazla

in %bids___i_period_sub_35% gün içinde561%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(1 Yorum)
1.9