Devam Ediyor

c# Data gathering from web applications


I have a program that gathers data from websites (adult). Each website is represented by a class with several methods (get articles from index, get data from article, etc.)

I need to create new classes for data collecting from a particular website (one for each website), no login is required. The data will then be structured as an object and returned.

I can provide you with some examples from other websites, usually it is very similar.

I have about 100 websites in a queue, waiting to be created. Some websites have a very similar structure, so the differences between those are minimal, usually some html tag has a different name/id.

I would prefer to split this project into more milestones - each milestone would represent 20 pages (or less/more depends what you prefer) and when the milestone is done, then you would start to work on a next batch of websites

First milestone will be a little bit harder/more complex (depends on your skills), but I need those sites to be done first.

It’s 6 very similar websites with almost identical html/JavaScript structure, but to access those websites there is a need to bypass double google captcha (at least from the server where I need the program to be running). Check no robot box, wait and check second no robot box, then the page loads, it’s google recaptcha).

In this case I would prefer a solution like this (if it is even possible):

- when captcha happens, sends the captcha link by email and wait till the captcha is filled on another device

- usually on mobile phone I will open the email and fill the captcha

- when it's done, process continues

Or if not possible, I would imagine something like this:

- when captcha happens, opens chrome with google captcha and waits till the captcha is done manually

- when captcha is filled, close/hide the chrome window and continue in the process

Other websites don't require the captcha bypass, so they won't be that complex.

When possible, I always prefer to use htmlagility pack, otherwise I'm using selenium chrome.

Except the captcha, it is not a complex scripting. Maybe a little time consuming, but I can provide you with a couple of done website where you can check how it was done and re-use the code for creating new classes.

In proposal, please let me know if you have done something similar in the past. And what would be the price.

Thank you and kind regards,


Beceriler: .NET, C# Programlama, HTML, Javascript

Daha fazlasını gör: php display data tables web page, clone web applications, data net web application excel macro, research data gathering, layout examples crud web applications, create single page web applications php, software database driven web applications, programming data entry web page, web applications data entry layouts, data gathering web site design, pda data gathering applications, web data gathering extjs, web page data gathering, importing data excel sheet j2ee struts web applications, gathering web data, web data gathering free, cool web applications data processing, web applications solution developer, SQL, ASP.NET,MVC ,C#, .NET ,Web applications , Windows Applications

İşveren Hakkında:
( 16 değerlendirme ) Hradec Kralove, Czech Republic

Proje NO: #23962153



Nice to meet you on freelancer. My name is Da Zhang. I am an experienced C# programmer with more than 3 years scraping experience. Look at my upwork profile also: [login to view URL]~016a0f5cbf2aeb73ea? Daha Fazla

%selectedBids___i_period_sub_7% gün içinde 250%project_currencyDetails_sign_sub_9% %project_currencyDetails_code_sub_10%
(7 Değerlendirme)

Bu iş için 25 freelancer ortalamada $508 teklif veriyor


Hello there, I have read out the details of your project. And I am one of the suitable candidates for your project. We have more than 9 years exp in the development. We have focused to deliver perfect valuable deliver Daha Fazla

$700 USD in 30 gün içinde
(163 Değerlendirme)

Dear, Thank you for your job posting I have read your requirement carefully and I understood what you want. I am very happy to see the job which is matching my skills and experiences. I have 19+ years of experiences in Daha Fazla

$700 USD in 7 gün içinde
(3 Değerlendirme)
$444 USD in 10 gün içinde
(42 Değerlendirme)

Hi Matej You described proposal very carefully. Thanks again for your detailed explanation. I can help you with this project. I will use selenium mainly for this project and can do this project in 5 days.

$600 USD in 10 gün içinde
(9 Değerlendirme)

Hello Sir, I have read your requirement carefully. you need a web application We can do this job easily.. I have already developed many WEB APPLICATION, ERP,CRM,School management system, Hospital management system, Daha Fazla

$500 USD in 12 gün içinde
(18 Değerlendirme)

Hi I am a C#/html/JavaScript expert and I ONLY apply to jobs when I know I can do it. I am confident that I will deliver you the best solution possible and will exceed your expectations. I never left a client unsatisf Daha Fazla

$750 USD in 7 gün içinde
(24 Değerlendirme)

Dear client. Hope your are doing well. What about using python for your jobs? I am a python web scraping expert, I did many scraping job with python. I know how to avoid the captcha and how to make the classes for spec Daha Fazla

$500 USD in 7 gün içinde
(9 Değerlendirme)

Hi. Excuse me, you only want C#? how about using python for your goal? I have over 5 years of experience with python. I have already completed several scraping projects on this site, so I can deliver 100% result to ti Daha Fazla

$500 USD in 3 gün içinde
(9 Değerlendirme)

Hi there I have just read your post and interested in it. I am a web expert having great experience in .NET, C# Programming, HTML, Javascript. I will provide you the website as per your requirements where you can eas Daha Fazla

$555 USD in 7 gün içinde
(5 Değerlendirme)

Hi I have done this type of project in past. I can do this project. I have few questions about the requirements. Please message me so that I can discuss the project in details with you. Warm Regards Amit Bandana

$611 USD in 8 gün içinde
(9 Değerlendirme)

Greetings, this kind of job is my every day job, I am an Electronics Engineer/Software Developer, I have worked reversing both hardware & software (which I enjoy most, by the way).Here you can find a video sample of a Daha Fazla

$600 USD in 7 gün içinde
(1 Yorum)

Hi, I am an Expert Software achitect (12+ Years) and 100% confident to presentthe Possible Cheapest Solution for this work post. -I am ready for Technical Discussion/Interview -Available as per your time zone - Daha Fazla

$744 USD in 9 gün içinde
(6 Değerlendirme)

Hello, how are you? I had read your description very carefully. I can make the application for gathering data from multiple websites. I already had many experiences in bypassing google captcha with c#. Also I used for Daha Fazla

$300 USD in 7 gün içinde
(2 Değerlendirme)

Dear Client I have read your description very carefully and I am sure that can complete your project perfectly in short time. The Honest and Hard Work is diffterent than other freelancers. I am a new Freelancer but a A Daha Fazla

$250 USD in 7 gün içinde
(3 Değerlendirme)

Dear Client, I have read your requirement in detail. I have several projects of scraping with C#, Python, etc. We can start work immediately, and I can lead this project to perfect result. Thanks, Regards.

$500 USD in 7 gün içinde
(1 Yorum)

Hello, Thanks for your job posting. I read your requirements carefully and feel your job just fits my skills. I am good at web scraping using Python, c#, and PHP. And I have rich experience in this area. So I confident Daha Fazla

$500 USD in 5 gün içinde
(2 Değerlendirme)

Hi, We have over 11 years experience in developing web based software. As part of this, we have internally built scrapers to pull data from other websites and also for our own site for SEO audits. We have recently de Daha Fazla

$500 USD in 7 gün içinde
(0 Değerlendirme)

I can works wonders for you and enthusiast to do new and complex jobs . I am a Gold medalist in Information Technology I also have a team under me with different expertise (like developing , designing , content wri Daha Fazla

$300 USD in 5 gün içinde
(0 Değerlendirme)

Dear Prospect Hiring Manager, After a full understanding of your project description, I can say I could help you with strong interests and desire. I will use a mixture of selenium and htmlagility pack for your proj Daha Fazla

$750 USD in 60 gün içinde
(0 Değerlendirme)

Hello, I read your requirement and I am able to design a Project for you in .NET C# I'm a new freelancer, but Honesty and hard work is the difference between others. I am a C# and ASP.Net, MVC Expert. I can offer you Daha Fazla

$500 USD in 7 gün içinde
(0 Değerlendirme)