Write Java web crawler for bookmaker website

For this mini project, we want you to parse [url removed, login to view], a sports-betting website.

Under /football menu, /currentodds, you will find the events that we need to get data from : [url removed, login to view] .

Click on the day (for example: "SAT 1") of one event, and the Event page will appear, where markets and selections are found. This we need to get from you.

Note: We don't need the live events(the events that are in progress/ that are already started); only non-live events.

We have attached to this project some java domain objects which you need to get from this website. The objects follow the following structure : tournament -> events -> markets -> selections. A tournament has more events, an event has more markets, a market has more selections. If you can't find the tournament, no worries, just take the rest.

When your code finishes, we need to have a List/Set/Map or whatever of the mentioned domain objects.

Steps to parse hkjc.com.

1. when clicking [url removed, login to view], in the console you will find this url : [url removed, login to view]

In the response html, you will find : "var MSN=" text to parse ". Inside text to parse you find the event ids. This is step 1.

2. At step two, when you click on the date of the events, you will find in console,

for each eventID you have an url : [url removed, login to view]

Example: [url removed, login to view]

Search for the same variable "var MSN=", and there you will find the markets + selections for each event.

Example : betValue[[url removed, login to view]]=["['10-06-2017SAT2**HAD**Oita Trinita**FC Yokohama**1**0**x**x**x**JD2**115645','2.37**homecomb**1','3.05**drawcomb**X','2.37**awaycomb**2']"];


HAD -> code for different markets (Each market has it's own no of selection)

TEams / selection names

Selection types, in this case 1/x/2

eventId 115645

selectionValue/odd for homecomb/1

selectionvaluefor drawcomb

selectionvalue for awaycomb.

Notes: The server [url removed, login to view] is in Asia, the urls will load hard if you parse it from Europe, so set connection timeout to 15 seconds.

We need to get all data structure in less than 60 seconds, so i recommend you to load asynch all events urls from second step.

We need the source code.

This is an easy first project and if you are able to complete succesfully, there will be other similar projects for you in the near future.

When bidding for this project, please make clear you have read and understand the project. Bids without specifics will be declined. Any experience in scraping bookmaker websites is very much a plus.

Beceriler: Java, Web Scraping

Daha fazlasını gör: best web page for freelance job in europe, 2500 website templates web page design templates & websites fonts graphics & html pictures dvd cd disc, website crawler web based, java, web scraping, web development, crawler web java code, web crawler method java, web crawler mysql java, web search engine crawler spider java, web crawler project java university, web crawler project java, web crawler jobs java, software write mq4, software write chip epson, useful software write book, software write web specs, java website crawler, free software write user guide, multithreaded web crawler using java

İşveren Hakkında:
( 11 değerlendirme ) Utrecht, Netherlands

Proje NO: #14297202

Bu iş için 27 freelancer ortalamada $155 teklif veriyor


Hi sir, I am scraping expert, I have did more than 350+ scraping project, please check my feedback then you will know. Can we discuss more details about this project? then I will provide example data/script Daha Fazla

in %bids___i_period_sub_35% gün içinde138%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(224 Değerlendirme)

Good day! I`m expert Java Dev with more than +7 years in It area. I have a success career in web/soft development using cutting edge Tech with latest frameworks in Java. Best Regards

in %bids___i_period_sub_35% gün içinde222%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(38 Değerlendirme)

Hello, how are you? Here is the best scrapper you are looking for. I've just read your project descryption and i am interested in it I have full experiences in web scrapping and i've already many scrapping projects s Daha Fazla

in %bids___i_period_sub_35% gün içinde155%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(25 Değerlendirme)

Hi, I am experienced software developer (more info in my freelancer profile). I have reviewed your project description and I am ready to complete this project for you. We can discuss all details in the private chat. Pl Daha Fazla

in %bids___i_period_sub_35% gün içinde200%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(58 Değerlendirme)

Hi.. I am an expert in betting project. So, I am very interested in your project, and I have built many betting scraper and auto betting bot for bet365, bwin, pinnacle, betfair, marathon, 10bet and etc.. And I have w Daha Fazla

in %bids___i_period_sub_35% gün içinde155%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(44 Değerlendirme)

I use python language and scrapy framework. My scripts works on windows, mac or linux, but linux is preferably. I have more 300 finished projects (google scraping, facebook scraping, yellow pages, linkedinIn, amazon, Daha Fazla

in %bids___i_period_sub_35% gün içinde155%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(114 Değerlendirme)

Dear Employer, With over 8 years of experience I have completed more then 200 web scraping jobs till date. I have scrapped data and images from a lot of websites (some listed below and APIs. I know how to bypass Cap Daha Fazla

in %bids___i_period_sub_35% gün içinde250%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(44 Değerlendirme)

Hi There, I would like to be considered for this project. I have 3 years experience in python, Django and web scrapping. I can complete this task in as per your requirement. Please give me a chance to prove myself. Daha Fazla

in %bids___i_period_sub_35% gün içinde222%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(72 Değerlendirme)

Greetings sir, i am an expert freelancer for this job and your 100% satisfaction is assured if you allow me to serve. Here is the reason. Why you should pick me? a) I am a very expert and have the same kind of ex Daha Fazla

in %bids___i_period_sub_35% gün içinde160%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(18 Değerlendirme)
in %bids___i_period_sub_35% gün içinde155%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(16 Değerlendirme)

I have good knowledge in below mentioned skills by you. I also have some certifications in Java. I can share some of demos with you if you want for better understanding. Currently I'm working on a banking project in an Daha Fazla

in %bids___i_period_sub_35% gün içinde99%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(39 Değerlendirme)

Hi I have 3+ experience in web development. I have completed many task like this. I have strong knowledge of Mysql, Oracle, Database Design and as languages like Java, JSP, PHP, Javascript, Bootstrap CSS, Ajgular Daha Fazla

in %bids___i_period_sub_35% gün içinde155%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(28 Değerlendirme)

Hello sir I can scrape the websites. I read through the job details extremely carefully and I am absolutely sure that I can do the project very well.  Scraping/Crawlingworking experience of more then 8 year Analytics, Daha Fazla

in %bids___i_period_sub_35% gün içinde30%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(7 Değerlendirme)

Hi, I have the able to can do your task. I would do my best on your task. You can see also my front end web site game at url = [login to view URL], ID = client, PW = ghostman and [login to view URL] site for my HO Daha Fazla

in %bids___i_period_sub_35% gün içinde250%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(7 Değerlendirme)

Hello, I'm a professional Java programmer, have been working in this area for 9 years now. I've scraped other sites successfully with jsoup library. However they weren't bookmaker sites. But your specification was v Daha Fazla

in %bids___i_period_sub_35% gün içinde200%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(20 Değerlendirme)

Hi! I can help you. I have one question though. Is Java a compulsory requirement? This can be done much faster with python. Please PM for details. Regards, Usama

1 gün içinde %bids___i_sum_sub_32%%project_currencyDetails_sign_sub_33% USD
(12 Değerlendirme)
in %bids___i_period_sub_35% gün içinde155%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(7 Değerlendirme)

Hello, I am a full-time freelancer and do web scraping jobs only. I am creating automated data extraction systems for more than two years now. Any security can be bypassed. I have already scraped millions of records o Daha Fazla

in %bids___i_period_sub_35% gün içinde35%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(9 Değerlendirme)
in %bids___i_period_sub_35% gün içinde155%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(9 Değerlendirme)
in %bids___i_period_sub_35% gün içinde155%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(5 Değerlendirme)