Kapalı

ElasticSearch expert - build search index on millions of files

I have crawled several thousand sites and saved the html from those sites into json along with some structured meta data. we need to import all of these json blobs in to ElasticSearch so that we can query all of the pages for specific terms, keywords, and phrases. we need help getting all of this setup and done. each document/page is roughly 20K so this data is massive since we are storing a ton of html and redundant data but its critical that we can search the html for specific things. I need someone that is familiar with how to deal with this much data (terabytes) in a quick and cost effective way. I see it that we can either spin up a massive AWS server or maybe a cluster of servers (from digital ocean) each running some portion of the data. overall we need help, our timeline is short and we need to get someone that has already learned a lot of lessons about doing this. I expect this to be in the 50-100 million row range.

we are still gathering data but we have a lot of representative data to go ahead and get started with

let me know in your bid how awesome you are with ES, for sure i'm looking for an expert :)

Beceriler: Elasticsearch, NoSQL Couch & Mongo, SQL, Ubuntu

Daha fazlasını görün: mongo or, aws sql server, mongo, meta expert, massive data, json nosql, help with data gathering, elasticsearch, digital ocean, couch, cluster server, AWS server, aws expert, aws cluster setup, sql maybe, quick json, aws cluster, elasticsearch server setup, import json data sql, setup elasticsearch, sql server import json, import json data sql server, crawled data, import json sql server, json query

İşveren Hakkında:
( 454 değerlendirme ) Austin, United States

Proje NO: #6559543

7 freelancer bu iş için ortalamada 31$/saat teklif veriyor

cupertinovw

Hi, I have worked on ElasticSearch using large terabyte datasets. A large AWS or Google Cloud instance may be economical as a lot of data transfer is required. Portfolio: [url removed, login to view] Let me know, Daha fazlası

41$ USD / saat
(15 Değerlendirme)
7.4
PSSPL2000

Hi Greetings !! Thank you very much for giving me opportunity to bid on your project. We are having team of experienced developer and they have good sound on AWS, Elasticsearch, NoSQL, MongoDB etc. Please mess Daha fazlası

25$ USD / saat
(13 Değerlendirme)
6.8
Excellentlancer

A proposal has not yet been provided

25$ USD / saat
(0 Değerlendirme)
0.0
glontbay

Hello, Hope you had a great day today. I know you are looking for I.T. Programming partners to work on your projects. I will not tell you that we can do this and that; alternatively I would like to find the solut Daha fazlası

50$ USD / saat
(0 Değerlendirme)
0.0
neosign

ข้อเสนอยังไม่ได้ระบุ

41$ USD / saat
(0 Değerlendirme)
0.0
sumitguptasgt

A proposal has not yet been provided

27$ USD / saat
(0 Değerlendirme)
0.0
emilemilot

Hello, I really want to work on your project with technologies I like to work on. I am new in freelancer and I am searching for good reviews. It could be a very good opportunity for you. I want to provide my best Daha fazlası

26$ USD / saat
(0 Değerlendirme)
4.4
girnarsoft

A proposal has not yet been provided

26$ USD / saat
(0 Değerlendirme)
0.0
neilunadkat

Hi there, I am one of the founders of Appacitive which is a backend as a Service. You can checkout the video here ([url removed, login to view]) Our platform is made on top of Elastic search. I would suggest tha Daha fazlası

35$ USD / saat
(0 Değerlendirme)
0.0