I need to adapt my python algorithm to Dask or spark or apache Hadoop in order to scale my algorithm to work with big data

Kapalı İlan edilme: 2 ay önce Teslim sırasında ödenir
Kapalı

Over the past years, I have devoted myself to a project involving Algorithmic Trading. My system leverages only pricing and volume data at market closing. It studies technical indicators for every stock in the S&P 500 from its IPO date, testing all possible indicator 'settings', as I prefer to call them.

This process uncovers microscopic signals that suggest beneficial buying at market close and selling at the next day's close. Any signal with a p-value below 0.01 is added to my portfolio.

Following this, the system removes correlated signals to prevent duplication. A Bayesian ranking of signals is calculated, and correlated signals with a lower rank are eliminated. The result is a daily optimized portfolio of buy/sell signals. This system, primarily built with numpy python, doesn’t rely on 'black-box' libraries.

I am seeking an experienced python developer to help adapt my existing algorithm to scale when working with large amounts of data. Currently, my data set consists of more than 200TB, and I need to make use of the Dask framework in order to enable better scalability.

My goal is to take my current algorithm and transform it into a scalable system that is able to handle such a massive amount of data quickly and efficiently. This means that the developer will need to engage in optimization and debugging to ensure the best performance for my algorithm. Ultimately, I am looking to improve the scalability of my algorithm so that it can meet the demands of my current dataset with no issues.

The ideal candidate should have a deep understanding of both python and Dask, as well as experience working with large datasets and optimizing algorithms. If you believe that you have the skillset necessary for this project, please feel free to submit a proposal.

Apache Büyük Veri Hadoop Machine Learning (ML) Python Trading

Proje NO: #37238316

Proje hakkında

13 teklif Uzak proje Aktif 3 hafta önce

Bu iş için 13 freelancer ortalamada $38/saat teklif veriyor

HamzaBashirr

I can help you in 200TB with apache spark. Waiting for your kind response. Thanks.

$38 USD / saat tutarından itibaren
(126 Değerlendirme)
6.5
salmanullahbaig

I understand that you are looking for a python developer to help adapt your algorithm to scale when working with large amounts of data. As a freelance developer with expertise in Data Science, Python, machine learning Daha Fazla

$38 USD / saat tutarından itibaren
(10 Değerlendirme)
5.1
hafeelmo

Hi I have read your job description carefully, and understand that you're looking for a senior Python developer. I have experience working with Dask framework. so I think that I can assist you to complete this task. A Daha Fazla

$40 USD / saat tutarından itibaren
(4 Değerlendirme)
4.7
danielrosendahl7

I understand that you are seeking a python developer to help adapt your existing algorithm to scale when working with large amounts of data. My experience makes me well-suited for this project. I have a strong backgrou Daha Fazla

$40 USD / saat tutarından itibaren
(2 Değerlendirme)
4.3
ImraanTech

Hey man ( I worked with hadoop you can check my profile ) I can help you with how you can adapt your Python algorithm to work with big data using Dask, Apache Spark, or Apache Hadoop. Each of these technologies has i Daha Fazla

$50 USD / saat tutarından itibaren
(8 Değerlendirme)
4.0
pankajcyberbells

Hi, I am a Python developer with experience working with large datasets and optimizing algorithms. I understand that your current algorithm is able to generate buy/sell signals by studying technical indicators for eve Daha Fazla

$40 USD / saat tutarından itibaren
(0 Değerlendirme)
0.0
UrvashiRajput02

***40 hours weekly I am available for work*** *** You will be able to track all work progress through the tracker*** Hi There! I'm a full-time Python programmer with knowledge in Angular, Django, and MongoDB. Heroku a Daha Fazla

$25 USD / saat tutarından itibaren
(0 Değerlendirme)
0.0
YasminSAug

To whom it may concern, I'm applying for this position since my professional experience meets your requirements and I think I can be of great help to your team. Best regards, Yasmin Selic

$45 USD / saat tutarından itibaren
(0 Değerlendirme)
0.0