Need Help Implementing [login to view URL] on Video Inputs for Machine Learning

Kapalı İlan edilme: 3 yıl önce Teslim sırasında ödenir
Kapalı Teslim sırasında ödenir

I'm training a video classification model using TensorFlow and Keras. Currently my data pipeline is a custom generator than reads the raw video file, do some preprocessing and feed the processed data into the model batch by batch. However, this is really slow and not scalable to large datasets.

I'm currently running the model on my university's high performance computing server, which allows me to request up to 28 cpu cores (with up to 128 gb of memory each) and 4 gpu cores per job. However, my custom generator, which processes videos sequentially are not utilizing these resources for speedup and is pretty much stuck at the I/O disk reading and video pre-processing part.

I'm unfamiliar with [login to view URL] pipeline but heard that it can prefetch data. I also heard about parallel processing but I'm unable to implement these by myself. So I'm asking for your help to write a code that can prefetch video data, do parallel processing of my videos and utilize the resources provided so that the speed of the training and prediction can be increased.

I'm going to give you more information in the chat room.

This will be ongoing work if it goes well.

Python C++ Programlama Machine Learning (ML) C Programlama Yazılım Mimarisi

Proje NO: #27500724

Proje hakkında

16 teklif Uzak proje Aktif 3 yıl önce

Bu iş için 16 freelancer ortalamada $1183 teklif veriyor

AwaisChaudhry

Hello there, How are you doing? Just saw your project posted. I read the brief details and I felt I could help you with it. Lets start the chat and discuss it in detail. Please check my porfolio: My Portfolio: https:/ Daha Fazla

$1500 USD in 12 gün içinde
(74 Değerlendirme)
8.0
sgadou

Hi, there. I am a machine learning engineer with 5+ years of hands-on experience in Tensorflow. Carefully checked your requirements. Hope to work for you with this project. Best regards, Sgadou

$1125 USD in 7 gün içinde
(15 Değerlendirme)
5.2
obsurf

Hello, I am very interested on your project, and I have confident to complete your work. I am a talented developer and have been developing software for years. I am confident to finish your task in time, I wish to work Daha Fazla

$1200 USD in 7 gün içinde
(5 Değerlendirme)
5.0
sajjadtaghvaeifr

Hi, I hope you are doing fine. I have almost 10 years of experience in machine learning algorithms. I can implement various types of artificial intelligence algorithms including yours with Matlab, Python, JAVA, etc. I Daha Fazla

$1125 USD in 7 gün içinde
(8 Değerlendirme)
4.1
engrhassanwali

Hello! I have read your project details completely and thoroughly. I am Python and have 10 years experience. Further details will be discuss in the inbox. I am waiting for your message to discuss it. Th Daha Fazla

$1500 USD in 14 gün içinde
(3 Değerlendirme)
3.5
rbn2000

I am currently pursuing my Masters in Data science and thus have a lot of experience, 2+ years to be exact, in the field of ML using python. I have done several projects such Real time hand emoji detection, Music genre Daha Fazla

$1200 USD in 2 gün içinde
(0 Değerlendirme)
0.0
omartini

Hello Thanks for your opportunity to apply this project. I have 7 years experience of computer vision and machine learning. So i have full skills and experience of this field, and have developed a lot of projects such Daha Fazla

$1125 USD in 7 gün içinde
(0 Değerlendirme)
0.0