Kapalı

Fast GPU csv parser using Pypy and PyOpenCl

I have a lot of csv files (about 18000) containing data that I need to parse as fast as possible . The project consist of read a csv file using pypy and put it in a list. Treat the entire list (about 5000 lines) with GPU using PyOpenCl. Each line get about 40 comma separated financial data (some floats, some integer, and some strings). First, each line have to be tokenized and fast-atof strings data. At the end, a c-structure with all of the data have to be return. For sure, I need to be able to easily recover data from the c-structure using cffi for example.

Find a example of a simplified csv file with only 6 data (Date (have to be convert in integer),Open, High, Low, Close, Volume).

I wrote a single core program in pypy and cffi that works and take about 9s to load 18000 csv files. I hope to considerably decrease time using GPU.

regards,

Yannick

Beceriler: C Programlama, C# Programlama, C++ Programlama, Python, Yazılım Mimarisi

Daha fazlasını gör: generate csv report using php, csv parser vbnet, resume parser using, c++ csv parser, c++ read csv, gpu database github, php, python, django, net csv parser, read csv file using adonet, compare csv files using, converting csv mysql using php, converting csv access using net, csv parser php mysql, read csv file using python script, read csv file using ksh, vbnet csv parser, csv reader using php, xml csv parser

İşveren Hakkında:
( 0 değerlendirme ) Canada

Proje NO: #17353863

Bu iş için 13 freelancer ortalamada $524 teklif veriyor

sherifamgadnabih

i am a lead .NET software engineer Relevant Skills and Experience responsible for creating a web and desktop applications using different languages and technologies Proposed Milestones $500 CAD - FULL

in %bids___i_period_sub_35% gün içinde500%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(90 Değerlendirme)
6.5
in %bids___i_period_sub_35% gün içinde555%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(12 Değerlendirme)
5.7
sun0815

Hello. Do you want a python dev? I am a senior python developer and have 7+ years of experiences. We can discuss more via chat. Kind regards. Relevant Skills and Experience django python Proposed Milestones $50 CAD Daha Fazla

in %bids___i_period_sub_35% gün içinde500%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(16 Değerlendirme)
6.1
in %bids___i_period_sub_35% gün içinde555%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(157 Değerlendirme)
5.3
itoasis1

Hi. I have review your project description. I am very interested in your project and also ready to start work immediately. Hoping for your soon Reply. Thank You Regard. Relevant Skills and Experience C Programming, C Daha Fazla

in %bids___i_period_sub_35% gün içinde250%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(22 Değerlendirme)
4.7
in %bids___i_period_sub_35% gün içinde600%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(3 Değerlendirme)
3.9
in %bids___i_period_sub_35% gün içinde555%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(1 Yorum)
3.6
in %bids___i_period_sub_35% gün içinde555%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(2 Değerlendirme)
2.6
in %bids___i_period_sub_35% gün içinde555%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(1 Yorum)
1.2
in %bids___i_period_sub_35% gün içinde527%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(2 Değerlendirme)
0.9
in %bids___i_period_sub_35% gün içinde555%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(1 Yorum)
0.9
in %bids___i_period_sub_35% gün içinde555%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(0 Değerlendirme)
0.0
zaccaria175

I had worked about some OpenGL programming and I'm familiar with GPU a little bit. If you hire me, I'd like to catch up with pypy and send you program which you want absolutely. Relevant Skills and Experience My OpenG Daha Fazla

in %bids___i_period_sub_35% gün içinde555%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(0 Değerlendirme)
0.0