
Completed
Posted
I need assistance splitting a large CSV file into smaller files. Each smaller file should contain 100,000 rows and repeat the headers from the original file. Ideal skills for this project include: - Proficiency in working with CSV files. - Experience with data handling and file management. - Familiarity with programming or software that can automate this process would be a plus. - Experience with data manipulation frameworks like Pandas or similar. I have a number of files that I need help with. One is is 50GB. Another is 10GB. There will be a few of these so I need you to help on several steps. BTW, I tried my own CSV splitter tool and it did not work (I assume the file size was too large).
Project ID: 38866709
131 proposals
Remote project
Active 1 yr ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
131 freelancers are bidding on average $20 USD/hour for this job

Top 1% in Freelancer.com Hi, Greetings! ✅checked your project details: ✅Completed Time: In project deadline We have worked on 900 + Projects. I have 6 + years of the experience in same kind of projects. If you are looking for a true Freelancer, I am the Right person for you. I am available almost 24-7 and am very responsive. I feel proud that I am a trusted Freelancer who pleases almost every single client. You can rest assure, your work will be delivered well in advance of others, with passion and accuracy. I guarantee you instant communication & responses when you need me. Why choose me? I think every client is the reason for my success. I only take projects which I am sure I can do quickly. My Portfolio Items: https://www.freelancer.com/u/schoudhary1553 I would really like to work with you on this project. If interested, Kindly contact me via chat for further details and discussion. Thank you Sandeep
$20 USD in 40 days
8.6
8.6

Hello there, I will spilt your csv file into multiple csv files. I am experienced in web scraping and building scripts or a Windows desktop application using Python. I am also experienced in large data scraping from a given website, bypassing IP, Captcha, and anti-bot or cloud flair protection. Please message me to discuss this project in detail. Best Regards
$25 USD in 2 days
8.2
8.2

HI I hope you are fine and doing great! I have seen in screenshots that files are quire big and you wanted to split them into smaller csvs I can ready csvs using pandas module in python and will split them into new csv each having around 100,000 rows of data. we dont have to open file and then split, pandas module will read them programmatically and split into smaller onces
$25 USD in 40 days
7.9
7.9

Hello, I can help you split large CSV files into smaller ones. I'm ready to start with the 10GB file.. Please drop a PM if you’re interested. Best regards, Hoang
$120 USD in 1 day
7.6
7.6

"Sir/Madam, Excel and CSV is my specialty and i love performing complex task in excel. There is nothing in Excel that i can't do. From simple formulas to complex condition based formulas and automation through VBA and MACRO, i am expert in all. My Expertise in Excel Include but not limited to: 1) SIMPLE and COMPLEX EXCEL FORMULAS (ALL TYPES OF FORMULAS) 2) VBA MACRO AUTOMATION 3) PIVOT TABLES 4) DASHBOARDS FULLY AUTOMATED AND VISUALLY APPEALING. 5) AUTOMATED INVOICE AND QUOTE GENERATOR IN EXCEL WITH DATABASE. 6) CREATING ANY TYPE OF AUTOMATED TEMPLATE IN EXCEL. This is my field and I can I can handle this task very efficiently and you can expect 100% accuracy from me. About me I am a Chartered Accountant with more than 8 years of experience including 4 years from the worlds leading Accountancy and auditing firm ""PWC"" and 1 year working at managerial level in Multination company and 3 years as freelancer. I am EXCEL, VBA, MACROS, GOOGLE SHEETS, ACCOUNTING, FINANCE, BUDGETS ADVANCE LEVEL EXPERT. I have been working as a freelancer from the last 3 years and I have 390+ 5 stars reviews here. I am not new to work. I know how to meet strict deadlines without compromising the quality of the work. Note. The price is negotiable and we can agree on a mutual price. I will be available for any query round the clock WITHOUT any further cost even if the project is completed as i am making permanent clients. Regards Arman Kakar"
$20 USD in 40 days
7.6
7.6

As an experienced Finance and Data Analytics Professional, I possess the exact combination of skills you are looking for in this task. My years of working with data have made me well-versed in handling CSV files and sorting/formatting large quantities of information. I have a deep understanding of Excel—I am proficient in creating dynamic and interactive dashboards, managing extensive datasets, and implementing automation tools. Regarding your concern about file size limitations, I can assure you my tools and techniques are highly capable even when dealing with large files up to 50 GB. My capability goes beyond just splitting files—I can transform raw data to desired outputs performing cleaning processes, analyzing patterns, making accurate forecasts, and providing insights when needed. In fact, you will find my expertise with Power BI & Tableau particularly valuable in visualizing the structures and distribution of your data once it's been split. Lastly, I understand the value of ongoing support even after projects conclude. One unique aspect of my service is that I offer free demo/trial runs upfront so that you are fully satisfied before we begin. This task requires precision and efficiency with no human error over colossal amounts of data—qualities that characterize my work consistently. Let's collaborate on achieving your desired outcome together!
$15 USD in 4 days
7.6
7.6

With 15+ years of experience in data management and automation, I offer a finely honed skill set ideal for your project needs. My expertise handling large datasets, particularly in CSV format, is guaranteed to ensure that the files are optimally split without losing a single row. I am proficient with data manipulation frameworks such as Pandas and have substantive automation experience using VBA Scripting in Excel and Google Apps Script. My knowledge of file management extends beyond just splitting and concatenation - I can support you throughout the entire process in order to maximize efficiency. I want to make clear that I have handled files as large as yours, thanks in part to my comprehensive strategies for optimizing workflows. This includes checking and fixing issues your previous tool may have encountered due to size.
$15 USD in 40 days
6.7
6.7

Hello I have over 20 years of experience with software development and scripting. I can prepare script that would read CSV line by line, therefore no limit on size. I am able to start now.. also, I did similar thing recently..
$22.22 USD in 3 days
6.5
6.5

Hello Jeff, I understand that you require assistance with splitting large CSV files into smaller parts, each containing 100,000 rows with repeated headers. With my expertise in working with CSV files and experience in data handling and file management, I can efficiently tackle this task. Additionally, I can employ programming or automation tools to streamline the process, leveraging frameworks like Pandas for data manipulation. Given the large file sizes of 50GB and 10GB, I am well-equipped to handle the complexities that may arise during this project. I am keen to assist you with each step and ensure the successful splitting of your files while maintaining data integrity and accuracy. Looking forward to collaborating on this project. What specific headers or columns do you want to include in the smaller files? Would you like any specific naming conventions for the split files? Thanks, Shamshad
$35 USD in 15 days
6.5
6.5

Hello, I am highly experienced in data handling and can efficiently manage the task of splitting your large CSV files into smaller, organized files using Python and its powerful libraries. My approach will ensure accuracy, consistency, and scalability for large datasets like yours. To begin, I will use Python's pandas library to process and manipulate the data while maintaining the headers in each split file. For handling extremely large files, I will integrate the csv module and use an iterative reading approach to avoid memory issues. For files as large as 50GB, I will optimize performance by leveraging chunks and ensure headers are correctly replicated in each output file. The process will be methodical: first, I will read and validate the input file, then divide it into chunks of 100,000 rows, and finally write each chunk to a new file. These files will be named sequentially for easy tracking. My solution will be reliable and tailored to handle multiple large files seamlessly. Best Regards, Aneesa
$15 USD in 40 days
6.3
6.3

Hello there I can help you to complete the project asap It’s easy job for me I’m waiting for your response to discuss further Thank you.
$20 USD in 40 days
5.8
5.8

Hi, thanks for your job posting. I have reviewed your job description and I can deliver the result you want. I can develop a script for your project. Looking forward to your reply. Thanks, Martin
$25 USD in 40 days
5.9
5.9

Dear Jeff C., We carefully studied the description of your project and we can confirm that we understand your needs and are also interested in your project. Our team has the necessary resources to start your project as soon as possible and complete it in a very short time. We are 25 years in this business and our technical specialists have strong experience in Excel, Data Mining, Database Administration, Big Data Sales, Data Scraping and other technologies relevant to your project. Please, review our profile https://www.freelancer.com/u/tangramua where you can find detailed information about our company, our portfolio, and the client's recent reviews. Please contact us via Freelancer Chat to discuss your project in details. Best regards, Sales department Tangram Canada Inc.
$25 USD in 5 days
5.6
5.6

Hi, This is the best deal that you are looking for. I have a good experience in ''Virtual Assistant'' and any type of Exel jobs that you searching here ! I am a full time Freelancer here with 24/7 service and can work anytime with your requirements ! When I accept any project, It means i understand the job perfectly and can give you the best result with minimum time frame. Please give me sometime if i am not responding as i try to respond your message within an hour !!
$15 USD in 6 days
5.8
5.8

With over 18 years of experience in the industry, our team has honed its expertise in web and app development, delivering innovative solutions that drive success for our clients. Our extensive work spans a wide range of technologies, including PHP, React, Nuxt, and mobile app development, ensuring we stay at the forefront of the ever-evolving tech landscape. We pride ourselves on our ability to understand our clients' unique requirements and translate them into effective digital solutions. Our commitment to excellence and continuous learning ensures that we not only meet but exceed expectations, providing our clients with the tools they need to succeed in a competitive market. Partner with us to leverage our extensive experience and technical expertise, and let's create something exceptional together. Raman
$20 USD in 40 days
5.5
5.5

My name is Adnan and I believe I'm the perfect fit for your CSV splitting project. My extensive background in data management includes expertise in working with and handling large CSV files, ensuring that I can efficiently tackle your 50GB and 10GB files. I have also developed a comprehensive understanding of various programming languages like Python, which enables me to automate processes, such as dividing files to meet your specifications. In addition, I am well-versed in utilizing advanced data manipulation frameworks like Pandas for tasks similar to yours. My wide-ranging knowledge in Big Data sales, data mining, data scraping, database administration, and Excel equips me with the necessary tools to conduct insightful analysis and ensure smooth workflows. Importantly, my experience transcending the boundaries of different sectors validates my adaptability and highlights my capacity to collaborate effectively. I've led diverse teams on complex projects in a range of environments successfully meeting deadlines within budget. My keen attention to detail and stringent adherence to quality standards are traits that underpin my overall commitment to excellence.
$20 USD in 40 days
5.7
5.7

Hi, I have done similar things before with multiple files. Do reach me up sharing the CSV file I'll provide you children CSV files with each file having 100 rows.
$15 USD in 40 days
5.4
5.4

I have my own csv splitter tools, I believe it will work to split your csv file. Message me so we can find out. Best regards, Usama
$19 USD in 40 days
5.2
5.2

Hello, I'm expert in python web scraping for 3.5+ years using python coding. Can finish in 1 days only Thanks.
$15 USD in 40 days
5.0
5.0

i can do it
$20 USD in 40 days
5.1
5.1

Gallatin, United States
Payment method verified
Member since Feb 17, 2009
$250-750 USD
$10-20 USD / hour
$10-30 USD
$30-250 USD
$10-19 USD / hour
€8-30 EUR
₹600-1500 INR
$250-750 USD
$115-200 HKD / hour
₹12500-37500 INR
₹1500-12500 INR
$250-750 USD
₹12500-37500 INR
₹750-1250 INR / hour
₹750-1250 INR / hour
₹100-400 INR / hour
$30-250 USD
₹600-1500 INR
$10-30 USD
£20-30 GBP
$10-30 USD
₹600-1500 INR
₹750-1250 INR / hour
$30-250 USD
₹750-1250 INR / hour