This is a simple project if you already have a solution. I get a 3.6gb compressed gzip file every day that decompresses into a ~22gb flat file. Decompressing this file currently takes anywhere between 90-120 seconds. I'd like to get this time down as low as possible, ideally under 10 seconds. As I understand it, the main barrier to this is that gzip decompression can't be multithreaded. I've looked into this myself but have not come up with a solution.
The solution should work on a windows server machine. (the production environment will be an aws ec2 machine, more specifically) I can provide an example file for you to test on. Less than 10 seconds isn't a strict requirement, but of course the faster the solution is, the better.
I'm not looking to pay a ton for this - I'm just looking for someone who has dealt with this before and knows of a solution already, whether it's some software I should use or some custom script I should be writing.
Thank you for your time.
Hi there.
I am a Systems Architecture and Software Development expert since 7+ years and working on IBM AIX Supported Machines with RPM and LPAR archs and Support level.
On the software development side I provide solutions to make operations and tasks more optimized.
I have read your requirements and can do this decompression for you with short span of time
Lets get in touch.
We had worked on same module for state Government university as per reference
Your project will be just a day job for us.
We will provide you 1 month free service post completion of project if you face any issue.
Regard's,
Vinayak Pandey
Reindeer Solutions
BDM
+91 95168 16005