Find Jobs
Hire Freelancers

Code that will parse and merge large csv files

$30-250 USD

Lukket
Slået op over 3 år siden

$30-250 USD

Betales ved levering
I'm working with large csv files up to 50GB in size. Typically one file is around 30GB while the one that will be merged onto it is just about 100 MB. The code I'm currently using will take about 1 hour to parse and merge two files. If we can reduce the time this takes by writing new code that will be great.
Projekt-ID: 27364042

Om projektet

22 forslag
Projekt på afstand
Aktiv 3 år siden

Leder du efter muligheder for at tjene penge?

Fordele ved budafgivning på Freelancer

Fastsæt dit budget og din tidsramme
Bliv betalt for dit arbejde
Oprids dit forslag
Det er gratis at skrive sig op og byde på jobs
22 freelancere byder i gennemsnit $178 USD på dette job
Brug Avatar.
Hi there,I'm biddin on your project "Code that will parse and merge large csv files" I have read your project description and i'm confident i can do this project for you perfectly.I still have a few questions. please leave a message on my chat so we can discuss the budget and deadline of the project. Thanks. .. .
$250 USD på 4 dage
5,0 (63 anmeldelser)
7,6
7,6
Brug Avatar.
Hi there, I'm bidding on your project "Code that will parse and merge large csv files" Being an expert in C, and C++ programming I can do this project for you. please leave a message on my chat so we can discuss the budget and deadline of the project. Also, have a look at my profile for my reviews and portfolios. Thanks Note: This is not an automated bid and i'm ready to discuss your project right now. .. .
$250 USD på 4 dage
4,9 (19 anmeldelser)
6,7
6,7
Brug Avatar.
I am very proficient in c/c++. I have 17 years c/c++ developing experience now, and have worked for more than 10 years. My work is online game developing, and mainly focus on server side, using c++ under Linux environment. I made many great projects using c++, for example, I made the tools which could convert java files into c++ scripts, of course garbage collection included, this job was very similar to a compiler, and was very complex. I also made our own mobile game using c++, I can show you the demo of client, if you like. I have a very good review on Freelancer.com, I never miss a project once I accept the job, you can check my review. Trust me, please let expert help you. Besides, I am very proficient in java also, hope I can help you.
$100 USD på 1 dag
4,9 (143 anmeldelser)
7,0
7,0
Brug Avatar.
I'm a Python expert with rich experience in CSV. I read the job description and understood the requirements. I think I can finish this project within short period with a minimal budget. I can start work immediately. Should you require further assistance, feel free to contact me. Thank you.
$140 USD på 2 dage
4,9 (26 anmeldelser)
6,0
6,0
Brug Avatar.
⭐⭐Hello, there!⭐⭐ ✅I have gone through your project details carefully and I think that I am the best fit developer for your project. ✅I have rich experience in similar projects, so I have a clear way to complete the project. ✅Your project is very fit for my skill sets. ✅If you are willing to award the project to me, I will always be ready to complete it perfectly.
$34 USD på 1 dag
4,8 (45 anmeldelser)
6,2
6,2
Brug Avatar.
Hello I am a Python and c++ expert. I have worked on a project of sorting very large files, so I am capable of doing yours. Let me know please about the criteria of merging. Feel free to send a message.
$80 USD på 2 dage
5,0 (45 anmeldelser)
5,3
5,3
Brug Avatar.
Hello I have read your job description carefully. Also, I have rich experience in python So I am interested in and I am confident in your project. I always provide perfect results to my clients as you can see my profile and reviews. If you give me a chance, I will provide you the perfect result. I hope you send me a quick message. Regards Daniel Ramos Garcia
$140 USD på 3 dage
5,0 (12 anmeldelser)
5,3
5,3
Brug Avatar.
Hello, Ken! I have read your description very carefully, so I'm very confident in your project. I have rich experiences in CSV parsing with python and done many projects such as your projects . In your project, I'm going to implement faster algorithm to merge two result from parse. I'm looking forward to working on your project Hope your kind contact. Thanks
$100 USD på 2 dage
5,0 (10 anmeldelser)
4,6
4,6
Brug Avatar.
hi, probably i can help you 100chars100chars100chars100chars100chars100chars100chars100chars100chars
$250 USD på 7 dage
5,0 (11 anmeldelser)
4,8
4,8
Brug Avatar.
Hi I am fully experienced working with python and c++. Contact me to discuss further details. Thanks for your time :)
$300 USD på 3 dage
4,6 (19 anmeldelser)
4,7
4,7
Brug Avatar.
Hi I can do this job. There are several libraries in python for handling large data. I can start working right now.
$140 USD på 7 dage
5,0 (6 anmeldelser)
4,3
4,3
Brug Avatar.
I believe i can reduce the time by alot get in touch Hey there, i am developer from the UK with over 9 years experience in web development. Upon reading your project description this seems like a task which i can start on right now and will not take long to complete. I have a few questions for yourself before i get started then i can begin. I will describe and explain the whole process and keep you updated along the whole way. I have experience in various languages PHP, HTML, C#, C++, Python, Javascript and jQuery. I also have heavy experience in scraping projects scraping sites such as linkedIn, google and facebook. Furthermore, experience in mobile app development and cross system applications developing on both MacOS and Windows. I can fulfil all your requirements to the fullest standard in a low and affordable price. Contact me right away so we can discuss and I can get started. Thank you
$250 USD på 1 dag
5,0 (3 anmeldelser)
3,9
3,9
Brug Avatar.
Hello. Thanks for your attention. I am Machine Learning, Deep Learning, Computer Vision expert and working in these fields from the past 5 years. The major field in which I have worked on including Deep Learning, Machine Learning, Digital Image Processing, Computer Vision and Neural Networks. The main tools that I have used for implementation is MATLAB, Python, OpenCV and TensorFlow. I will put 100% effort on your project. I accept and can deliver a professional, finalized, and creative output in a timely manner, every time. I love to help people grow their businesses. Kindly reply me, so that we can discuss more. Thanks
$150 USD på 1 dag
4,3 (7 anmeldelser)
4,7
4,7
Brug Avatar.
Hello, I am kernel developer and I might have an idea what might be happening in your code. Your code is trying to read the file and work on it at runtime. Now, its a big file and if you are using C++ then you must be using stream to read file which makes frequent read on large files and as we all know disk operations are really slow. We can achieve the same by finding a way to use memory. I know precisely how to do it. I know C as well as C++ and as I am kernel level developer I know system calls as well. It would be great if I can help you with this work. Looking forward to have a conversation with you.
$250 USD på 7 dage
5,0 (15 anmeldelser)
4,1
4,1
Brug Avatar.
Hi, I can optimize code, Please share your current code so i can check and get back to you? what about language, can I use according to my choice? Thanks
$220 USD på 7 dage
5,0 (2 anmeldelser)
3,1
3,1
Brug Avatar.
Hello, I can reduce the time using Multi Processing in Python. Let's discuss more in chat. Thank you Milan
$200 USD på 3 dage
5,0 (2 anmeldelser)
2,5
2,5
Brug Avatar.
Hi, In my previous job I did a lot of data analyzing with selfmade scripts in Python and C++. I think I can help you to create a better script for it. Can you tell me more about what kind of data needs to processed? And on what kind of machine do you want to process this data? Depending on the job we can decide to do it in Python or in C++.
$200 USD på 14 dage
5,0 (1 bedømmelse)
2,4
2,4
Brug Avatar.
Hey there, I imagine that it can be solved using recursion, maybe with divide and conquer, or somthing similar.
$200 USD på 7 dage
0,0 (0 anmeldelser)
0,0
0,0
Brug Avatar.
Hi , I should be able to do that . i have worked with files in python and should be able to do it using python 3. Please let me know Thank you
$140 USD på 7 dage
0,0 (0 anmeldelser)
0,0
0,0
Brug Avatar.
Hi. I have developed something a bit like what you request: It is the project that I already completed in Freelancer and you can see it at https://www.freelancer.com/projects/data-processing/PROGRAM-PARA-COMPARAR-DATOS-Files/reviews That Python software reads the data (text strings like "R0056879T003") from various files and compares them. I would like you to give me more information about your project. Perhaps with some example files and a good explanation on how they should be merged I can develop a demo with various functionalities to try to convince you to hire me. What do you think of my idea for a demo? I could modify the proposal after receiving more information about your project. Thanks for your attention.
$100 USD på 10 dage
0,0 (0 anmeldelser)
0,0
0,0

Om klienten

Flag for UNITED STATES
Santa Clara, United States
0,0
0
Medlem siden sep. 14, 2020

Klientverificering

Tak! Vi har sendt dig en e-mail med et link, så du kan modtage din kredit.
Noget gik galt, da vi forsøgte at sende din mail. Prøv venligst igen.
Registrerede brugere Oprettede jobs i alt
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Indlæser forhåndsvisning
Geolokalisering er tilladt.
Din session er udløbet, og du er blevet logget ud. Log venligst ind igen.