Nice to meet you on freelancer.
This sounds like a very simple project, the only problem is the file size is big. We can do below steps:
* If this is a one-time query.
step#1, we use a StreamReader object to read the file line by line in C# language, if we use python language, we can call open function in "r" (read mode).
step#2, we need call readlines method, don't read entire file into memory.
step#3, we split the line by "," to get columns, and check column C and column H, if it meet filter condition, save it into another list.
step#4, save the list.
* If you want to search the database many times, we then need to import to sql server or mysql database. You mentioned SQL Server, that's OK, we use SQL Server.
step#1, we create a database and a table in the database, create the table accordingly to the csv columns.
step#2, we the import the data into sql server database with [login to view URL] (if we use C#), I don't know how to import to sql server with python yet, most time I use mysql and python together, we can use [login to view URL] and sqlalchemy.
step#3, write sql queries according to your filters. We can run these sql in sql manage tool (SQL Server Management Studio for SQL Server; MySQL Workbench for mysql), then export data into other place you want (CSV or JSON?)
- we can also write this in code to run the query to get data directly.
We can talk!
Thank you.