We need a python script to upload csv files into a mysql database, move the processed csv files into a processed folder, and using mysql scripts to clean up the data.
We receive multiple email files daily with 3 csv file attachments per email.
1. *counters*.csv, Devices counters file
2. *cartridges*.csv, Cartridge counters file
3. *alarms*.csv, Alarms reports file.
These attachments are saved to our linux server folder during the day.
We need to:
Some of the csv file names have spaces. They must be removed and replaced with a underscore “_”
On all csv files the name of the csv filename must be added to LAST Column of the csv file with the header of FILE_ID
Upload the csv files into a 3 mysql tables with the same column names as the csv header row.
Processed csv files must be moved into a processed folder with the suffix “[url removed, login to view]”
We need to create a list of printers with their serial number as the primary key (Table “PRINTER_DETAILS”). Table structure as below. The field ID, from table counters, must have the date, defaults and the counters parts removed. This is the field SITE_ID. The last column “TYPE” has to values “N” (default) and “L”. There can only be one entry for a printer.
Based on the table “PRINTER_DETAILS” the counters and the date scanned must be populated into table PRINTER_COUNTERS. There is no primary key as there could duplicate entries.
The purpose of this is too step by step make sure that each printer has a
2. Their counters recorded. The csv files have a lot of duplicated entries. We need one sett of counter per device.
This python script will be run as a cron job at midnight. NB this is a linux (centos) environment.
I have included a selection of files. I have included the database script to create Databases.
This is part of a larger system that will be part of our billing and reporting system. We need clean data first.
All files can be downloaded from this link.
[url removed, login to view]
18 freelancers are bidding on average $150 for this job
I gone thru ur zip file and interested to work with it as i have experience in backend scripts, i can complete the work in couple of days but to be on safe i told 5 days.