Create a Python program to download a 60 mb csv file and insert it into a Postgres database

I need someone to create a cron job, which downloads the csv file (.gz file actually) found here [url removed, login to view] and inserts it into a postgresql database. After that an email needs to be sent from our linux server, with a report of how many rows were inserted and how many rows failed. 0 rows should fail. Please utilize the appropriate column types (not all varchar).

Please do not include the following columns:

AddressOfficialAddressLineText AddressPostalValidFromDate AddressPostalMunicipalityCode AddressPostalStreetCode AddressPostalStreetBuildingIdentifier AddressPostalStreetName AddressPostalFloorIdentifier AddressPostalSuiteIdentifier AddressPostalDistrictSubdivisionIdentifier AddressPostalPostOfficeBoxIdentifier AddressPostalPostCodeIdentifier AddressPostalDistrictName AddressPostalStreetBuildingIdentifierTo AddressPostalRegionCode AddressPostalAddressLineText

And any columns, which names ends with "ValidFromDate".

Please create a free test database at [url removed, login to view] with a 10000 row limit for this project.

Your solution should "just work". The cron job should run and the db should get deleted and re-created. Please use a temporary secondary table which will replace the "live" table once it has been confirmed that all all rows were successfully inserted, so we do not risk that a failure will leave us with no data.

Evner: PostgreSQL, Python

Se mere: postgres job, how to get a temporary work, how to get a job, how to do a report, how to create database program, heroku download, download heroku, python download file, postgresql any, download file python, free program downloads, python: get data, python program, postgresql c++, postgres, MB , Linux python, heroku, download free project 0, csv file, rows insert, python create file, 10000 downloads, python file create, python download

Om arbejdsgiveren:
( 165 bedømmelser ) Copenhagen, Denmark

Projekt ID: #4623637

Tildelt til:


Hi. I have experience with Python and Postgres. Let start the work

$63 USD på 1 dag
(3 bedømmelser)

10 freelancere byder i gennemsnit $155 på dette job


Hi. Please check my pm.

$157 USD in 2 dage
(4 bedømmelser)

cron, python, csv, un-gzip, mail, postgresql, heroku.. you certainly don't ask for many skills! Luckily, I can do all that. I just need to chat with you and clarify the final bits and we can get started. Please see P Flere

$250 USD in 4 dage
(2 bedømmelser)

Hello sir, I have all the necessary skills to make this script for you.

$166 USD in 5 dage
(4 bedømmelser)

Hej hulagutten2, I'm the author of an script to "magically" determine the type of columns in a CSV file and to automatically generate the corresponding PostgreSQL CREATE statement. So I know a bit about CSV, Postgre Flere

$200 USD in 10 dage
(1 bedømmelse)

hi i can do this job..

$222 USD in 4 dage
(0 bedømmelser)

Hi, I can work on this. I have projects in the past that are similar on this. Thanks

$55 USD in 3 dage
(1 bedømmelse)

yes I can do this

$113 USD in 3 dage
(0 bedømmelser)

It's straightforward: PostgreSQL supports importing data from CSV files, and Python can certainly be used to remove the unneeded columns beforehand. Downloading a file, emailing a report, setting a cronjob and renaming Flere

$150 USD in 7 dage
(0 bedømmelser)

I have experience with both python and postgresql. I can do it for you with no problems. Check your PMB.

$170 USD in 3 dage
(0 bedømmelser)