Data extraction from Salesforce with Python

We need a python script that extracts all tables and metadata from our Salesforce CRM organisation, and writes this data to zipped CSV files on Amazon S3.


1. Download all data from all Salesforce objects into a CSV file. The selection of files should be filtered using a Regex (positive / negative - to download only a subset of objects)

2. Download all binary data (salesforce attachements)

3. Download all metadata from Salesforce into a CSV file, with the following columns (“meta data column”, “data type”, “possible values”, “description”)

4. Upload the CSV files for data and meta data and the attachments to a directory on S3 bucket

Additional Requirements:

- AWS SDK for Python is mandatory.

- All files on S3 should be zipped using GZip.

- Consistency of downloads is important / preferred over parallelization

- CSV files should include quotation / escaping of data

- Configuration should be done using configfilter (Salesforce OAuth, Bucket name, S3 folder, Regex for object filter) in separate ini file.

- Regex for filtering objects will be used to download only files from a specific namespace OR everything except files from a specified namespace (we need to separate HR relevant data which is stored in 2 different SFDC apps - Releco and TargetRecruit)

In addition to the previous requirements we need the following features:
- Error handling: log errors into a [leads].error.gz and standard (non-error) messages to [leads].log.gz
- Meta-data: we are not only interested in the data from the Salesforce objects (such as leads) but also on all data from other Salesforce REST interfaces (such as metadata of salesforce objects and attributes, users, and the like)

We do not provide an environment with data. We expect that the developer has access to a Salesforce environment (free developer edition is available) and S3 for testing purposes.

The configuration of the output CSV (delimiter, quote character) should be done via the ini file.

The Salesforce source changes frequently. The goal of this project is to develop a script that downloads all available fields and other data from the source present at execution time. a fixed set of attributes (to be configured in the ini file) is NOT SUFFICIENT to complete the project.
1) scan the rest api (or maybe the python SDK for SFDC) for all available attributes
2) write everything off to the CSV file

Færdigheder: Dataindførsel, Databehandling, Python, Regular Expressions,

Se mere: https www freelancer com projects data entry fill spreadsheet with data 10799431, https://wwwfreelancercom/projects/data-entry/fill-spreadsheet-data-entry/, data-entry/fill-spreadsheet-with-data-entry, FILL DATA SPREADSHEET, python script read data text file, python script extract data, python modify file data, web extraction data project, python read input data file, python html extract data, python script crape data, extraction data php, extraction data email visual basic, php form data spreadsheet, salesforce load data aspnet, python script extract data web page, extraction data web, macro cut data spreadsheet copy different spreadsheet, vba macro cut data spreadsheet spreadsheet, excel macro script insert data spreadsheet, contact data spreadsheet, collecting price data spreadsheet, website extraction data feed, macro data spreadsheet, python csv extraction

Om arbejdsgiveren:
( 5 bedømmelser ) Hannover, Germany

Projekt-ID: #13433112

Tildelt til:


Greetings sir, i am an expert freelancer for this job and your 100% satisfaction is assured if you allow me to serve. Here is the reason. Why you should pick me? a) I am a very expert and have the same kind of ex Mere

€25 EUR på 1 dag
(146 bedømmelser)

19 freelancers are bidding on average €153 for this job


Hi I am Furqan I've reviewed your complete job description, and I fulfill all the qualifications required for this project.I can extract data using python script I have 8+years experience working in python langu Mere

€34 EUR in 3 dage
(40 bedømmelser)

A proposal has not yet been provided

€222 EUR in 10 dage
(20 bedømmelser)
€250 EUR in 5 dage
(30 bedømmelser)

Hi, I am well equip to this kind of task, can handle it pretty well. In fact, I already done related to this job before. Let me know the best of your time so we can discuss further based on your requirements and we ca Mere

€249 EUR in 3 dage
(24 bedømmelser)
€222 EUR in 10 dage
(9 bedømmelser)

Hello Sir, I am shahid from kashmir. I read through the job details extremely carefully and I am absolutely sure that I can do the project very well.I'm interested in your project. Please send me a message so that we Mere

€30 EUR in 0 dage
(9 bedømmelser)

Hello! We are a professional team of web developers with huge experience in using python for custom webapps based on django and odoo. Please provide more details about your project. We are available and will be hap Mere

€220 EUR in 5 dage
(2 bedømmelser)

Hello Client, Hope you are doing well ! I would like to take a chance to show my abilities and prove that I am a right candidate for this project. With 8+ years of experience and recommendations as an expert and exp Mere

€30 EUR in 3 dage
(7 bedømmelser)

Hello there my beloved employer, I have gone through your project description and clearly understood what you need me to do. Let me show you my reliability, dedication, honesty, accuracy, attention to details, etc., Mere

€50 EUR in 3 dage
(4 bedømmelser)

I am a seasoned Salesforce Consultant/Developer with 4+ years of experience. I’ve worked on every aspect of [url removed, login to view] ranging from Sales cloud, Apex, API's , Service cloud, Marketing Cloud (Campaigns) , Collaborat Mere

€222 EUR in 3 dage
(3 bedømmelser)

Hello sir!! Myself Sumit Singh, I read the job details extremely carefully and I am absolutely sure that I can do the project very well.I have experience more than 8+ yrs. My skills are : - PHP, MySql,Python MVC Frame Mere

€177 EUR in 5 dage
(0 bedømmelser)
€155 EUR in 3 dage
(0 bedømmelser)

Hello , We are a team of expert developers who are dedicately working on AWS,MWS,EBAY like projects from last 2 years and have expertise working with- 1)Amazon Orders of seller 2)Amazon Product API 3)Amazon Mere

€206 EUR in 3 dage
(0 bedømmelser)

Hope this finds you well. I have a great background in Information science. I have tremendous experience in Matlab gained not only in my learning but in subsequent years helping students and organizations in developi Mere

€178 EUR in 5 dage
(2 bedømmelser)

IM a very patient person, trustworthy, responsible, reliable and you can count on me . im a data encoder for almost1 year in a company. i can make it in 2 days and i promise you that.

€111 EUR in 2 dage
(0 bedømmelser)

Hello Hiring manager, I am a certified developer. I have 3 years of experience in Salesforce Development. The Projects I have worked on deals with standard Salesforce functionality and a lot of standard and customi Mere

€277 EUR in 3 dage
(0 bedømmelser)

Solid background in python and regex, we data extraction experience with sales for and SAP based products

€222 EUR in 4 dage
(0 bedømmelser)

hi I am good at python and saleforce as well I can help you on this script

€34 EUR in 3 dage
(0 bedømmelser)