I gang

Database Script for Data Warehouse

***Context & Introduction***

I am part of a small team whose mission is to help improve lives by reducing the delivered cost of energy. Ready access to high quality data is an important first step to achieving these aims; this project is aimed squarely at addressing that challenge.

***Project Overview***

We are looking to develop a database (data warehouse) to contain a large amount of historical data, which will have data added to it incrementally, approximately every 30 minutes via automated processes. The scope of work consists of:

(1) database setup (table creation / structuring etc...),

(2) creation of an automated process to back-fill historical data, and ,

(3) creation of an automated process to add real-time data via push service.

Both of the scripts (2, 3) would interact with an API. The API description and instructions can be found at: [url removed, login to view]

***Additional Details***

The database should contain all of the data items listed in section 8.5.1 of the document at the link above. Both the script used to backfill data and the script used to acquire realtime data via push service should include all of the message types listed in this section.

Examples of script implementation are provided in Java in Appendix A of the document link above.

In order to avoid duplicate record creation the scripts should be sophisticated enough not to add data which has already been retrieved (data validation / duplicate avoidance).


(1) A means by which to receive or reconstitute the database shell (tables / structure / etc.); this can be via an SQL script.

(2) A script capable of back-filling the database with all of the messages contained in section 8.5.1 of the document linked above, executable on-demand.

(3) A script/daemon capable of adding new data via PUSH service (outlined in section 6 of the document linked above) to keep each of the data streams listed in section 8.5.1 updated on a half-hourly basis.

(4) Any pertinent instructions for the setup of the database or scripts


We would like to receive the deliverables no later than February 28th, 2018.

***What we're looking for in RFP responses***

We will be carefully reviewing all responses submitted to this request for proposals. In addition to standard demographic, credential and commercial information, it would be advantageous for you to include some content that would illustrate your initial thoughts on an approach to tackling the project. We spend a lot of time exploring and expanding the conceptual "art of the possible" in the course of our day-to-day work and so it's important to us in selecting a Freelancer that we pick someone who can clearly articulate a design concept.

Evner: Programmering af database, MySQL, Software Arkitektur, SQL

Se mere: import data csv mysql database script php sample, php small database script, script access database update data, small mysql database script, script data imdb database, simple php data database script, data warehouse project bid, simple database script, create database script, php create install database script, create database normalize data, access database web data capture, role database developers data mining, database script php user friendly, simple web database script, data warehouse optimization, rental database script

Om arbejdsgiveren:
( 0 bedømmelser ) Calgary, Canada

Projekt ID: #16307035

Tildelt til:


I could implement PosgreSQL Foreign Data Wrapper (FDW). [url removed, login to view] . [url removed, login to view] . Advantages wi Flere

$1388 CAD in 15 dage
(8 bedømmelser)

21 freelancers are bidding on average $1167 for this job

$1250 CAD in 20 dage
(21 bedømmelser)

Hi, I'm interested. Ok, so how much data are we talking about? This the #1 question, because from that answer flows the design. There a re a couple of options to consider, but we need to review pricing and features, Flere

$1498 CAD in 15 dage
(56 bedømmelser)

With my 9+ years of Software Development experience like to work on your project,Please see my reviews to consider me as your development member. ASP.Net, C#, VB.Net, MVC, WPF, Visual Basic, Excel VBA, MS SQL Server Flere

$1250 CAD in 20 dage
(42 bedømmelser)

Good day. I can help you to develop a database containing a large amount of historical data according to your requirements. As for me, I am a professional Web-Developer with 15+ years experience. My main specializat Flere

$1052 CAD in 20 dage
(8 bedømmelser)

Hi, What's the amount of information that you plan on storing in the database? If you're expecting big amount of data it might be worth setting up a solution for writing fast the information in the database from the Flere

$1250 CAD in 12 dage
(13 bedømmelser)

We have designed C# applications for big data analysis. Which include visual data as well. Sir i believe we can provide you an efficient time saving and generic system for the purpose you require for data comparison. A Flere

$1250 CAD in 20 dage
(10 bedømmelser)

Hi sir. We have read ur requirement and this can be done with MySQL and php in wonderful way. You will get work before deadline, 28 Feb. Relevant Skills and Experience Php, MySQL. Data management software

$1333 CAD in 10 dage
(32 bedømmelser)

I can do your task . Please contact to discuss the project scope and to get started . Waiting for your message .

$750 CAD in 20 dage
(4 bedømmelser)

I am confident that i can do this project. Would you please message me so i can ask some directed questions to gather all the details for this project before project's initiation? Looking forward to show you my skill Flere

$1250 CAD in 20 dage
(1 bedømmelse)

Hi let me help you for Database Script for Data Warehouse i have skill ,Database Programming,MySQL,Software Architecture,SQL which is very suitable to your project So send me Private message at PMB so we can dis Flere

$1250 CAD in 20 dage
(17 bedømmelser)

Dear, I have extensive experience in databases and developing applications, I have done similar work using APIs I can do the work you need, I can start the work immediately, I am attentive to your comments, kind regard Flere

$900 CAD in 13 dage
(13 bedømmelser)

Hello, i have read your job description and fully understand your requirements. It looks like I’ll be the perfect candidate for this job because I have hands on experience in this field. Could you provide us more Flere

$1250 CAD in 20 dage
(5 bedømmelser)

A proposal has not yet been provided

$1111 CAD in 20 dage
(7 bedømmelser)
$750 CAD in 10 dage
(0 bedømmelser)

Hi I have gone through the above mentioned details. I have got plenty of experience in these kind of projects and i am also available from now for this task. Looking for a positive response. Thanks.

$1250 CAD in 20 dage
(0 bedømmelser)

I would like to learn your business rules and implement the same in DW . please let me know if you have any questions regarding my work . I am expertise in ETL

$1250 CAD in 14 dage
(0 bedømmelser)

A proposal has not yet been provided

$1111 CAD in 10 dage
(0 bedømmelser)

Hi, i'm a data integration expert with more than 10 years of experience. I think that I can help you with this process. We are a Consultant Services Company, you can see our web page [url removed, login to view] Can we talk about t Flere

$1222 CAD in 15 dage
(0 bedømmelser)

SABA IT Solutions specialized technology startup in Data Engineering providing Solutions and Services focused on enriching data value. We provide customized services for giving you competitive advantage and help you im Flere

$900 CAD in 8 dage
(0 bedømmelser)

A proposal has not yet been provided

$1250 CAD in 20 dage
(0 bedømmelser)