I gang

Migrate a database to support data warehousing, OLAP and big data

This project aims to transform an existing database to support analytical processing (OLAP) for a data-warehouse that holds a huge amount of data and streams more data on daily basis. The analytical tasks are mostly statistical such as mean, variance, normalization, standardization, max, min, median. The challenge here is that the nested queries and the big data make the response time too slow and consumes lots of computational power that takes the server down.

The requirement here is :

1. Propose a solution to make these reports more efficient in a way that allows the site to load in less than a second

2. evaluating the performance of current queries

3. Install and configure the necessary needed software to the server (if any)

4. Migrate the database from the current DBMS (MySQL) to the new DBMS

5. Migrate the views and nested queries in the current database to be efficiently implemented in the new database

6. Review each SQL statements to and propose how it can be optimized to run in the most efficient way

7. Create and optimize materialized views + triggers as needed

8. optimize the performance of the migrated database

The deliverable:

A new database to be used by the website with response time less than 3 seconds. I will just change the connection string in my site to connect to the new database and it should load the same data from the same views as fast as it can. The new database should be able to handle huge amounts of data (more than 30 million records)

Obviously, MySQL does not support nested select statements, so many queries are just created to be used by the end queries for business. The business queries used by the site are listed at the end of the attached document. These queries must be created by the same names in the new database. The other internal queries used implicitly by the main queries can be traced through the code or listed from MySQL

Before awarding the project, I will have a chat with each applicant to discuss the proposed solutions, the data warehousing experience and query optimization method.

Evner: Cassandra, Data Warehousing, MongoDB, MySQL, PostgreSQL

Se mere: big data data warehouse architecture, data lake vs data warehouse, difference between hadoop and data warehouse, difference and similarities between data warehouse and database, data migration in hadoop, migrating data warehouse to hadoop, big data migration approach, difference between database and data warehouse pdf, migrate database oscommerce, flex3 database support, oracle database support time, technical specification document database support ecommerce web site, migrate database jevents, phpfox migrate database, Database support, quickbooks database data posted website, magento migrate database, database support services kolkata, clone joomla big data base, mangos project database support

Om arbejdsgiveren:
( 16 bedømmelser ) Geelong, Australia

Projekt ID: #18770030

22 freelancere byder i gennemsnit $378 på dette job

digidreamstech

Hello, I have checked the project requirements. We can discuss further in more details on this task. Thanks.

$250 AUD in 5 dage
(23 bedømmelser)
5.6
dhanuitdevendra

Hello, Hope you are doing well! We can help you with our Data Architect as a Service (ARCaaS). Please visit [login to view URL] for details. Please have a look at our existing customer base Flere

$70 AUD in 30 dage
(3 bedømmelser)
4.2
hotranan

Hello, I can work on this project. I have much experience working with Data Warehousing. I worked on Target's Store-BI DTK Toolkit with Data Stage as ETL processes, Hyperrol as Multi-Dimmension Data Cubes (OLAP Flere

$155 AUD in 3 dage
(2 bedømmelser)
3.7
RushService

Feel fee to contact me for Migrate a database to support data warehousing, OLAP and big [login to view URL] me message to discuss further more details .We provide the comments,images,videos,demos and live sessions in order Flere

$250 AUD in 3 dage
(3 bedømmelser)
2.8
alexannick

I have more than 18 years of experience working on highly regulated environments and supporting large scale database installations. I am here to help you. Please contact me to learn more details about the project. Flere

$1666 AUD in 15 dage
(1 bedømmelse)
2.9
nirajvalam

Hi, I have 7+ year of experience in database development and BI implementation. Mostly I worked with Pentaho business suits and most of RDBMS databases. According to my personal experience I suggest you to choose HP Flere

$890 AUD in 10 dage
(1 bedømmelse)
1.1
CitachiTech

Hi there, Good Evening ! How are you? I see that you need a developer who is skilled in database migration. It seems like a very straightforward job, we can do this easily. I am Hardik Kotecha. I have close to 1 Flere

$277 AUD in 3 dage
(0 bedømmelser)
0.0
himamahi09

Hi, Seeing the project description and requirement, I would suggest to migrate to PostgreSQL. I have experience of handling one OLAP of ~14TB on PostgreSQL with fact tables of size like > 100GB. I am able to achieve Flere

$1000 AUD in 15 dage
(0 bedømmelser)
0.0
chaituthalikota

I have gone through your requirement and I have done similar projects in past. The requirement is similar to what I am doing right now. we have a MySQL OLTP which we have migrated to postgresql. We have build DWH with Flere

$777 AUD in 15 dage
(0 bedømmelser)
0.0
techlinesols6

Dear Prospect Hiring Manager. Thank you for giving me a chance to bid on your project. i am a serious bidder here and i have already worked on a similar project before and can deliver as u have mentioned "I can do Flere

$208 AUD in 7 dage
(0 bedømmelser)
0.0
techlinesols35

"Hi, Hope you are doing well! Thanks for sharing your project requirement with us. It will be our great pleasure to work on your project. I have checked your requirement, yes we can do it, because we already work on si Flere

$208 AUD in 7 dage
(0 bedømmelser)
0.0
JhansiYarlagadda

I am working as Big data developer at arrow electronics USA. Please find my linkedln link [login to view URL]

$277 AUD in 3 dage
(0 bedømmelser)
0.0
rahulsingh239ca

Hello, Hope you are doing great ! As per your requirements, I saw a 50+ Tables where your destination source will fetch the data and you require a Analytical Database for this perpose. I having a 2+ years of experien Flere

$333 AUD in 10 dage
(0 bedømmelser)
0.0
devxterity

Hi there, Greetings!! I read your description carefully and assure you to provide you with website support and development services for your website as i am expert level developer and designer having 5+ years of ex Flere

$250 AUD in 3 dage
(0 bedømmelser)
0.0
dineshrajputit

Hi, I have 8 years of experience and working on hadoop, spark, nosql, java, BI tools(tableau, powerbi), cloud(Amazon, Google, Microsoft Azure)... Done end to end data warehouse management projects on aws cloud with ha Flere

$55 AUD på 1 dag
(0 bedømmelser)
2.8
artirajora

Hello We are team of smart developers working in IT industry from past 7-years have developed 200+ simple and complex Mobile phone apps for Android & iPhone, Hybrid app and many Websites in RubyOnRails,WordPress Flere

$250 AUD in 3 dage
(0 bedømmelser)
0.0
choudharyneeti11

- 7.8 Years of onshore and offshore experience in EIM Technology, specializing in OLAP, ETL, Informatica, IBM DB2, Tableau, Quality Centre, Microsoft Sql Server, JIRA, Data Analysis, Alteryx. - Having a good understan Flere

$277 AUD in 3 dage
(0 bedømmelser)
0.0
DataLamp

We DataLamp, is a Big Data company which works in Java, Data-Pipeline, BI/Visualisation/Reporting & Recommendation solutions. We also provide optimisation in existing architectural design for better performance. W Flere

$277 AUD in 3 dage
(0 bedømmelser)
0.0
soumyabratabat

Hello , I’m excited to share with you the proposal for this project. As I understand about your project it's truly challenging. I'll assure you that this project will complete within promise day. I’m truly excite Flere

$166 AUD in 9 dage
(0 bedømmelser)
0.0
waseemsaleemg

Hi Dear, Our best concern is to follow your requirement and deadline and we will do our best for the success of your project. Feel free to send message to discuss your project with us. Thank you very much! Surely, we Flere

$155 AUD in 3 dage
(0 bedømmelser)
0.0