We have a requirement on Data Migration project. Need to do migration of OLAP data warehouse system from on-Premise to Google Cloud -Big query

We have a requirement to do migration OLAP data warehouse system from on-Premise to Google Cloud -Big query Next year .

Requirement:

Data Size: 70 TB

Data: Structure data

Source DB: DB2/SQL/Oracle (Relation DB-OLAP) :ROW based DB

Target -Bigquery: No Relation DB , No SQL ,Columnar DB

Cloud Storage Layer: Google Bucket

CLoud Data warehouse : Bigquery

Data validation Requirment: How to validate file in google bucket vs data in Bigquery based on time stamp.

Use Case: Fraud Detection

Real time: Real time Initiala and detal load

Industry: Finance

Source: Bigquery - building Data Lake (No SQL)

Approach: Extract-> Load ->Transform

Technology: Data flow -Apache Beam using Java (Confirmed by client and Recommended by Google [login to view URL]

[login to view URL])

Language : Java (preferred) /Python

- How to migrate data from Source to target in real time ?

- How do data validate ,verification using Java/Python and generate report for data quality check like Row count, Cloumn count, Field value validation

- Special character, Non English text, sign ,blank value

- Data Modeling in Non Sql Big query Star schema to Data vault schema

- Data Masking and Data Encryption

- Data governance integration Informatica Axon and Colibra

- Data Migration Strategy

- Data Ingestion Strategy

- Date Quality and Data Verification Strategy

- List of Data Validation and verification approach and scenario

- List of data Transformation scenario

- Data Integration strategy

- Atunity VS Goldengate vs Talend vs Informatica vs IBM infostage vs MS BI SSIS vs Oracle ODI for Extract and Load comparison

Evner: Informatica Powercenter ETL, Java, Oracle, Python, SQL

Se mere: joomla migration project, server migration project planserver 2008, exchange 2007 migration project, bigquery gcp permissions, an existing application uses websockets to help migrate the application to cloud you should, in gcp what is the minimum number of ip addresses that a vm instance needs quizlet, which of the following does not allow you to interact with gcp quizlet, exchange 2007 migration project bid, magento data migration project, data center migration project schedule, data center migration project, data migration project schedule, data center migration project schedule template, wbs data migration project, data center migration project wbs, data migration project schedule template, data center migration project work breakdown, BIDS/ENTRIES STARTED PRICE (INR) Odoo Accounting data migration I need an experienced Odoo implementer to help me migrate my , data migration project steps, data migration project plan mpp

Projekt ID: #23165195