...milestones: 1. Data Model: Define the data model for the new index using the tool Hackolade. It's a data modeling tool for noSQL/doc-based repositories. There is a free trial. 2. ETL: The transformation process to take the two mariaDB tables and get them into json structure that's defined as part of step 1. 3. Index: Configuration of the Elasticsearch index
· PROJECT BASED IN MADRID · SQL Avanzado · Experiencia en ETL · Conocimientos básicos en API REST · Experiencia con bases de datos Relacionales (Oracle, Postgres, MySQL) · Nociones de bases de datos noSQL · Ingles nivel medio o superior
...database administration. Here is what we currently have: - Azure SQL Database - Azure VM - Azure Storage Account Currently Empty - Blob Storage Account (I believe empty) - ETL: Custom Code that loads our SQL database from the files that we poll (Amazon S3) that has redundancies built in in case files don't load correctly - Currently we have no Kimball/Inmon
...growing team, building a new generation of weather and business risk capabilities. We are looking for a Data Engineer with knowledge of data warehousing and experience with ETL tools to leverage state-of-the-art data and analytics to establish our platform. What You Will Do: • Develop APIs that will interface with insurance companies, clients and
installation of test environment in tour hosting server and production environment on our proprietary server, multi company ...production environment on our proprietary server, multi company module, creation of new dolibarr modules, creation of pdf print of contracts, reporting, export of data for invoicing, etl for migration of data from existing erp
installation of test and production environment on proprietary server, ...production environment on proprietary server, multi-company module, creation of new dolibarr modules, creation of pdf print of contracts, reporting, data export for billing, etl for data migration from existing erp. departure project mid-January, end of project 28 February 2019.
installation of test and production dolibarr environment on pr...production dolibarr environment on proprietary server, multi-company module, creation of new dolibarr modules, creation of pdf print of contracts, reporting, data export for billing, etl for data migration from existing erp. departure project mid-January, end of project 28 February 2019.
...do not have at least 2 of those skills at strong proficiency and 1 at medium, please do not apply. • Data Warehouse design experience • Python/R/SQL, • Tableau/PowerBi • ETL concepts • predictive & classification methods Please state your expertise In one of these key areas of specialization: >> AWS for Big Data, Azure for Big Data, Cloud Architec...
Progress Tech Solutions is looking to hire a highly experienced Data Analyst/ETL tester Tutor for its technology division. We will be conducting initial round of interview followed by a video demo call. - Qualified candidate should be able to work from 7:30 to 9:30 PM CST on weekdays. - Candidate should have strong verbal and presentation skills -
Training will be mostly for new candidates and some with short experience. A trainer is expected to have min 5yrs of experience in the USA based projects on similar positions. Submit your proposal with Detailed course outline.
Required single dedicated part time developer on below skills At least 3 years of experience working in Hadoop Ecosystem and big data technologies Build data pipelines and ETL using heterogeneous sources to Hadoop using Kafka, Flume, Sqoop, Spark Streaming etc. Experience in batch (Spark. Scala) or real time data streaming (Kafka) Ability to dynamically
...skill, Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala. • Experience with Spark, Hadoop, MapReduce, HDFS. • Knowledge of various ETL techniques and frameworks, such as Flume, Sqoop. •  ...
...Providing guidance on suitable options, designing, and creating data pipeline for the analytical solutions data lake / data warehouses to specific micro services ▪ Building ETL jobs based on jointly defined requirements along the data pipeline ▪ Works closely with both the backend developers as well as the IT data architecture group ▪ Supporting the
I have an existing MongoDB app that is used by a Spring Boot App to provide REST services to Front End (Angular) clients. Need t...MongoDB app that is used by a Spring Boot App to provide REST services to Front End (Angular) clients. Need to port the MongoDB schema over to Apache Cassandra and Port the ETL logic from Spring Boot over to Apache Storm
Need to pa...wrangling in Amazon Web Services. Time zone is in UTC +8 area or if you can do these times. Maybe an hour a day weekly or more time depending on workload. Tools used: Python, SQL, ETL, lambdas, Redshift, Mysql When bidding on this project let me know what number is a baker's dozen so I know you can speak English and you are not a robot.
...data scientist currently working on a data engineering task and I would need some assistance. I have the data on S3 in 7z JSON, which I would like to convert to Parquet run ETL jobs and finally create a dashboard. I am trying the following: Glue -> Parquet -> Athena or Batch -> docker image -> R jobs I am running into issues and would need someone
good morning, we have an SQL server 2008 R2 on windows 2008 R2, it has an ETL process that builds a Cube. The ETL has worked fineso far, but now it does not complete (continues forever). would you be interested in taking a look, launching it in debug mode and see what is the problem?
Process and clean a list of large amount of raw data (export and import data) obtained from trade facilitation companies. Build a framework and process for data cleaning. Some level of text cleaning and API call is needed to successfully map each row of data into a correct category (eBay or Google API). Develop a program to process more similar raw data files in the future, and facilitate sto...
Transition 15 fields and 1 million records from source 1 to source 2. More information and attachments will follow after your bid.
We have a need for someone to help in development and operations work. Initially some ETL development using Python/pandas. Knowledge of cassandra/nosql databases, Ubuntu, virtual environments (docker), and parallel/distributed programming is required.
I want to customize an open source ETL in order to made some changes and integrate some new features/Solve bugs and trace/debug errors.
...zugehöriger Prozesse im DWH • Analyse von Kundenanforderungen, Entwurf und Implementierung von Lösungen • Aufbau von Integrations- und Transformationslösungen mit ETL-Tools und SQL • Erstellung von Reports und Frontend Layern mit Standardtools und SQL • Übernahme von Projektaufgaben als Mitglied eines agilen Teams I...
I am working as Data Warehouse Engineer. And I need some support(proxy) to help in my work. Its related to Data Migration and requires creating ETL mapping documents, maintaining them, ER diagram development, writing SQL queries, creating SSIS packages.
Need a female proxy with good knowledge of hadoop ecosystem such as hive, mapreduce, hdfs, hbase. should know spark [log ind for at se URL] that would be good to...with good knowledge of hadoop ecosystem such as hive, mapreduce, hdfs, hbase. should know spark [log ind for at se URL] that would be good to know - java, scala, python. knowledge of ETL processes are a plus
I started building a visual ETL tool but now lacking the time to finish it up. I need a strong WPF and C# developer to help me cross the finish line. Skillset includes the following: - C# WPF view/layer - Data mapping technical and best practice with SQL Server in the backend