Spark Jobs

Purpose: To enable and control access to data on a system database via an API. Example: Say for instance, an application wants access to credit card data for a particular user. A table has 50 columns and the application doesn’t need the data in all 50 columns, only 3. The application may want to access a user's ssn, phone, monthly amount spent. The API should expose data from the...

Environment : spark-2.3, kafka-0.10, Avro data, scala-2.11.8 Build pipeline to stream Avro data from kafka topic.

We are working in development of filter to upload them in facebook. We need to create a skin of a tigger with mustache, ears, shaded eyes and skin characteristics. In this moment we have the image of this animal in 2D but we needed in 3D to implement in Spark AR Studio. Also to begin this project we need to know how many hours it would take.

DNA methylation is a well-studied genetic modification crucial to regulate the functioning of the genome. Its alterations play an important role in tumorigenesis and tumor-suppression. Thus, studying DNA methylation data may help biomarker discovery in cancer. Since public data on DNA methylation become abundant, and considering the high number of methylated sites (features) present in the genome,...