Azure AWS pipelines with databricks

@sahilcomputers39

Hi, Are you looking to build a reliable Azure/AWS data pipeline with Databricks that can analyze cloud usage and generate accurate cost-saving recommendations? I can help you design and implement the complete solution. I have 16+ years of experience in AWS, Azure, DevOps, cloud architecture, data pipelines, automation, and production environments, with hands-on experience across cloud services, Databricks, monitoring, analytics, and optimization. I can help build the pipeline to collect and process AWS/Azure usage and infrastructure data, integrate it with Databricks, analyze resource utilization and cloud costs, and develop a recommendation engine that identifies optimization opportunities and potential savings. I can also automate the data ingestion and processing workflows so recommendations remain updated as usage changes. The solution can include AWS/Azure integration, Databricks pipelines, data processing, cost analysis, usage-based recommendations, dashboards/reporting, automation, and secure cloud architecture. I’m available for a Freelancer call to understand your current environment, data sources, and recommendation requirements and discuss the best implementation approach. Rate: USD $15/hour, negotiable based on the project scope. Best regards, SaD

@kumarashish99

As an experienced AWS-certified professional, I have accumulated a wealth of expertise over the past 5 years that is perfectly suited to the goals of your project. I am highly proficient in backend development utilizing languages such as Node.js, Python, and PHP; and have extensive experience in building serverless and containerized applications using frameworks like Serverless Framework, SAM and SST. I believe my skills align directly with your needs to create Azure AWS pipelines with Databricks. Lastly, my knowledge of integrating advanced AI/ML solutions into cloud infrastructures perfectly complements your requirement for a recommendation engine. Having worked extensively with AWS's AI/ML services, including Textract, Comprehend, Kendra and Rekognition, I understand how they can powerfully drive automation for cost-saving calculations. In conclusion, with my breadth of skills in AWS and Azure, backed by my commitment to quality and deep establishment in DevOps, I am confident in offering a turnkey solution that not only fulfills but exceeds your expectations for this project.

@Cyberoisystems01

Hi there, I can help build the Azure/AWS data pipelines with Databricks for your recommendation engine. I have experience with AWS, cloud services, data pipelines, automation, and deployment. I can help with: * Azure/AWS pipeline setup * Databricks integration * Usage and cost data processing * Cost-saving recommendation logic * Deployment and testing I’m available to start immediately and can discuss the requirements in detail. Thanks!

@apurvasakhare21

Hi, I've worked on similar cloud cost-optimization/recommendation builds before, integrating usage data from Azure/AWS with Databricks for analysis and cost-saving recommendations. I can build this as a pipeline that ingests your deployed environment's usage metrics, applies a cost-calculation/recommendation model, and outputs actionable savings insights. Before I finalize scope and timeline, a couple of quick questions: which cloud environment(s) are currently deployed (Azure, AWS, or both), and do you have existing usage/billing data exports I'd work from, or does this need to pull live from cloud APIs? Also, is the expected output a dashboard, a report, or an API/script other systems will call? Once I know these details I can commit to a precise timeline — based on typical scope for this kind of recommendation engine, I'd estimate 5–7 days.

@Divyanshu1701

Hi, I’m interested in building your cloud cost optimization recommendation engine. I have hands-on experience with Python, Machine Learning, data analysis, anomaly detection, FastAPI, Docker, and MLflow, and have built end-to-end ML systems involving large-scale usage data, prediction, monitoring, and automated retraining. For this project, I can develop a pipeline that analyzes deployed-environment usage, identifies cost patterns and inefficiencies, and generates data-driven savings recommendations. I’m also comfortable working with AWS/Azure environments and scalable data/ML workflows. I’d be happy to discuss your current usage data, cloud architecture, and the type of cost recommendations you want the engine to generate. Best regards, Divyanshu Pandey

@nabeeli18

Greetings I understand you're looking for a recommendation engine for cost calculation based on usage within Azure AWS pipelines with Databricks, and we have successfully completed similar projects in the past. Your goal of optimizing cost savings through usage analysis is crucial, and we can implement a robust solution that leverages Databricks to analyze deployed environments effectively. By integrating Azure and AWS, we can ensure seamless data flow and real-time insights, leading to significant savings for users. I bring experience in developing data-driven solutions, particularly in cloud environments, and I am confident in delivering a tailored recommendation engine that meets your needs. I would love to chat about your project and suggest a follow-up discussion to explore how we can work together. Regards, Nabeel Ismail

@bhargav922002

Hello, I have carefully reviewed your requirements for building an intelligent recommendation engine to calculate cloud cost savings based on

@indreshpnk

Hello, I understand you need a recommendation engine that analyzes usage of your deployed environments and calculates potential cost savings. The goal is to provide actionable, data-driven recommendations across cloud resources. Here’s what I can provide: Analyze Azure/AWS usage, resource utilization and historical cost data to identify optimization opportunities. Build an ML/data-driven recommendation engine to estimate savings from rightsizing, scheduling and resource optimization. Integrate Databricks for data processing, dashboards/reports and scalable analysis, with secure cloud deployment. I bring over 4+ years of experience in cloud computing, AWS, Azure, machine learning, data analysis and Databricks, focusing on practical automation and cost-optimization solutions. Just to clarify a few things: Which cloud environment should be prioritized, Azure or AWS? Do you already have historical usage and billing data available? Please come to the chat box to discuss more about your project. Best regards Indresh Kushwaha

@bikashp2003

Data Engineer with hands-on experience designing and implementing end-to-end data solutions on Microsoft Azure and Microsoft Fabric. Skilled in Azure Data Factory, Azure Databricks, and PySpark for building ELT/ETL pipelines using Medallion Architecture. Strong foundation in data integration, transformation, data quality, and metadata-driven pipeline design