
In Progress
Posted
Paid on delivery
I need a clear, reproducible walkthrough that takes me from a clean repo to a fully working Retrieval-Augmented Generation pipeline in Databricks. The source documents I will load are PDFs stored in a Unity Catalog volume, so please begin with the ingestion flow that generates embeddings for that format. I am happy to use any Llama foundational model you recommend—the “other” choice I selected simply means I am flexible as long as the end-to-end solution performs well. I have a workspace pre-configured, with a cluster running. What I must receive • A step-by-step guide and code that explains: – setting up the python project in Databricks Asset Bundles layout, – configuring Databricks Connect so I can develop from VS Code, – loading the PDFs into a Unity Catalog volume, – generating embeddings with the selected Llama model via Databricks Foundation Models API, – saving those embeddings—first preference is a Delta table; if that is not feasible, show how to use Databricks Vector Search indexes and outline cost and scaling implications of each option, – creating and deploying a serving endpoint that exposes a RAG function with zero errors, – wiring up a minimal sample app or notebook that queries the endpoint and returns answers. • All python code, unit tests if relevant, and the [login to view URL] files arranged exactly in Databricks Asset Bundles structure so I can deploy with “dbx deploy” or the native bundle CLI. • A brief note on how you verified the endpoint (curl or Python request snippet). Payment will be split: an initial deposit on contract start, with the balance released once I confirm the guide and scripts run without modification in my environment. You can use dummy pdf documents to get the code up and running and working, then provide me with step by step instructions, and I can swap out for what I need.
Project ID: 39735382
86 proposals
Remote project
Active 4 days ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs

With more than 7 years of experience in software development, machine learning, and automation, I am the ideal candidate to guide you through setting up your Retrieval-Augmented Generation pipeline in Databricks. My deep understanding of Python and the Llama foundational model will allow me to provide you with a step-by-step guide that ensures a fully functioning pipeline tailored to your needs. I have carefully reviewed your project requirements and I am confident in my ability to assist you effectively. I would love to discuss your project further in chat to understand your specific needs and how I can best support you. Looking forward to connecting with you. Regards,Vishruth
£135 GBP in 4 days
6.0
6.0
86 freelancers are bidding on average £150 GBP for this job

Hello, Having successfully executed numerous complex projects, my team at Yazir Software knows how crucial it is to provide not only a working solution but also a clear and reproducible walkthrough. I understand that you need a step-by-step guide that efficiently navigates you from a clean repo to a fully operational Retrieval-Augmented Generation pipeline in Databricks. I assure you of an end-to-end, meticulous implementation process, including the python project setup in Databricks Asset Bundles layout, configuring Databricks Connect for VS Code usage, loading PDFs into a Unity Catalog volume, generating embeddings with the recommended Llama model via Databricks Foundation Models API, saving those embeddings as Delta table or utilizing Databricks Vector Search indexes per your preference and outlining cost and scaling implications of each option. Additionally, my expertise extends to creating and deploying streamlined serving endpoints that accurately showcase the RAG function. Furthermore, I am adept at wiring up sample apps that effectively query the endpoint and return answers. With this project's specific task of handling PDFs stored in Unity Catalog volumes, my prior experience with diverse file formats will be immensely advantageous. With your preferred mode of payment split and release upon successful execution, It is my commitment to carefully document and validate every step ensuring you can flawlessly run everything on Thanks!
£150 GBP in 1 day
7.8
7.8

⭐⭐⭐⭐⭐ Create a RAG Pipeline in Databricks for PDF Ingestion & Embeddings ❇️ Hi My Friend, I hope you're doing well. I reviewed your project needs and see you are looking for a complete Retrieval-Augmented Generation pipeline setup in Databricks. You don’t need to look any further; Zohaib is here to help you! My team has successfully handled over 50 similar projects. I will ensure a clear walkthrough from a clean repo to a fully working pipeline, along with embedding generation from your PDF documents. ➡️ Why Me? I can easily create your RAG pipeline as I have 5 years of experience in Databricks and Python development, focusing on data ingestion, embeddings generation, and API deployment. My strong grip on various foundational models and Databricks tools will ensure your project is efficient and effective. ➡️ Let's have a quick chat to discuss your project in detail, and I can show you samples of my previous work. Looking forward to our conversation! ➡️ Skills & Experience: ✅ Python Development ✅ Databricks Setup ✅ API Deployment ✅ PDF Ingestion ✅ Delta Tables ✅ Vector Search ✅ Llama Models ✅ Databricks Connect ✅ Unit Testing ✅ Asset Bundles Structure ✅ Error Handling ✅ Data Processing Waiting for your response! Best Regards, Zohaib
£150 GBP in 2 days
7.9
7.9

Hello, I appreciate the detailed brief, and as both WellSpring Infotech and I share an entrepreneurial mindset, I understand the importance of having a reliable and comprehensive technical partner in your project. With over a decade of experience, I have developed robust skills in JavaScript and Python, making me an ideal candidate for setting up your Retrieval-Augmented Generation (RAG) pipeline in Databricks. In addition to our proficiency in these languages, my team and I are well-versed in business intelligence frameworks like Databricks and Llama models. Our proven track record underscores our ability to design adaptable data ingestion flows that would seamlessly process PDFs from a Unity Catalog volume into embeddings. We’ve also identified cost, scaling, as well as efficient embedding storage options such as Delta tables and Databricks Vector Search indexes - this would help you weigh each option depending on your particular use case. Moreover, you can be assured that all code and necessary components will be arranged perfectly in Databricks Asset Bundles structure, ensuring smooth deployment and future management. As sticklers for quality assurance, we intend to eliminate any additional work or troubleshooting on your part by providing thoroughly tested codes and giving you step-by-step instructions to follow for seamless replication on your clean repo. Let's collaborate closely to deliver results synonymous with exceeding expectations! Thank you
£250 GBP in 5 days
7.3
7.3

Hello Georgina L. I hope you're doing well. I understand you're looking for Databricks RAG Setup code through to app deployment I am the ideal candidate for your project. I have read the provided job description and I understand what you are looking for. I have over 10+ years of experience JavaScript, Python, Data Processing, Cloud Computing, C# Programming, Software Architecture, Data Science, API Development, AI Model Integration, AI Development .Please feel free to further discuss the requirements and timeline for the project. I'd be happy to assist you. I am ready to start right now. ✅ No Upfront Payment ✅ Release Milestone After Completion ✅ 100% Project Completion Rate You can visit my Profile https://www.freelancer.com/u/HiraMahmood4072 Thank you
£100 GBP in 2 days
5.6
5.6

Hello Georgina L. Hope you are doing well! This is Efan , I checked your project detail carefully. I am pretty much experienced with Data Science, AI Development, AI Model Integration, JavaScript, Software Architecture, Python, Cloud Computing, Data Processing, C# Programming and API Development for over 8 years, I can update you shortly. Cheers Efan
£150 GBP in 1 day
5.9
5.9

Hello, I hope this message finds you well! My name is Narayanan S, and I am a web and mobile app expert with over 12 years of experience. I have successfully completed more than 100 projects on Freelancer, all receiving 5-star ratings, showcasing my commitment to quality and client satisfaction. I have extensive experience in the skills required for your project, particularly in React.js, Node.js, and mobile app development using React Native. Recently, I developed a cross-platform mobile app for a client that streamlined their business processes, integrating real-time data and offering a modern user experience that significantly improved user engagement. For your project, I propose a high-level plan that includes understanding your requirements in detail, followed by creating a responsive design and developing the necessary backend services. I would love to discuss your vision further and refine the technical details to ensure we meet your goals. Looking forward to the opportunity to collaborate! Best regards, Narayanan S
£135 GBP in 7 days
5.2
5.2

Hi client, I'm Denis Redzepovic, an experienced developer with expertise in AI Development, Data Processing, API Development, AI Model Integration, JavaScript, C# Programming, Data Science, Python, Cloud Computing and Software Architecture. I have worked extensively on diverse Python projects, ranging from backend development and automation to data processing and API integrations. My deep understanding of Python’s libraries and frameworks allows me to build efficient, scalable, and maintainable solutions. I pay close attention to code quality and performance to ensure your project runs flawlessly. With my solid experience, I’m confident I can deliver results that exceed your expectations. I focus on writing clean, maintainable, and scalable code because I know the difference between 99% and 100%. If you hire me, I’ll do my best until you’re completely satisfied with the result. Let’s discuss your project details so I can tailor the perfect Python solution for you. Thanks, Denis
£150 GBP in 1 day
5.4
5.4

⭐Hi, I’m ready to assist you right away!⭐ I believe I’d be a great fit for your project since I combine fast execution with careful attention to detail, ensuring you get both quality and efficiency without stretching your budget. I’ve worked on projects where I built [web apps / automation tools / integrations—adapt for the job posting] that needed clean design, smooth functionality, and quick turnaround. I also have hands-on experience with [specific tech or business domain—e.g., APIs, databases, AI models, payment systems] that directly matches what your project requires. From what you described, the main challenge is [short summary of project issue—e.g., replacing outdated code, building a streamlined system, or creating a user-friendly solution]. By solving this, you’ll have a reliable setup that removes current roadblocks and gives your users a smooth, professional experience. If you have any questions, would like to discuss the project in more detail, or would like to know how I can help, we can schedule a meeting. Thank you. Maxim
£135 GBP in 7 days
5.5
5.5

Hi there, I'm Ahmed Hassan, a Senior Full-Stack Engineer based in California with over 15 years of hands-on experience in web and mobile application development. After reviewing your job posting, I’m confident that my background aligns closely with your project requirements and enough qualified for your project - Databricks RAG Setup code through to app deployment. I’ve successfully delivered SIMILAR projects in previous roles—both as a senior developer and project manager—ensuring secure, scalable, and user-friendly systems tailored to business goals. I’d love the opportunity to discuss how I can contribute to your project’s success. Looking forward to connecting. Best regards, Ahmed Hassan
£150 GBP in 1 day
4.9
4.9

Hello there. Georgina L., Good evening I’ve carefully checked your requirements and really interested in this job. I’m full stack node.js developer working at large-scale apps as a lead developer with U.S. and European teams. I’m offering best quality and highest performance at lowest price. I can complete your project on time and your will experience great satisfaction with me. I’m well versed in React/Redux, Angular JS, Vue, TypeScript, Node JS, Ruby on Rails, django, .net, html/css as well as javascript, jquery, web3, and solidity. I have rich experienced in Cloud Computing, Software Architecture, C# Programming, Data Science, Python, AI Development, API Development, AI Model Integration, Data Processing and JavaScript. For more information about me, please refer to my portfolios. I’m ready to discuss your project and start immediately. Looking forward to hearing you back and discussing all details.. With regards Angel
£150 GBP in 1 day
5.1
5.1

As an experienced freelancer with over 10 years helping clients achieve their project goals, I am confident in my ability to meet all your Databricks RAG set up needs. While I appreciate that my background is centered around Web and Software development, I assure you that I possess the essential skills, such as Data Processing, JavaScript, and Python that are necessary to tackle this project effectively. Ultimately, our shared vision of producing high-quality work aligns closely with maintaining a great client-vendor relationship throughout all stages of a project making me the ideal candidate for this job. My team at Prajapati Technologies and I are available 7 days a week to assist you whenever needed even after completing the task. I'm eager to discuss more details about the project with you and demonstrate how my skills can provide you with an efficient, top-notch solution for your business needs. Thank you for considering me for this opportunity - let's connect soon!
£190 GBP in 7 days
4.8
4.8

HI, Georgina L. I just checked job description that I need a clear, reproducible walkthrough that takes me from a clean repo to a fully working Retrieval-Augmented Generation pipeline in Databricks I'm a specialist in Artificial intelligence agent development with 5+ years of experience in tenforflow, pytorch, keras, opencv, nvidia, etc. I have read your requirement in the description carefully and have understood them. I have experience with developing many projects like palmprint recognition, face recognition, financial prediction, VR, segmentation, tflite in past. I can assure you that you will get your project delivered in a timely and quality manner. I will give my best to get positive feedback and a 5-star rating for this project from you. Looking forward to hearing from you. Thanks. Best Regards
£150 GBP in 1 day
4.3
4.3

Hello Georgina L., I hope this message finds you well. My name is Mikhail, and I'm reaching out to express my interest in your project titled "Databricks RAG Setup code through to app deployment" With extensive experience and a strong skill set in AI Development, Data Science, Cloud Computing, Python, API Development, Data Processing, AI Model Integration, C# Programming, Software Architecture and JavaScript, I am confident in my ability to deliver outstanding results that meet your expectations. I have a proven track record of successfully completing similar projects, and I am eager to bring my expertise to your initiative. Understanding the importance of timely delivery and budget constraints, I am committed to providing efficient solutions without compromising on quality. I prioritize clear communication and collaboration, ensuring that we are aligned throughout the project's duration. I would be thrilled to discuss how I can contribute to your project's success in more detail over chat. Looking forward to the opportunity to work together. Best regards, Mikhail
£250 GBP in 2 days
4.5
4.5

Dear Client, As an experienced full stack developer, my expertise spans Python, JavaScript, and Cloud Computing - making me well-suited for your Databricks project. I have a deep understanding of software architecture that will enable me to craft a clear, step-by-step guide and code that addresses each stage of your Retrieval-Augmented Generation pipeline. My proficiency in AWS EC2, S3, DynamoDB, and other services aligns with some of the technologies employed in Databricks. In line with your requirement for an end-to-end solution that performs optimally, I guarantee to generate embeddings for your PDFs using the most fitting Llama foundational model. In terms of scalability and costs implications—crucial considerations—I will recommend the best approach between using Delta table or Databricks Vector Search indexes to store embeddings. Lastly, I'm accustomed to deploying using the "dbx deploy" native bundle CLI or any supplied instruction; this extends to configuring Databricks Connect for leveraging Visual Studio Code (VS Code). You would find my job not only meeting all your needs but delivering an elegant yet simple solution that allows you to easily swap dummy data with real pdf documents and an assured support after the project is completed. Trust me with your project and let's bring it to life!!! Thank you!!!
£250 GBP in 7 days
4.5
4.5

Hello I am Zaheer Padani, a developer with experience in AI and data engineering, including RAG (Retrieval-Augmented Generation) implementations on Databricks. I can set up and code a robust RAG system to enhance your LLM's accuracy and contextual understanding. To tailor the solution, what is the primary data source or domain for the RAG system? Best regards, ZP
£135 GBP in 3 days
4.0
4.0

Hello, I appreciate your detailed project description outlining the need for a Retrieval-Augmented Generation (RAG) pipeline in Databricks. With your pre-configured workspace and a clear understanding of your requirements, I'm excited to offer a tailored solution that captures every aspect of your setup. I will provide a comprehensive, step-by-step guide that includes: - Setting up your Python project in the Databricks Asset Bundles layout. - Configuring Databricks Connect for VS Code development. - Successfully loading PDFs into a Unity Catalog volume and generating embeddings using the Llama foundational model. - Saving embeddings to a Delta table, along with cost and scaling implications if using Vector Search indexes. - Creating and deploying a serving endpoint that exposes the RAG function without errors. - Providing a minimal sample app that queries the endpoint. Rest assured, your payment structure will be respected, ensuring you receive both the guide and the code ready for deployment. I am committed to delivering an efficient and reproducible solution that meets your needs. Could you please specify if there are any particular Llama models you prefer for embedding generation, or should I choose based on performance insights? Thanks, Faisal
£150 GBP in 25 days
3.5
3.5

Hello gladd16, As a seasoned developer with expertise in Python, JavaScript, C#, and Cloud Computing, I am excited about the opportunity to assist you with your Databricks RAG Setup project. I have a solid background in Data Science, API Development, and AI Model Integration, making me well-suited for this task. I am confident in my ability to provide you with a clear and reproducible walkthrough, from setting up the python project in Databricks to deploying a fully working Retrieval-Augmented Generation pipeline. Rest assured, I will deliver step-by-step instructions, high-quality code, and guidance on verifying the endpoint. Let's collaborate on this project and bring your vision to life. I look forward to discussing the details further and
£175 GBP in 3 days
4.2
4.2

Hello, As an experienced Web and Mobile App Developer, my primary focus has been on creating practical, effective, and efficient solutions for clients' needs. With Python, C# Programming and JavaScript among my core skills, I am well-prepared to take on your Databricks RAG setup project. I have a deep understanding of the entire development life cycle - from requirement gathering through to CI/CD. My experience with various CMS platforms, including Django and Flask, along with RESTful APIs makes me adept at configuring Databricks Connect and setting up python projects in Databricks Asset Bundles layout as you've stated in your project requirements. Additionally, for your specific workflow of loading PDFs into a Unity Catalog volume, I have a good command of Python libraries like Pandas, NumPy & PyPDF2 which enables me to extract the text data from your format. Moreover, my well-versedness with front-to-back development using technologies such as React, Vue and Angular combined with my fluency in Python offers a unique blend of skills that will be beneficial while wiring up your requested sample app or notebook that queries the endpoint and returns answers. Be assured that my aim is producing a step-by-step guide featuring clear code explanations, unit tests if relevant, and script arrangements for you to confidently deploy using "dbx deploy" or other CLI tools. Thanks!
£150 GBP in 1 day
3.9
3.9

Hi, We would like to grab this opportunity and will work till you get 100% satisfied with our work. We are an expert team which have many years of experience on JavaScript, Python, Data Processing, Cloud Computing, C# Programming, Software Architecture, Data Science, API Development, AI Model Integration, AI Development Lets connect in chat so that We discuss further. Thank You
£250 GBP in 7 days
3.6
3.6

With my extensive experience in software development, I believe I'm the ideal candidate to guide you through your journey from setting up a clean repo to deploying a fully functioning Retrieval-Augmented Generation pipeline in Databricks. I’ve worked on several projects using Python, which would be incredibly valuable here when it comes to loading the PDFs into a Unity Catalog volume and generating embeddings with your chosen Llama model. In addition, my familiarity with various cloud platforms including AWS and Google Cloud will come into play when configuring Databricks Connect and recommending the most suitable option for saving the embeddings (be it as Delta tables or by using Databricks Vector Search indexes). My proficiency in C#, JavaScript and Software Architecture will also provide you with valuable insights as you wire up your minimal sample app or notebook that queries the endpoint and returns answers. Lastly, rest assured that with my meticulous approach to project development, I'll ensure clear step-by-step documentation of every process and provide all python code and unit tests needed for thorough reproducibility. Your satisfaction is my priority; payment will only be released when you confirm the successful execution of the scripts in your environment. Let's get started on empowering your data-driven goals with Databricks!
£135 GBP in 7 days
3.6
3.6

Nottingham, United Kingdom
Payment method verified
Member since Jan 3, 2016
£20-250 GBP
£10-20 GBP
£10-20 GBP
£20-250 GBP
£20-250 GBP
$750-1500 USD
$1500-2000 USD
₹600-1500 INR
$5000-10000 USD
$750-1500 USD
$8-15 USD / hour
₹750-1250 INR / hour
₹12500-37500 INR
€250-750 EUR
₹600-1500 INR
$30-250 CAD
$2-8 USD / hour
₹12500-37500 INR
₹12500-37500 INR
₹1500-12500 INR
₹1500-12500 INR
$1500-3000 USD
$30-250 USD
₹12500-37500 INR
$250-750 USD