
Closed
Posted
Paid on delivery
I need a reliable web-scraping setup that gathers product details from Australian e-commerce, retailer, and manufacturer websites and consolidates everything into a single, Shopify-ready file I can import without extra tweaking. The data I want captured for every matching product is: product name, price, kit configuration, shipping cost or policy, and any membership or subscription pricing the site displays. Because many stores carry the same items, the script must recognise duplicates, merge the records, and clearly show which site each data point came from. Require packet size, images, and exact names for different varities. Please build the scraper, run an initial full pull, and deliver: • A clean CSV formatted exactly to Shopify’s column requirements, with the fields above populated for every unique product. • The documented code or workflow (Python, Scrapy, BeautifulSoup, Selenium—use whatever you prefer) so I can rerun it when prices change. • A brief read-me explaining how to update the regional site list or add new sources. Accuracy and deduplication are critical; I will spot-check before sign-off.
Project ID: 40414862
38 proposals
Remote project
Active 10 days ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
38 freelancers are bidding on average $25 AUD for this job

Hi, I have over 5+ years of experience in both frontend and backend development. I will do the specified tasks. Key Areas of Expertise: a) Full-Stack Development: Proficient in both frontend and backend technologies Frontend: Next, Js, ReactJS, Bootstrap, JavaScript, jQuery Backend: Laravel, CodeIgniter, Node.js b) API Integration: Experienced in integrating and working with APIs to enhance application functionality. c) Microservices: Skilled in developing and integrating microservices for scalable and efficient solutions. d) Database Management: Competent in managing databases with Postgresql, MySQL, MongoDB, and Oracle. d) Server Handling: Adept at handling server environments such as AWS, Google Cloud, VPS, Apache, and Nginx. Let’s discuss how I can help achieve your project goals and add value. Lets connect in chat so that We discuss further. With Regards, Sai
$15 AUD in 1 day
7.5
7.5

Hi, This is a great use case for a structured, production-ready scraping pipeline, and I can build it to deliver clean, Shopify-ready data with strong deduplication. My approach: • Scraping: Python (Scrapy + Playwright/Selenium for dynamic sites) • Data capture: product name, variants, price (incl. subscription tiers), kit config, shipping policy, images, packet size • Deduplication: normalized product matching (name + attributes + fuzzy logic) to merge duplicates and track source per field • Output: Shopify-ready CSV (fully mapped columns, ready to import without edits) What you’ll get: • Clean CSV with unique products + source attribution • Scraper code + reusable pipeline • Config file to easily add/update target websites • Readme with run steps and maintenance guide I’ll make sure the data is accurate, deduplicated, and ready to use immediately. Thanks.
$20 AUD in 7 days
7.6
7.6

I'm Mahesh Kumar, and I've got extensive experience in web development and data scraping using Python. With over 11 years of experience, I can confidently assure you that I'm well-equipped to handle your project on creating a web scraper to scrape product details from Australian e-commerce websites. I'm fluent in multiple web scraping frameworks like Scrapy, BeautifulSoup, and Selenium, allowing me to implement the best solution according to your needs. What sets us apart is our commitment not just to deliver your required assets accurately, but also equipping you fully for independently maintaining and updating them. We'll provide you with the documented code/workflow so you can easily rerun it yourself whenever prices change. Additionally, we'll include a brief read-me explaining how to update the regional site list or add new sources should you require further expansion or customization in the future. Choose us for proficient and hassle-free execution of your project.
$20 AUD in 1 day
6.4
6.4

Hi, I understand your requirement for a robust web-scraping setup to gather essential product details from Australian e-commerce sites. I have 3+ years of experience in web scraping using Python, BeautifulSoup, and Scrapy, delivering reliable and easy-to-manage solutions. For your project, I will create a comprehensive scraper that consolidates product data such as name, price, kit configuration, and shipping policies while ensuring proper deduplication and accurate sourcing from multiple sites. One suggestion is implementing a logging mechanism to track data sources automatically. I’ve worked on similar scraping projects where clients achieved seamless data importing and significant time savings in maintaining their databases. I can complete this initial setup within 7 days. Best regards,
$25 AUD in 1 day
5.9
5.9

Hello Dear! Greetings from Toriqul Global Solutions! We are pleased to introduce our company as a reliable and experienced provider of Web Design & Development services. Founded and led by Engineer Toriqul Islam, a B.Sc. graduate in Computer Science & Engineering from Rajshahi University of Engineering & Technology (RUET), our team brings over 10 years of industry experience. At Toriqul Global Solutions, we specialize in building modern, user-friendly, and high-performance websites that help businesses grow and stand out in the digital world. Our design approach focuses on simplicity, elegance, and functionality to ensure maximum user engagement. Technologies We Use: Custom Websites Development Using ======>Full Stack Development. 1. HTML5 2. CSS3 3. Bootstrap4 4. jQuery 5. JavaScript 6. Angular JS 7. React JS 8. Node JS 9. WordPress 10. PHP 11. Ruby on Rails 12. MYSQL 13. Laravel 14. .Net 15. CodeIgniter 16. React Native 17. SQL / MySQL 18. Mobile app development 19. Python 20. MongoDB We would be honored to discuss your project requirements and help bring your ideas to life. Thank you for your time and consideration. Warm Regards, Toriqul Global Solutions
$30 AUD in 2 days
5.7
5.7

Hello there, we are a team of Full Stack Senior Web Developers. We will develop a clean responsive excellent user friendly robust application. Please, send me a message to discuss the work. Thanks Ashish Kumar.
$120 AUD in 7 days
5.5
5.5

Hey, Building multi-site scrapers that output clean, import-ready CSVs is exactly what I do — I've shipped similar pipelines for retail and real estate data across AU/UK/US sites, including deduplication logic and structured output for downstream platforms. For your project specifically: - I'd use Python + Playwright (handles JS-heavy Aussie retail sites better than BS4 alone) with rotating proxies to avoid blocks - Deduplication runs on product name + SKU/barcode similarity — merged records will show a source_sites column listing every URL the data came from - Output maps directly to Shopify's required columns: Title, Vendor, Price, Compare At Price, Images, Variant fields for kit configs/sizes, plus custom metafields for shipping policy and membership pricing - Packet size and image URLs captured per variant, not just per product - README included — adding a new source site is a one-line config change One thing worth clarifying before I start: 1. Do you have a target product category or a seed list of sites, or should I identify the major AU retailers in your niche? 2. Are the sites mostly static or heavily JS-rendered (e.g., Shopify storefronts, WooCommerce)? Can deliver working scraper + initial full pull + documented code within 5–7 days. Happy to show past scraper work as reference. — Muhammad Muneeb
$20 AUD in 2 days
5.4
5.4

Hi, I can build a reliable scraping workflow that collects product name, price, kit configuration, shipping policy/cost, membership pricing, packet size, images, and exact variant names from Australian e-commerce, retailer, and manufacturer sites, then outputs a clean Shopify-ready CSV. I’ll make the scraper in Python using BeautifulSoup/Selenium depending on each site’s structure, run the first full pull, and add duplicate detection so the same product from multiple stores is merged into one record while still showing the source site for each data point. A small improvement I’d include: I’ll normalize product names, sizes, and variants before matching duplicates, so “500g pack”, “500 g”, and similar listings don’t become separate Shopify products by mistake. You’ll receive: Shopify-formatted CSV ready to import documented scraping code/workflow README showing how to update or add regional sources I’m ready to start and can keep the setup simple so you can rerun it whenever prices change. Md. Shahadat Hossain
$30 AUD in 1 day
5.0
5.0

Hello Dear! Good Day! Hope you are doing fine. This is Ruhul Ajom Sagor. I am an expert "Web Developer" with 10+ years of working experience in PHP, HTML5, CSS3, JavaScript, jQuery, Bootstrap, MySql and different Frameworks. I have completed my B.S.C Engineering in Computer Science and Engineering (CSE) from BUET. Hire me and you don't have to worry about your website problems again! I'll add value to your projects by creating astonishing designs and code with high impact and optimized user interaction that leads to bigger conversions. WHAT PROBLEMS CAN I HELP YOU SOLVE? • Custom Websites Using PHP and Frameworks • e-Commerce Websites (Woo-Commerce and Shopify) • Custom WordPress themes • On-Page and Off-Page SEO • WordPress themes Customization • Database Modeling/Development • WordPress migrations and upgrades • Responsive Coding (Make your website compatible with: smartphones, tablets, desktops) • Websites speed and loading time improvements • Cross-browser compatibility • PSD to HTML to WordPress conversion • HTML5/CSS3/jQuery websites based on Bootstrap I love challenges, talking to my clients, and meeting others’ standards as well as expectations. I will be discussing everything in detail, giving my full advice and delivering through best of my skills. You are cordially welcome to discuss your project. Thank You! Best Regards, Ruhul Ajom
$20 AUD in 2 days
4.9
4.9

Hi, I am Puja Rani. I have read your proposal completely. I have experience in this kind of work I am ready to start working. I am confident that I can handle it easily. If you are interested, please message me and we can discuss further
$30 AUD in 1 day
4.2
4.2

Hi, I’ve reviewed your project and can help you get it done quickly and accurately. I’m Sarim Ali Khan, a top-rated freelancer specializing in data automation, analysis, and workflow optimization. My clients hire me because I deliver on time, on budget, and with zero guesswork. I can start right away and share a quick sample if you’d like. Let’s chat about the details and get you results — fast. Best, Sarim
$30 AUD in 1 day
4.2
4.2

This is squarely in my wheelhouse. I've built multi-site Australian product scrapers before, Shopify CSV delivery included, and I know the exact column mapping Shopify expects so your file imports cleanly first try with no reformatting. Here is what I will build for you. A Scrapy or Playwright based pipeline depending on what each target site requires, with BeautifulSoup parsing for static pages and browser automation for anything JavaScript rendered. Every product record will capture name, price, kit configuration, packet size, shipping cost or policy, membership pricing where displayed, image URLs and all variant names exactly as listed on the source. Duplicates get merged into a single canonical row with a source attribution column showing which site each data point came from so you can verify everything at a glance. Deliverables are the Shopify ready CSV, fully documented Python code you can rerun yourself when prices change, and a short readme explaining how to add new source URLs or swap out regional sites without touching the core logic. I do a sample pull from two or three of your target sites before you commit so you can confirm the output format matches what you need. No surprises on delivery. Ready to start today. Share your site list and I will get the first sample back to you within 24 hours.
$30 AUD in 1 day
3.8
3.8

I will build a reliable web-scraping setup to gather product details from Australian e-commerce websites, capturing product name, price, kit configuration, and shipping cost, and deliver a clean CSV file formatted for Shopify, with documented Python code using Scrapy, BeautifulSoup, or Selenium, to ensure accuracy and deduplication, providing a brief read-me for future updates, and a stable solution for importing product data into Shopify.
$10 AUD in 7 days
4.3
4.3

Hello, I checked your project "Competitor Product Scraping Database" and I already have a clear idea how to deliver this efficiently. I have solid experience in JavaScript, Python, Data Processing, Web Scraping, Amazon Web Services, Shopify, Scrapy, Data Extraction, BeautifulSoup, Selenium, and I’ve worked on similar projects where I delivered high-quality, scalable, and clean solutions. Why choose me? • Strong expertise in JavaScript, Python, Data Processing, Web Scraping, Amazon Web Services, Shopify, Scrapy, Data Extraction, BeautifulSoup, Selenium • Clean, optimized, and scalable code • Fast communication and daily updates • 100% focus on delivering results, not just code If needed, I can also suggest improvements to make your project even better. Let’s connect I’m ready to start right away. Best regards, Umer
$19 AUD in 1 day
3.4
3.4

Hi, I can build a reliable web-scraping system for Australian e-commerce sites with strong accuracy and duplicate detection. It will extract all required product data and generate a clean, Shopify ready CSV along with reusable code. You’ll also get a simple guide to rerun and update sources whenever needed. Thanks Mehadi
$25 AUD in 3 days
3.4
3.4

Hi, I can build a reliable scraping pipeline that collects product data from multiple Australian sites and outputs a clean, Shopify-ready CSV. I’ll handle deduplication (merging same products across sources) and include fields like price, variants, shipping, membership pricing, packet size, and images with clear source attribution. I typically use Python (Scrapy/BeautifulSoup + Selenium where needed) and structure the output to match Shopify import format exactly. You’ll also get reusable code + a simple README to update sources and rerun
$20 AUD in 3 days
3.4
3.4

As a senior full-stack developer with over 9 years of experience and a mastery of Javascript and Python, I have the technical skills required to build a reliable web-scraping setup for your project. I understand the criticality of accuracy and deduplication for your data consolidation task, and I guarantee that my solution will meet your high-standards. In past projects, I've successfully developed intricate data processing systems that effectively merge records and eliminate duplicates without any loss of information. Moreover, my proficiency in Python will ensure your scraper's efficiency and ability to adapt to changing prices with minimal effort or tweaking on your end. The project's deliverables - a clean CSV in a format exactly as per Shopify's requirements, documented code, and instructions for updating regional site lists will be provided promptly and comprehensively. Finally, my broad range of skills in both independent and collaborative projects also means that you can count on me to not only handle the scraping aspect meticulously but also integrate the compiled data smoothly with Shopify. With me at the helm of this assignment, you can rest assured that not only would you get the output you need, but it would be done efficiently using the best technology available. Let's efficiently scrape, merge, consolidate these Australian e-commerce sites so you can focus on growing your business!
$20 AUD in 7 days
3.1
3.1

Hi there, I specialize in building structured competitor product databases from publicly available website information. I focus on accurate data collection, clean organization, and scalable formatting so product details such as names, categories, specifications, pricing, and availability are easy to analyze and compare. Whether you need the data in Excel, CSV, Google Sheets, or a database-ready format, I ensure the final dataset is organized, consistent, and practical for market research and competitive analysis. Let’s build a clean competitor product database that gives you useful insights and saves research time. Best regards, Waleed Saleem
$15 AUD in 1 day
2.1
2.1

Hello, I have experience with web scraping and data consolidation for e-commerce platforms, focusing on capturing detailed product attributes and merging data effectively. I can build a reliable scraper that gathers product names, prices, kit configurations, shipping details, and membership pricing from various Australian sites, ensuring duplicates are recognized and merged clearly. For implementation, I would utilize a method that processes data in stages, first capturing raw details, followed by cleansing and formatting it into a Shopify-compliant CSV. Let's discuss!
$30 AUD in 1 day
2.3
2.3

Hi there, This project immediately caught my attention as it aligns closely with my experience in web scraping and data engineering pipelines. I specialize in building reliable scraping systems using Python (BeautifulSoup, Scrapy, Selenium), with a strong focus on data accuracy, deduplication, and scalable database-ready outputs. On a recent similar project I worked on a competitor data extraction system where I collected structured product data from multiple e-commerce sources, normalized inconsistent product formats, removed duplicates, and stored everything into a clean database-ready dataset for analysis and reporting. The key focus was making the scraper resilient to layout changes and ensuring clean, consistent outputs. For your engagement I will design and implement a robust scraping system that collects competitor product data, including names, prices, variants, shipping details, and other relevant attributes. I will also build deduplication logic to merge identical products across different websites and deliver a clean structured database/CSV output ready for analysis or import. I am comfortable to communicate in Portuguese, English, and Spanish. I look forward to working with you. Best regards, Sostenes Apollo
$20 AUD in 7 days
2.0
2.0

Sydney, Australia
Payment method verified
Member since Nov 25, 2024
$20 AUD
$10 AUD
$10-30 AUD
$10-30 AUD
$30 AUD
$30-250 USD
₹100-400 INR / hour
$30-250 USD
₹12500-37500 INR
$250-750 USD
$30-250 USD
₹12500-37500 INR
$10-50 USD
₹37500-75000 INR
$30-250 USD
$30-250 CAD
$30-250 USD
$25-50 AUD / hour
₹600-666 INR
$10-50 USD
$250-750 USD
$250-750 USD
₹600-1500 INR
$30-250 SGD
$250-750 USD