Scraping data directoryJobs

I am looking for an experienced freelancer capable of creating a simple web scraping tool, able to extract text content, images, and links from a specific url (you just need to do one single url and I take it from there). The extracted information should be in a python dictionary and saved to pkl Skills: - Experience in web scraping - Proficient in handling js and automation This is a very simple project for the right individual. I need all the visible info and images (no maps) plus the info in the JS that must be reached by clicking a button. This is a couple of hours of work max, and needs to be done in Python and for today. I will provide the URL when I make sure you can handle the job. Thanks

I am seeking to acquire a comprehensive list of 10,000 fake domains associated specifically Saudi Arabia with phishing scams. This list will primarily serve the purpose of security testing. The focus of this task will be on the accumulation of domains, with no requirement for a detailed description of each domain's potential threat level. The ideal freelancer for this job ...domains associated specifically Saudi Arabia with phishing scams. This list will primarily serve the purpose of security testing. The focus of this task will be on the accumulation of domains, with no requirement for a detailed description of each domain's potential threat level. The ideal freelancer for this job would have a strong background in cyber security and a profound understanding of Web Scraping...

I require a professional web scraper to collect both text (data points) and images from a long list of web pages about hotels and destinations. - The project involves saving the actual images of destinations/hotels —not just their URLs—from every webpage. - As for the text content, I'm particularly interested in several points - The extracted data and saved images should be meticulously organized in an Excel sheet for easy review and reference. Ideally, I'm seeking someone with an extensive background in web scraping and data extraction. Being proficient in Excel would be a significant plus. Accuracy, attention to details, and reliability are also crucial traits for this task.

I'm in need of a Python developer with specific skills in web scraping. The main task for this project is to fix bugs in existing web scraping scripts. Your role will be to primarily focus on this aspect, ensuring the scraping process runs smoothly, and is optimized for efficiency. If you perform well in this project, it will be a long term business opportunity. I have lots of projects in mind which need to start after this. New freelancers are welcome to bid.

...scraper to gather data from specific fashion retailers. You will scrape the data for a period of about 12 weeks. Starting mid June. We would target the 10 following fashion retailers: Guess, Tommy Hilfiger, Levis, GAP, Calvin Klein, Ralph Lauren, Desigual, Mango, River Island, Pepe Jeans. The data required is - Item characteristics (like audience [male/female/kids] and item type [pants/shorts/tshirt/shirt/...]) - Price points over time (and corresponding discounts) - Out-of-stock data over time (per item, not by size) The collected data should specifically focus on their clothing items (no accessories, shoes, underwear, home wear, gifts,...). The project start deadline is ASAP. A quick turnaround is essential. Ideal Skills and Experience: - Pro...

I need a Python expert to scrape tabular data from a series of PDFs and store it in a database. Ideal Skills and Experience: - Proficiency in Python. - Strong experience in web scraping with PDFs. - Familiarity with database management. The PDFs are consistent in format and all contain tables. The scraped data needs to be stored in a database.

...meticulously extract table data from approximately 7500 pages of PDF files and transfer the data to Excel. The PDF tables are consistent across all pages, maintaining a fixed column structure which you need to duplicate in the Excel spreadsheets. The data you will be working with is primarily text-based as opposed to numerical. Necessary Skills and Experience: - Excellent attention to detail - Proficiency in optical character recognition (OCR) processing - Experience with data scraping or extraction - Valuable skills in MS Excel - Familiarity or experience with PDF data extraction software Swift and accurate execution is essential for the successful completion of this project. Please only apply if you are comfortable handling a high volume of...

...Pakistan, Bangladesh, India, etc. I need a freelancer from LATIN AMERICA only. I need close to EST time!! Furthermore, I need a BILINGUAL freelancer!! So READ before biding. I need a fully bilingual professional (I will interview in English via video) to do some tasks for my agency, such as: PR Outreach Social media Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress (change text, add a button, upload a file, etc) And others related to the position You must be a FAST learner, attentive to details, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes over and over. Attention to detail. Common sense. T...

they closed it? collect information from a directory for our event, which lists approximately 2590 partners. The information must be obtained from subpages 1. Logo (embedded in excel and folder) 2. Company Name 3. Stand number/code 4. "Why Visit Our Stand" Section 5. Brands 6. Description 7. Company Activity 8. categories 9. Regions 10. Gallery (embedded in excel and folder) 11. Follow us section (social media links) 12. Website 13. Email(s) 14. Company Address 15. Company phone number

they closed!! collect information from a directory for our event, which lists approximately 2590 partners. The information must be obtained from subpages 1. Logo (embedded in excel and folder) 2. Company Name 3. Stand number/code 4. "Why Visit Our Stand" Section 5. Brands 6. Description 7. Company Activity 8. categories 9. Regions 10. Gallery (embedded in excel and folder) 11. Follow us section (social media links) 12. Website 13. Email(s) 14. Company Address 15. Company phone number

...database software to authenticate users with local Active Directory (AD) credentials. Key Requirements: - Authentication: Set up the database to authenticate users with their local AD credentials. This is crucial for security and access control. - Seamless Integration: Ensure that the connection between the database and the AD server is seamless and reliable. - User Management: The system should allow for easy management of user privileges, ensuring that the right people have the right levels of access. Ideal Skills and Experience: - Experience with Postgres: You should have a strong background in working with Postgres, particularly in a configuration and security context. - AD Integration: A deep understanding of Active Directory and how to integrate it with other s...

...ideal candidate must be skilled in web scraping and should reverse engineer API from mobile app because lazada blocks and throws captcha on web website is lazada . The script should work like i enter something in search box and it should scrape all the products from that search query Key Responsibilities: - Extract the following information: product names, prices, descriptions, stock, images, seller information, and product URLs. This list encapsulates the attributes you need to pay the most attention to. - Organizing the scraped data: The data, once scraped, must be organized in a well-structured CSV file. Ideal Skills: - Strong experience with Python. - Proficiency in web scraping tools. - Attention to detail to ensure all the mentioned data ...

...Pakistan, Bangladesh, India, etc. I need a freelancer from LATIN AMERICA only. I need close to EST time!! Furthermore, I need a BILINGUAL freelancer!! So READ before biding. I need a fully bilingual professional (I will interview in English via video) to do some tasks for my agency, such as: PR Outreach Social media Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress (change text, add a button, upload a file, etc) And others related to the position You must be a FAST learner, attentive to details, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes over and over. Attention to detail. Common sense. T...

Hi there, We are looking for someone who is: - Proficient in Python. - Experienced in automation and data scraping. Our budget is $3/hr for 20 hours on the initial project. This is a one-off task for now but could be ongoing work if successful. Please message with your CV/portfolio if interested

...au, , , , Facebook Market Place) and display the results in one convenient place. Key functionalities should include: - Advanced filtering options - Price range filtering - Location-based search Ideal expertise would entail experience in advanced web scraping and designing search algorithms, along with a deep understanding of diverse automobile databases and SEO. The candidate should be capable of verifying and testing the accuracy of the collected data as well. Efficiency in coding with an ability to manage site speed and response time is crucial, especially considering the breadth of services it will be searching. The final product should be a user-friendly platform that effectively and accurately condenses numerous individual searches into

I need a skilled Bot Developer to create a multi-language web bot for me. - Tasks: The bot will mainly be responsible for web tasks like form filling, data scraping, and possibly social media automation. Unlike some bots, it won't interact with APIs or integrate with other web services. - Programming Languages: This is a multi-language project. I am open to using Python, JavaScript or PHP depending on what you think is best for this task. I need someone who is experienced in bot development and can create a reliable and efficient bot that performs these tasks seamlessly. Please have a look at the choices of programming languages I'm considering and let me know which one you think would best suit the goals of this project.

I need help fetching influencer data from Instagram, YouTube, and TikTok. There are other platforms, and the influencers required here are trading influencers. 1 - Those who sell trading indicators. 2 - Who have special channels for trading.. 3 - Who have bots for automated trading Basic skills and experience required: - Deep understanding of Instagram, YouTube and TikTok – Experience in data mining or web scraping - Good at analyzing data - Flexible and adaptable working approach I will attach a file I created as an example of the requirements I want. If you see yourself as suitable for this job, create an example of the same file sent to you, but with different information, and send it to me

I need the names, addresses, and contact information from a specific web map extracted. The purpose of this project is to create a directory of locations from this data, and the information will need to be updated annually. The ideal freelancer for this job will have experience in web scraping and data extraction. Key requirements: - Web scraping experience - Proficient in data extraction techniques - Understanding of directory creation - Reliable and professional with an eye for detail.

I'm looking for a Python expert to help me build a simple yet effective project. I need a program that can scan barcodes of grocery items and then provide me with detailed information about these products. This information should include protein, calories, added sugar, and any other relevant nutritional facts. Key r...sugar, and any other relevant nutritional facts. Key requirements: - The ability to scan barcodes effectively and quickly - Retrieving information about the scanned products from an online source - Displaying this information in an organized and easy to understand manner Ideal skills and experience: - Proficiency in Python - Experience in working with barcode scanning - Familiarity with web scraping for nutritional information - Ability to create a user-fri...

I am looking to develop a WordPress website dedicated to providing comprehensive information about various tools. Here's a brief overview of my requirements and expectations: - **Purpose:** The primary goal of this platform is to serve as an informative hub, offering data on a wide range of tools. Users should be able to explore and understand different tools, their uses, and possibly their pros and cons, aiding them in making informed decisions. - **Tool Organization:** The tools featured on the site should be organized by categories. For instance, categories could include carpentry, gardening, automotive, and so on. The categorization should be intuitive and easy to navigate for users. **Requirements:** - **WordPress Expertise:** As the website will be built on the WordPre...

I need a program that can scrape for the addresses of homes listed and compile them into a CSV file....com for home addresses - Compile addresses in CSV format - Include the duration each house has been listed - Run the program every hour to capture new listings - Automatically eliminate any duplicate entrie - Run CSV file against another data base that has age and name of owner and contact info. Ideal Skills and Experience: - Experience in web scraping and data extraction - Proficiency in programming languages suitable for web scraping (e.g. Python, Scrapy) - Knowledge of CSV file creation and data handling - Ability to automate processes for regular data updates Please note that the addresses should be stored in the CSV file with each one on ...

I am in need of a proficient and experienced Windows Server and Active Directory expert who can assist with troubleshooting (also by CLI commands). My system is fully set up, but I am currently encountering some server errors that need to be addressed. Key responsibilities will include: - Diagnosing and repairing server errors. - Enhancing command line management. - Help in effective Server and Active Directory configuration. The ideal candidate would have extensive experience with Windows Server, Active Directory and knowledge on CLI commands to swiftly identify and rectify any errors. Your goal is to improve the overall health and performance of my existing setup. Errors like failed test DFSREvent",and replication faults

I'm looking for a skilled web scraper to handle challenging websites with advanced detection. The main data you will be required to scrape is text content. Here are the key project details: Ideal candidate should have: - Experience in web scraping, especially from challenging sites - Strong knowledge of web scraping tools and techniques - Proficiency in handling advanced automation detection - Excellent attention to detail to maintain a high level of data accuracy - Ability to deliver monthly updates in a timely manner Please include any relevant past experiences or examples of similar projects in your bid.

I have a need to have the ability for a user to send an image to a specific email address, and that image would be rendered on a webpage with a masonry style layout. Workflow as follows: 1.) User sends email to a specific email address which includes image 2.) that image would be transacted to a directory on the server 3.) a page would render all images found in the directory in a masory-grid layout

Hey folks, I have a franchise directory website, built with Premiumpress theme, child theme activated, and Elementor used. It's based on a PremiumPress child theme () but has been heavily customised with a custom plugin controlling large parts of it. Currently, at the moment, all the Categories (both Parent and Child) are listed in alphabetical order. Please can the categories be displayed with Child Categories immediately underneath the Parent category, like is it on this page: I understand you can achieve this by creating a custom Elementor widget or as a shortcode

I am experiencing issues with Active Directory 2016 replication in a topology that includes 10-50 domain controllers. The tasks that need to be performed include: - Diagnosing current replication problems. - Providing solutions to rectify replication issues. - Implementing troubleshooting practices to avoid future issues. The ideal freelancer for this task will have expert knowledge and experience in Microsoft Active Directory, specifically the 2016 version, and a deep understanding of domain controller topologies. They will be proficient in diagnosing and fixing replication issues and optimizing directory performance. A solid background in IT system administration is also essential for this job.

I'm in need of a proficient data entry specialist to assist with a substantial volume of data entry work. This is a very basic task, a lead scraping website doesn't allow me to export data. So we will copy and paste from one website to a google sheet. There are 2,241 entries needed This project will take ~20 hours I am attaching a screenshot of the picture of the website and of the spreadsheet

I require a specialized robot capable of locating and compiling available citations from business websites. As a fundamental part of this project, I ...specialized robot capable of locating and compiling available citations from business websites. As a fundamental part of this project, I am looking for: - Proficiency in handling and extracting data from different business sources, specifically focusing on citations. - Advanced skills in programming and web scraping to efficiently channel through high amounts of data. - Understand the "citation" within the context of a business website as a direct link to the company's website. The ideal candidate would be someone with vast experience in data mining, web scraping, and programming. Previou...

I'm in need of a web scraping wizard who can help me extract text data and profiles from Twitter website. Key Requirements: - The ability to scrape text data and profile information efficiently and accurately. - Experience in web scraping, with a strong portfolio showcasing past work in similar projects. - The time for scraping a post and profile must be less 3 seconds without using Twitter API. The final deliverable should be in a format that's easy for me to analyze, but I'm flexible on whether it's a CSV file, Excel spreadsheet or a database format. Please describe your past work examples with your application. Write "Blue" on the head of your bid if you are not a bot.

I'm about to get daily PDF forms and need them automatically dumped into a Google Sheets document. The project involves: - Extracting data from incoming PDFs and inputting them into corresponding fields on Google Sheets. - Ensuring that each form submission creates a new row in the Google Sheets document. It's essential that: - The data is accurately extracted with no errors. - The system can handle a normal volume of PDF submissions (no more than 150) Ideal qualifications: - Proficient in web scraping and data entry. - Experienced in working with Google Sheets and PDF manipulation. - Ability to create an automated system for seamless data transfer.

I'm in need of a professional who can develop a scraping tool that will track market announcements and releases on a financial website using specific keywords. - The tool should scrape this data on a daily basis. Accuracy and reliability are key. - the scraped data should be filtered for the current date, daily. - I need this table of data to be automatically filtered for keywords. -the filtered results to be emailed automatically to an email list. - the tool to run automatically on a website or server. I'm looking for someone who has a proven track record in web scraping with a focus on financial data. Experience in creating automated scraping tools, particularly those that operate on a daily basis, is a huge plus.

I'm looking to scrape a website using the python package requests. 1) create a session because the site requires a username and pwd login 2) pass an initial URL that will get pagination of results 3) from the results we'll get the URL of the individual person/page we need to get info from 4) we'll make a request call within the session to the persons URL 5) Then we'll parse the HTML from the persons page 6) Then, we'll put the information into a dictionary object and append it to the a list 7) Finally we'll then print out the list of JSON objects to a text file

...who is proficient in data analysis, visualization, and data science to work on an array of data types including financial, customer, social media, and pharma data. Key Tasks: - Data Analysis and Visualization: You will be given various sets of data which you will need to efficiently analyze and create meaningful visualizations. - Web Scraping and Automation: Knowledge in this area is desirable but not necessary. - Django Web Development: Again, not a necessity but would be considered a bonus. Objectives: - Efficiency Improvement: Assist in identifying areas of operational efficiency and suggest or implement changes accordingly. - Cost-Saving Opportunities: Use the analyzed data to identify potential areas for reducing costs. - D...

I'm seeking a professional programmer to help me create an effect...viral the tweet is considered to be. - It should be able to scrape and analyze tweets from the past week. - The bot should be capable of differentiating between tweets based on their views to followers ratio and identify the 'most viral' one. Ideal Skills & Experience: - Proficient in creating Twitter bots. - Strong understanding of Twitter API and scraping tools. - Familiarity with tweet analytics and calculations. - Ability to extract and process data efficiently. The end goal of this project is to have a functional tool that can accurately pinpoint the most viral tweet of the week. It is essential that the developer is skilled at creating algorithms that can measure and compare the �...

I need a web scraping expert to scrape Title, Price, star ratings, delivery window from a specific e-commerce site on a regular basis. - The scraping should cover a range of products, ideally with the ability to specify categories for tracking. - The data needs to be scraped frequently, so automation and scheduling will be crucial. - It's important that the extracted data is accurate and up-to-date as this will be used to inform pricing strategies and customer service. The ideal freelancer for this project should have: - Proficient experience in web scraping, particularly from E-commerce sites. - Proficiency in programming languages like Python or R for automation. - Good understanding of data management and quality control. - Ability to del...

...a skilled Python developer proficient in Selenium or other scraping tools, AI and others API integration. The main tasks in this project include: - Integrating APIs: You'll be responsible for seamlessly integrating the following APIs: - Send/reveive data from trained AI - Collect data using scraping - Payment Gateway - Other websites: API to integrate with other websites - Developing B2B Features: We're looking to expand our platform to cater for B2B transactions. Your role will be to create and incorporate features that facilitate B2B interactions. Key skills and experience required: - Proficient in Python - Experienced with Selenium or other scraping tools - Proven track record with API integration - exchange data w...

I'm looking for a skilled professional to create an API that scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The data should be delivered in JSON format. Ideal freelancer: - Proficient in web scraping - Experienced in API development - Familiarity with or similar e-commerce websites is a plus - Ability to deliver high-quality and clean JSON data - Reliable and able to meet daily scraping requirements.

I'm looking for a skilled professional to create an API that scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The data should be delivered in JSON format. Ideal freelancer: - Proficient in web scraping - Experienced in API development - Familiarity with or similar e-commerce websites is a plus - Ability to deliver high-quality and clean JSON data - Reliable and able to meet daily scraping requirements.

Our SaaS site () is getting a bit old. We need an experienced designer/front-end developer to completely freshen it up,We operate in the Web Scraping industry and would like our new site to stands out w.r.t. competition. We want a site that's easy on the eyes and presents our product offering better than how it is currently presented. Requirements =========== . New home page should have a section for testimonials/clients and a section for awards/review badges. . Each product (currently scrape and extract) have their dedicated page. Their illustrations need to be redone and the scrape page should have some icons/illustrations on top of each "Applications" box. . We need a new nav menu item for "Resources". The site footer section will also host new section...

...in web scraping, especially from websites, social media platforms such as LinkedIn, publications, and news sites. This will help in gathering relevant data for building a recommendation system. Key requirements include: - Proficiency in data scraping from multiple sources - Ability to effectively scrape data from websites, social media platforms like LinkedIn, and news sites - Experience with handling and storing data in a database - Understanding of how to structure and manage data for machine learning purposes Your task will be to gather the data and store it in a database for further analysis. Having a solid background in data handling, artificial intelligence, and machine learning will be a great advantage. Th...

I'm granting the opportunity to conduct an educational market research in UAE for my school directory platform. Overview: Our startup operates a school directory platform specifically designed to assist UAE families in finding and comparing schooling options for their children. We are committed to providing innovative solutions that help parents navigate the complex educational landscape with ease. To enhance our platform's effectiveness and ensure it meets the diverse needs of all families, comprehensive market research is crucial. This research will help us gain detailed insights into our target audience, the broader industry landscape, and our competitive positioning. Scope of Work: Market Statistics: • Collect up-to-date statistics on the UAE education s...

I'm granting the opportunity to conduct an educational market research in UAE for my school directory platform. Overview: Our startup operates a school directory platform specifically designed to assist UAE families in finding and comparing schooling options for their children. We are committed to providing innovative solutions that help parents navigate the complex educational landscape with ease. To enhance our platform's effectiveness and ensure it meets the diverse needs of all families, comprehensive market research is crucial. This research will help us gain detailed insights into our target audience, the broader industry landscape, and our competitive positioning. Scope of Work: Market Statistics: • Collect up-to-date statistics on the UAE education s...

I'm seeking a Python developer who's proficient in web scraping to help me extract data from social media platforms. Key Responsibilities: - Develop and implement a Python script for web scraping data from social media channels. Deliverable: - The scraped data should be compiled and delivered in an Excel spreadsheet for further analysis. Ideal Candidate: - Proficient in Python with a strong background in web scraping techniques. - Prior experience in scraping data from social media platforms will be a big plus. - Ability to deliver the end results in an organized, neat and easily accessible format, such as an Excel spreadsheet. Please reach out if you think you're the right fit with the necessary expertise.

I'd like to extract the phone numbers of real estate agents from a particular website Key Requirements: - Extract agent contact information Ideal Skills and Experience: - Proficiency in web scraping - Experience with data extraction and automation - Strong understanding of data privacy laws and regulations Please note that the data is intended for internal use only and will not be shared with any third-parties.

I need a talented web designer with expertise in APIs, data scraping, and AI to help me build a professional portfolio website. - Design: The designer needs to create an engaging and visually appealing layout for the website, considering it's targeted at professionals. - Integration: I require the integration of API functionalities into the website. - Data Scraping: The designer should implement data scraping. - AI /ML Features: The website will also need AI-based features. The primary goal of the website is to serve as a showcase for my work. It’s important that the design is not only aesthetic but also functional, user-friendly, and professional. I am looking for someone who can bring a high level of creativity, technical skill, a...

I am in need of a skilled developer who can create a functional scraping tool for me. The purpose of this tool is to download JPEG product images from a specified URL that increments numerically. Key Requirements: - Scrape images from a continuously changing URL (i.e., www.****/asdasd/1234 then 1235, and so on). - Ability to tweak URL structure according to my needs. - Images must be saved in JPEG format. The ideal candidate for this task: - Has experience in web scraping and dealing with dynamic URLs. - Understands how to name files after the URL page number. Please note that the key goal is to download product images, not data extraction or process automation. Hence, your proposal should focus on delivering this specific requirement. Your understanding of this ...

I'm seeking an experienced software developer to execute Single Sign-On (SSO) integration between Microsoft Active Directory and Office 365. Key responsibilities: - Implement and configure SSO - Ensure secure and seamless connection between Microsoft Active Directory and Office 365 Ideal candidate: - Extensive experience in SSO integration - Strong expertise in Microsoft Active Directory and Office 365 - Prior work in ensuring secure integrations and solving related issues. The aim is to provide users with a secure, efficient, and seamless experience. Your ability to deliver this on-time without compromising on security or performance will be the defining measure of success.

I am seeking a proficient Python programmer who can create a web scraper for Lazada. Key Responsibilities Include: - Develop a Python program that will enter query in search box and scrape Lazada for the following data: product name, images, price, description, seller, and URL. - The scraper should be able to handle pagination plus also bypass captcha using 2captcha api Ideal Skills and Experience: - Proficiency in Python and web scraping frameworks. - Familiarity with the Lazada's web structure and data extraction. - Experience creating scrapers for e-commerce platforms. Website lazada .

...Pakistan, Bangladesh, India, etc. I need a freelancer from LATIN AMERICA only. I need close to EST time!! Furthermore, I need a BILINGUAL freelancer!! So READ before biding. I need a fully bilingual professional (I will interview in English via video) to do some tasks for my agency, such as: PR Outreach Social media Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress (change text, add a button, upload a file, etc) And others related to the position You must be a FAST learner, attentive to details, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes over and over. Attention to detail. Common sense. T...

I'm looking to build a custom scraper for DeFi exchanges....exchanges. The main features I'm interested in are: - Historical data analysis: This is crucial for me to make well-informed decisions about the market trends. - Real-time data updates: Although not explicitly stated in the questions, the bot will need to be able to update data in real-time. This will help me stay ahead of the market. I currently prefer the output in CSV format, as it is easy and widely used. Given the nature of the DeFi space, experience in cryptocurrency scraping bots is a must. It would be ideal to have experience with DeFi exchanges particularly. This project will require strong skills in programming languages such as Python, R, or JavaScript, as well as ...