Web scraping seleniumJobs
This is an ongoing project and most likely it will turn into a long term business relationship if things play out accordingly. MUST have: Python Selenium/Scrapy Django/Flask HTML/CSS/Boostrap JS MySQL, Postgres, Sqlite Redis, mongodb AWS, Heroku GIT + zenhub TDD, SOLID Nice to have: -React/Redux -CI, CD -Graphql -Elastic search Please show your past experience in your proposal PD: state what passions you about working as a freelancer in less than 10 words. all details will be provided to the few selected throu DM. Best Regards!!
...Processing and Data Scraping. The ideal freelancer for this job should have: - In-depth knowledge and skills in languages such as Python, Java, or C++ to efficiently build the bot - Expertise in Natural Language Processing and Data Scraping - Experience in building bots, particularly ones focused on task automation Although the bot is primarily for personal use, ensuring its compatibility across different platforms is fundamental. Therefore, any previous experience or knowledge in optimizing bots for varying platforms will be advantageous. We can discuss further the specifics of what platforms the bot should optimally function on as we move forward with the project. To sum up, I'm looking for a professional with robust coding skills, a deep understanding of NLP a...
I am looking for...calls for logging into to simulate human-like texting behavior to a specified phone number. Key requirements include: - Developing the scripts in Python - Enabling the scripts to be operable from the Windows command line - Incorporating Selenium for successful implementation Ideal skills would include: - Proficiency in Python - Experience with Windows Command Line operations - Familiarity with Selenium for web automation While Selenium is a mandatory requirement for this project, enriched hands-on experience with other web scraping libraries and tools will be a bonus. Your success in this project will be measured on the efficiency and accuracy of the automated operation, as well as the seamless and smooth running of scri...
I require an experienced professional who can create a comprehens...LinkedIn contacts for India-based Canvas Beach Bags. The main aim of this list is to be used for email marketing, so the contacts should be highly relevant and receptive. Key Requirements: - Deliver a list with a minimum of 1,000 entries. - Include the following details for each contact: - Name - Company - Email - Position - LinkedIn Profile Ideal Skills: - Proficiency in LinkedIn data scraping - Experience in email marketing - Attention to detail in data entry - Understanding of the Indian market and/or fashion industry would be a plus I am open to discussing how the emails of the contacts should be verified, and would like to work with someone who can ensure the highest quality of contacts for this...
I am seeking a proficient freelancer to transfer text content from various websites and compile them meticulously into a Word document. Key Responsibilities: - Navigate diverse websites to find specified text - Diligently copy and paste accurate information - Ensure the data is correctly formatted in the Wo...content from various websites and compile them meticulously into a Word document. Key Responsibilities: - Navigate diverse websites to find specified text - Diligently copy and paste accurate information - Ensure the data is correctly formatted in the Word document Important Skills: - Proficient in Microsoft Word - Strong attention to detail - Excellent web navigation - Quick and accurate typing skills Experience in data entry, web scraping or similar ta...
I am looking for a skilled Python programmer to assist with various tasks. Experience with data analysis and visualization, web scraping and automation, as well as Python application development would be preferred. The purpose of this project is not specified, so a versatile skill set is required. Proficiency in Python, Django, and Flask would be advantageous.
I require a savvy data scraping professional who can efficiently collect specified details from retail giants Amazon, eBay, and Walmart. I'm interested in: - Extracting product details (name, price, description) This activity should be performed daily. The ideal candidate would have experience in data scraping, particularly from the mentioned websites. Proficiency in appropriate tools and a keen attention to detail is expected to ensure high-quality, timely, and consistent data harvesting.
I'm looking to hire a highly skilled freelancer to help me with a data scraping project. The focus here is on website content, specifically, text elements. As the nature of text content was not specified, I anticipate a variety of text types which might include news articles, blog posts, product descriptions, among others. Ideal Candidate: - Experienced in Data Scraping projects, specifically with website content - Proficient in working with different types of text - Detail-oriented and accurate in collecting required information - Ability to handle tasks within given time frame Please ensure that you are equipped with appropriate data scraping tools and techniques, and able to adhere to legal guidelines for data collection. Your responsibility will be collecti...
...function to offer more refined search capabilities. - Scraping: I'm looking to add a data scraping capability to my service. This will involve extracting data from various websites and integrating it into my existing database. - AI Data Analysis: I'd like to incorporate AI data analysis functionality into my service. Specifically, I'm interested in pattern recognition and data clustering. Other Enhancements: - Batch Searching: I need to implement a batch search functionality. - Additional Database Integration: I'm interested in integrating new databases into my service. Ideal Skills and Experience: - Extensive experience in developing and improving online database searching services. - Proficiency in advanced search options, scraping, and AI ...
Monitor specific HTML div elements on various web pages. (differnt flows) -Send Telegram notifications when new elements or changes are found, including a subject to indicate which monitoring flow detected the change and a hyperlink to the relevant web page. -Explain the configuration of new monitoring flows, enabling addition of new web pages and specific HTML elements. Provide a list of required dependencies and setting up and configuring the flow, including telegram bot integration so I can install/config them on my Raspberry Pi.
I'm in need of a Python developer to assist me with web scraping. The data I'm after is sourced from APIs and once extracted, it needs to be stored in a CSV file. Key Requirements: - Proficiency in Python - Experience with web scraping - Knowledge of working with APIs - Ability to store scrapped data in a CSV file Ideal Skills: - Familiarity with popular Python libraries for web scraping, like Beautiful Soup or Scrapy - Understanding of API integration and usage - Strong data handling and manipulation skills It's a straightforward task that needs attention to detail and adherence to best practices in web scraping. If you have the right experience and are keen to assist, I look forward to hearing from you.
I am looking for an experienced freelancer capable of creating a simple web scraping tool, able to extract text content, images, and links from a specific url (you just need to do one single url and I take it from there). The extracted information should be in a python dictionary and saved to pkl Skills: - Experience in web scraping - Proficient in handling js and automation This is a very simple project for the right individual. I need all the visible info and images (no maps) plus the info in the JS that must be reached by clicking a button. This is a couple of hours of work max, and needs to be done in Python and for today. I will provide the URL when I make sure you can handle the job. Thanks
I'm seeking a skilled Selenium tester who can help me ensure the quality of my applications before deployment, which re written in both JavaScript and .NET. This is a niche project where you'll be integrating the test suite into Jenkins for a continuous integration pipeline. Key Responsibilities: - Create robust Selenium tests for my applications, utilizing both JavaScript and .NET - Integrate the Selenium testing suite into Jenkins for continuous integration - Run tests efficiently and effectively in the pipeline - Identify and rectify bugs in the code before deployment Ideal Candidate: - Proficient in Selenium and JavaScript, as well as .NET and Maven - Prior experience integrating Selenium tests with Jenkins for continuous integra...
I am seeking to acquire a comprehensive list of 10,000 fake domains associated specifically Saudi Arabia with phishing scams. This list will primarily serve the purpose of security testing. The focus of this task will be on the accumulation of domains, with no requirement for a detailed description of each domain's potential threat level. The ideal freelancer for this job ...domains associated specifically Saudi Arabia with phishing scams. This list will primarily serve the purpose of security testing. The focus of this task will be on the accumulation of domains, with no requirement for a detailed description of each domain's potential threat level. The ideal freelancer for this job would have a strong background in cyber security and a profound understanding of Web Sc...
I require a professional web scraper to collect both text (data points) and images from a long list of web pages about hotels and destinations. - The project involves saving the actual images of destinations/hotels —not just their URLs—from every webpage. - As for the text content, I'm particularly interested in several points - The extracted data and saved images should be meticulously organized in an Excel sheet for easy review and reference. Ideally, I'm seeking someone with an extensive background in web scraping and data extraction. Being proficient in Excel would be a significant plus. Accuracy, attention to details, and reliability are also crucial traits for this task.
I'm in need of a Python developer with specific skills in web scraping. The main task for this project is to fix bugs in existing web scraping scripts. Your role will be to primarily focus on this aspect, ensuring the scraping process runs smoothly, and is optimized for efficiency. If you perform well in this project, it will be a long term business opportunity. I have lots of projects in mind which need to start after this. New freelancers are welcome to bid.
I'm in need of a proficient website scraper to gather data from specific fashion retailers. You will scrape the data for a period of about 12 weeks. Starting mid June. We would target the 10 following fashion retailers: Guess, Tommy Hilfiger, Levis, GAP, Calvin Klein, Ralph Lauren, Desigual, Mango, River Island,...shirt/...]) - Price points over time (and corresponding discounts) - Out-of-stock data over time (per item, not by size) The collected data should specifically focus on their clothing items (no accessories, shoes, underwear, home wear, gifts,...). The project start deadline is ASAP. A quick turnaround is essential. Ideal Skills and Experience: - Proficient in web scraping, particularly for pricing data - Experience in scraping fashion retail websit...
I need a Python expert to scrape tabular data from a series of PDFs and store it in a database. Ideal Skills and Experience: - Proficiency in Python. - Strong experience in web scraping with PDFs. - Familiarity with database management. The PDFs are consistent in format and all contain tables. The scraped data needs to be stored in a database.
I am in need of a skilled i...the data to Excel. The PDF tables are consistent across all pages, maintaining a fixed column structure which you need to duplicate in the Excel spreadsheets. The data you will be working with is primarily text-based as opposed to numerical. Necessary Skills and Experience: - Excellent attention to detail - Proficiency in optical character recognition (OCR) processing - Experience with data scraping or extraction - Valuable skills in MS Excel - Familiarity or experience with PDF data extraction software Swift and accurate execution is essential for the successful completion of this project. Please only apply if you are comfortable handling a high volume of pages and can ensure that no data is lost or incorrectly transcribed in the transition from PDF...
...desire; Pakistan, Bangladesh, India, etc. I need a freelancer from LATIN AMERICA only. I need close to EST time!! Furthermore, I need a BILINGUAL freelancer!! So READ before biding. I need a fully bilingual professional (I will interview in English via video) to do some tasks for my agency, such as: PR Outreach Social media Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress (change text, add a button, upload a file, etc) And others related to the position You must be a FAST learner, attentive to details, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes over and over. Attention to detail. Common sense. ...
...create a scraper for Lazada. The ideal candidate must be skilled in web scraping and should reverse engineer API from mobile app because lazada blocks and throws captcha on web website is lazada . The script should work like i enter something in search box and it should scrape all the products from that search query Key Responsibilities: - Extract the following information: product names, prices, descriptions, stock, images, seller information, and product URLs. This list encapsulates the attributes you need to pay the most attention to. - Organizing the scraped data: The data, once scraped, must be organized in a well-structured CSV file. Ideal Skills: - Strong experience with Python. - Proficiency in web scraping tools. - Attention to detail ...
...desire; Pakistan, Bangladesh, India, etc. I need a freelancer from LATIN AMERICA only. I need close to EST time!! Furthermore, I need a BILINGUAL freelancer!! So READ before biding. I need a fully bilingual professional (I will interview in English via video) to do some tasks for my agency, such as: PR Outreach Social media Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress (change text, add a button, upload a file, etc) And others related to the position You must be a FAST learner, attentive to details, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes over and over. Attention to detail. Common sense. ...
Hi there, We are looking for someone who is: - Proficient in Python. - Experienced in automation and data scraping. Our budget is $3/hr for 20 hours on the initial project. This is a one-off task for now but could be ongoing work if successful. Please message with your CV/portfolio if interested
...through several car websites (, , , , , , , Facebook Market Place) and display the results in one convenient place. Key functionalities should include: - Advanced filtering options - Price range filtering - Location-based search Ideal expertise would entail experience in advanced web scraping and designing search algorithms, along with a deep understanding of diverse automobile databases and SEO. The candidate should be capable of verifying and testing the accuracy of the collected data as well. Efficiency in coding with an ability to manage site speed and response time is crucial, especially considering the breadth of services it will be searching. The final product should be
I need a skilled Bot Developer to create a multi-language web bot for me. - Tasks: The bot will mainly be responsible for web tasks like form filling, data scraping, and possibly social media automation. Unlike some bots, it won't interact with APIs or integrate with other web services. - Programming Languages: This is a multi-language project. I am open to using Python, JavaScript or PHP depending on what you think is best for this task. I need someone who is experienced in bot development and can create a reliable and efficient bot that performs these tasks seamlessly. Please have a look at the choices of programming languages I'm considering and let me know which one you think would best suit the goals of this project.
I need help fetching influencer data from Instagram, YouTube, and TikTok. There are other platforms, and t...fetching influencer data from Instagram, YouTube, and TikTok. There are other platforms, and the influencers required here are trading influencers. 1 - Those who sell trading indicators. 2 - Who have special channels for trading.. 3 - Who have bots for automated trading Basic skills and experience required: - Deep understanding of Instagram, YouTube and TikTok – Experience in data mining or web scraping - Good at analyzing data - Flexible and adaptable working approach I will attach a file I created as an example of the requirements I want. If you see yourself as suitable for this job, create an example of the same file sent to you, but with different informati...
I need the names, addresses, and contact information from a specific web map extracted. The purpose of this project is to create a directory of locations from this data, and the information will need to be updated annually. The ideal freelancer for this job will have experience in web scraping and data extraction. Key requirements: - Web scraping experience - Proficient in data extraction techniques - Understanding of directory creation - Reliable and professional with an eye for detail.
I'm looking for a Python expert to help me build a simple yet effective project. I need a program that can scan barcodes of grocery items and then provide me with detailed information about these products. This information should include protein, calories, added sugar, and any other relevant nutritional facts. ...added sugar, and any other relevant nutritional facts. Key requirements: - The ability to scan barcodes effectively and quickly - Retrieving information about the scanned products from an online source - Displaying this information in an organized and easy to understand manner Ideal skills and experience: - Proficiency in Python - Experience in working with barcode scanning - Familiarity with web scraping for nutritional information - Ability to create a u...
I need a program that can scrape for the addresses of homes listed and compile them into a ... for home addresses - Compile addresses in CSV format - Include the duration each house has been listed - Run the program every hour to capture new listings - Automatically eliminate any duplicate entrie - Run CSV file against another data base that has age and name of owner and contact info. Ideal Skills and Experience: - Experience in web scraping and data extraction - Proficiency in programming languages suitable for web scraping (e.g. Python, Scrapy) - Knowledge of CSV file creation and data handling - Ability to automate processes for regular data updates Please note that the addresses should be stored in the CSV file with each one on a separate line for easy r...
I'm looking for a skilled web scraper to handle challenging websites with advanced detection. The main data you will be required to scrape is text content. Here are the key project details: Ideal candidate should have: - Experience in web scraping, especially from challenging sites - Strong knowledge of web scraping tools and techniques - Proficiency in handling advanced automation detection - Excellent attention to detail to maintain a high level of data accuracy - Ability to deliver monthly updates in a timely manner Please include any relevant past experiences or examples of similar projects in your bid.
I'm in need of a proficient data entry specialist to assist with a substantial volume of data entry work. This is a very basic task, a lead scraping website doesn't allow me to export data. So we will copy and paste from one website to a google sheet. There are 2,241 entries needed This project will take ~20 hours I am attaching a screenshot of the picture of the website and of the spreadsheet
I require a specialized robot capable of locating and compiling available citations from business websites. As a fundamental part of this project, I am looking for: - Proficiency in hand...and compiling available citations from business websites. As a fundamental part of this project, I am looking for: - Proficiency in handling and extracting data from different business sources, specifically focusing on citations. - Advanced skills in programming and web scraping to efficiently channel through high amounts of data. - Understand the "citation" within the context of a business website as a direct link to the company's website. The ideal candidate would be someone with vast experience in data mining, web scraping, and programming. Previous expos...
I'm in need of a web scraping wizard who can help me extract text data and profiles from Twitter website. Key Requirements: - The ability to scrape text data and profile information efficiently and accurately. - Experience in web scraping, with a strong portfolio showcasing past work in similar projects. - The time for scraping a post and profile must be less 3 seconds without using Twitter API. The final deliverable should be in a format that's easy for me to analyze, but I'm flexible on whether it's a CSV file, Excel spreadsheet or a database format. Please describe your past work examples with your application. Write "Blue" on the head of your bid if you are not a bot.
I'm about to get daily PDF forms and need them automatically dumped into a Google Sheets document. The project involves: - Extracting data from incoming PDFs and inputting them into corresponding fields on Google Sheets. - Ensuring that each f...project involves: - Extracting data from incoming PDFs and inputting them into corresponding fields on Google Sheets. - Ensuring that each form submission creates a new row in the Google Sheets document. It's essential that: - The data is accurately extracted with no errors. - The system can handle a normal volume of PDF submissions (no more than 150) Ideal qualifications: - Proficient in web scraping and data entry. - Experienced in working with Google Sheets and PDF manipulation. - Ability to create an automated system ...
I'm in need of a professional who can develop a scraping tool that will track market announcements and releases on a financial website using specific keywords. - The tool should scrape this data on a daily basis. Accuracy and reliability are key. - the scraped data should be filtered for the current date, daily. - I need this table of data to be automatically filtered for keywords. -the filtered results to be emailed automatically to an email list. - the tool to run automatically on a website or server. I'm looking for someone who has a proven track record in web scraping with a focus on financial data. Experience in creating automated scraping tools, particularly those that operate on a daily basis, is a huge plus.
I'm looking to scrape a website using the python package requests. 1) create a session because the site requires a username and pwd login 2) pass an initial URL that will get pagination of results 3) from the results we'll get the URL of the individual person/page we need to get info from 4) we'll make a request call within the session to the persons URL 5) Then we'll parse the HTML from the persons page 6) Then, we'll put the information into a dictionary object and append it to the a list 7) Finally we'll then print out the list of JSON objects to a text file
...a Python Developer who is proficient in data analysis, visualization, and data science to work on an array of data types including financial, customer, social media, and pharma data. Key Tasks: - Data Analysis and Visualization: You will be given various sets of data which you will need to efficiently analyze and create meaningful visualizations. - Web Scraping and Automation: Knowledge in this area is desirable but not necessary. - Django Web Development: Again, not a necessity but would be considered a bonus. Objectives: - Efficiency Improvement: Assist in identifying areas of operational efficiency and suggest or implement changes accordingly. - Cost-Saving Opportunities: Use the analyzed data to identify potential areas for reducing costs. - Decision Making I...
I'm seeking a pr...followers' ratio. The higher the ratio, the more viral the tweet is considered to be. - It should be able to scrape and analyze tweets from the past week. - The bot should be capable of differentiating between tweets based on their views to followers ratio and identify the 'most viral' one. Ideal Skills & Experience: - Proficient in creating Twitter bots. - Strong understanding of Twitter API and scraping tools. - Familiarity with tweet analytics and calculations. - Ability to extract and process data efficiently. The end goal of this project is to have a functional tool that can accurately pinpoint the most viral tweet of the week. It is essential that the developer is skilled at creating algorithms that can measure and compare the '...
I need a web scraping expert to scrape Title, Price, star ratings, delivery window from a specific e-commerce site on a regular basis. - The scraping should cover a range of products, ideally with the ability to specify categories for tracking. - The data needs to be scraped frequently, so automation and scheduling will be crucial. - It's important that the extracted data is accurate and up-to-date as this will be used to inform pricing strategies and customer service. The ideal freelancer for this project should have: - Proficient experience in web scraping, particularly from E-commerce sites. - Proficiency in programming languages like Python or R for automation. - Good understanding of data management and quality control. - Ability to deliver a ...
I'm seeking a skilled Python developer proficient in Selenium or other scraping tools, AI and others API integration. The main tasks in this project include: - Integrating APIs: You'll be responsible for seamlessly integrating the following APIs: - Send/reveive data from trained AI - Collect data using scraping - Payment Gateway - Other websites: API to integrate with other websites - Developing B2B Features: We're looking to expand our platform to cater for B2B transactions. Your role will be to create and incorporate features that facilitate B2B interactions. Key skills and experience required: - Proficient in Python - Experienced with Selenium or other scraping tools - Proven track record with API integration - exchange...
I'm looking for a skilled professional to create an API that scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The ...scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The data should be delivered in JSON format. Ideal freelancer: - Proficient in web scraping - Experienced in API development - Familiarity with or similar e-commerce websites is a plus - Ability to deliver high-quality and clean JSON data - Reliable and able to meet daily scraping requirements.
I'm looking for a skilled professional to create an API that scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The ...scrapes data from and collect all product details. Key Requirements: - I need the API to scrape product name, price, and description, as well as all other available product details on the website. - The data should be delivered in JSON format. Ideal freelancer: - Proficient in web scraping - Experienced in API development - Familiarity with or similar e-commerce websites is a plus - Ability to deliver high-quality and clean JSON data - Reliable and able to meet daily scraping requirements.
Our SaaS site () is getting a bit old. We need an experienced designer/front-end developer to completely freshen it up,We operate in the Web Scraping industry and would like our new site to stands out w.r.t. competition. We want a site that's easy on the eyes and presents our product offering better than how it is currently presented. Requirements =========== . New home page should have a section for testimonials/clients and a section for awards/review badges. . Each product (currently scrape and extract) have their dedicated page. Their illustrations need to be redone and the scrape page should have some icons/illustrations on top of each "Applications" box. . We need a new nav menu item for "Resources". The site footer section will also host new ...
I'm looking for a skilled professional who can help me retrieve information from various sources. The ideal freelancer should be well-versed in web scraping, especially from websites, social media platforms such as LinkedIn, publications, and news sites. This will help in gathering relevant data for building a recommendation system. Key requirements include: - Proficiency in data scraping from multiple sources - Ability to effectively scrape data from websites, social media platforms like LinkedIn, and news sites - Experience with handling and storing data in a database - Understanding of how to structure and manage data for machine learning purposes Your task will be to gather the data and store it in a database for further analysis. Having a solid bac...
I'm seeking a Python developer who's proficient in web scraping to help me extract data from social media platforms. Key Responsibilities: - Develop and implement a Python script for web scraping data from social media channels. Deliverable: - The scraped data should be compiled and delivered in an Excel spreadsheet for further analysis. Ideal Candidate: - Proficient in Python with a strong background in web scraping techniques. - Prior experience in scraping data from social media platforms will be a big plus. - Ability to deliver the end results in an organized, neat and easily accessible format, such as an Excel spreadsheet. Please reach out if you think you're the right fit with the necessary expertise.
I'd like to extract the phone numbers of real estate agents from a particular website Key Requirements: - Extract agent contact information Ideal Skills and Experience: - Proficiency in web scraping - Experience with data extraction and automation - Strong understanding of data privacy laws and regulations Please note that the data is intended for internal use only and will not be shared with any third-parties.
