Scrape data databaseJobs

...work on a web project of mine. The project involves HTML, CSS, JavaScript, and some light database functions. The work will mainly focus on: - Implementing text input fields and dropdown menus: These are crucial elements for user interaction and data input. Your job would be to make them look and function as required. - Basic database functions: While the exact nature of these is yet to be decided, they will likely include retrieving and adding data. Your task will be to integrate these functions seamlessly into the site. Ideal skills for this project would include: - Proficiency in HTML, CSS, and JavaScript, with experience in creating user-friendly and responsive UIs. - Familiarity with basic database manipulation. - Good communication skills, as we...

Looking for help in modifying an existing python script and related sql database table The current script - (1) scrapes company financial data from website and populates database (2) scrapes news related to keywords from google news (3)sentiment classification of news items (4)pushes data to sql database The company names and keywords are currently hardcoded in the script Requirement- (1) Company names/urls/keywords (will be provided) to be put in master table in the database (2) The script to loop through and scrape the relevant data and put in database

I am looking for a freelancer to help me with a data entry project. The main task is to submit contact us forms on 1500 different websites for lead generation purposes. If you could also scrape website links according to our Keywords and Location that would be better. Requirements: - Experience in data entry and form submission - Attention to detail and accuracy - Proficiency in English language - Ability to follow instructions Key Details: - The project involves submitting contact forms on 1500 websites - I will provide specific messages to be sent through the contact forms If you have the necessary skills and are interested in this project, please submit your proposal. Thank you.

I am in need of a Python expert, specializing in web scraping. I require someone who can proficiently extract data from various websites. The specifics of the data may vary from text content, images, links, to contact information. Your key responsibilities will include: - Writing effective and efficient Python scripts to scrape data - Ensuring the data is extracted accurately and in a structured format - Delivering the data in a timely manner The ideal candidate should have: - Proficient experience in Python and web scraping - A strong understanding of data extraction techniques - Proven experience in handling and parsing a variety of data types - Excellent communication skills and the ability to meet deadlines Please be prepare...

...detail-oriented and web-savvy freelancer/contractor to build a comprehensive database of sign manufacturers/companies in France. Project Scope: • Research and identify qualified sign manufacturers/companies/suppliers/sellers/stores across France. • Utilize various online resources, including: o Search engines (Google, Bing, etc.) o Social media platforms (Facebook, Instagram, LinkedIn) o Industry directories and publications (list specific resources if known) o Business databases (mention specific databases if known) • Gather and verify contact information (name, email, phone number) for each lead. • Compile lead data into a Excel format . Qualifications: • French reading and understanding - ONLY • Excellent research and data collecti...

I'm looking for an experienced developer to help with real-time text data scraping via API and management using BeautifulSoup. This project is primarily focused on retrieving text data and storing it in a database. Key Responsibilities: - Implement an API scraper to continuously retrieve text data in real-time - Utilize BeautifulSoup for data extraction and management - Develop a robust database to store all the scraped text data The ideal candidate should have: - Proficiency in Python programming language - Strong experience with API scraping and BeautifulSoup - Previous work involving real-time data scraping - A good understanding of database management It is important that the data scraping runs seamlessly a...

I want someone who can create a database in MS Access for Invoices Log (tracking for already processed invoices) with the following features. 1- A list of all invoices (Master List) with the field names I will provide. 2- A list of all Contracts with the field names I will provide. 3- A list of all Purchase Orders. 4- A list of Approvers who is approving the invoices. 5- A list of Accounts. 5- All of these list should be linked with each other. The database should have a login page. After Login, there should be a a Main Page, with link to the above mentioned list pages plus, Add Invoice, Search Invoice, Search Approver, Search Contract, Search PO, Search Account and Reports pages. For Add New Invoice page, I should be able to add an invoice details in it, and if it's...

I require an advanced database to streamline church operations. It must include: - Member management: This involves recording personal details of each member, tracking attendance, and allocating to the right departments. Each member's record should also include household and family details, with specific fields for spouse and children. - Functionalities: Capacity to sort data based on each individual (organize by member). It should also capture other input fields like gender, age, membership status, notes, and whether they serve as workers or ministers. - Financial management: The platform should have capabilities for recording and tracking financial contributions. Ideal freelancers will have experience in building similar database systems, with a keen underst...

I'm searching for an expert who can assist me in generating high-quality leads and databases. The candidate should be an expert in scrapping and generating leads, as per the requirement. We are open to buying the lead list and paying for the consultation. Please apply only if you know how to generate and scrape leads in bulk and are an expert or have rich experience in it. We are looking for experts only. Budget is not a constraint for the right candidate. To ensure you have read the description, start your application with the word "Blue" to be considered. Thank you.

I need a professional to scrape names and email addresses from specific public websites. I'm looking to populate a database with details from a range of public websites. This data will be used for lead generation and market research purposes. Ideal skills and experience: - Proficient in web scraping - Familiar with public data extraction - Able to structure data effectively

I'm seeking a data entry specialist with a knack for precision to type data from PDFs into an online database. Key Requirements: - As a data entry specialist, you will be responsible for the accurate and timely entry of data from PDFs into our online database. - The data format should match the original PDFs, with no specific validation rules needed. - The ideal candidate will be detail-oriented, with a proven track record of data entry. If you're someone who enjoys working with data and has an eye for detail, this could be an ideal project for you.

My Python script is intended to scrape specific Telegram groups, but it's not functioning as expected. I need a developer to address these issues, described below. - **Issue Description**: The script is crashing when scraping certain Telegram groups, which is likely due to the fact that it's not respecting selections. The error presented is “ AttributeError: 'MessageMediaWebPage' object has no attribute 'document'” I can provide the script if you want to check how it’s working. I am open to a whole new script being made. So long as it functions in a similar way. If not familiar you can view telethon api - **Expected Behavior**: The scraping script is supposed to collect data that matches specific regex patterns. This means...

I need a script that can scrape the Google Play store specific data from list of apps in the search result url of any keyword. Need data in Excel spreadsheet. Eg : if i search cat in playstore, i need the below mentioned details of first 100 apps shown in the search result. Key Project Details: - I require the script to scrape app names, descriptions, emails, download counts, and URL of the app. - The scraped data should be compiled into an Excel spreadsheet format for my review and analysis. - deploy the script into my server The Ideal Freelancer: - Proficient in web scraping tools and techniques - Experience working with Google Play store data - Competent in automating data extraction and processing - Ability to deliver a reliable, da...

We are seeking a skilled developer or development team to create a comprehensive web crawler system. This system should scrape, structure, and update information from web pages, handle large projects, and be accessible via a powerful API. The system should offer user-friendly features for both individuals and businesses and include flexible user management for both customers and employees. Project Requirements 1. Web Crawling and Data Extraction -Develop a system capable of scraping entire websites and extracting data from each page. -The system should divide the scraped information into sections to facilitate easy reading and understanding. -For e-commerce sites, the system should identify and structure the following information: --Product category (including breadcr...

Build an ISO for a raspberry pi (with cellular notecard) to scan for unique cell phones in a specific range and log the unique phone ID and timestamps/ping (distance) from the raspberry pi and store in mysql database using cellular adapter.

Hi, I need the following scraped. You can use scraping software or script. YellowPages might be the easiest - law firms and lawyers - only name and email - Colorado, USA

I'm in need of a skilled professional to help me create a data mining script. The task involves mining emails, data from a certain website and delivering the data in a raw text file format. Key Requirements: - Develop a data miner script that can effectively scrape email data from websites. - Ensure the script can handle multiple sources and is scalable for future needs. - Deliver the mined data in a raw text file format. Ideal Skills: - Proficiency in web scraping and data mining techniques. - Experience with developing scripts for text data mining. - Strong knowledge of scripting languages suitable for scraping like Python/BeautifulSoup, R, etc. Please provide samples of your previous similar projects or portfolio t...

...complete but due to some error while connecting to the database some code is missing and the connection is not completed. You have to find out where the problem is and fix it properly. I will help you in everything ******* I'm seeking a skilled PHP developer to assist with a project that involves fixing a PHP file and combining a Php ,MySQL database. The main tasks for this project include: - Resolving a database connection issue in the PHP file. - Combining the MySQL database in the backend of the PHP file. Your role will be crucial in ensuring that the database is correctly integrated into the PHP file and that the database connection is stable and error-free. The PHP file should be able to successfully communicate with the MySQL ...

I'm looking for someone who can create a WordPress plugin for scraping manga websites. Plugin Requirements: 1. Grab per chapter by link. 2. Grab full chapter by link. 3. Grab new manga by link. 4. Compatible...link. 4. Compatible with various manga themes. 5. Images from the scraped content should be uploaded to s3 storage. 6. Must have 10 sources for scraping (with a guarantee that if one source fails or the website goes down, it can switch to another source). Usage Flow: 1. I create a manga post and fill in the manga link in the metabox. 2. The plugin will automatically fill in the chapter links, scrape HTML images, and create posts. It will also automatically fill in the chapter number and the manga post ID number based on the manga link. Note: Speed during scraping is ...

...creating an ER diagram, relational schema, database dump, SQL files, and queries for a library database system. Requirements: - ER Diagram: An ER diagram is required with rationalities similar to the example provided in this link: - Relational Schema: Develop a relational schema that effectively models the database. - Database Dump: Provide a database dump for the system. - SQL Files and Queries: The project should include a set of SQL files and queries that effectively interact with the database. - Managerial Queries: Develop a minimum of 20 managerial queries that will be used to analyze and manage the library database. Deadline: This project must be completed by Monday. Ideal Skills: - Proficiency in database design and SQ...

...complex backend development and database integration tasks and run code as offline. Key Responsibilities: Develop, test, and maintain robust, scalable, high-quality software solutions. Design and implement new features and functionality. Write clean, maintainable, and efficient code. Develop RESTful APIs to support front-end functionality. Integrate user-facing elements developed by front-end developers with server-side logic. - In-depth understanding and experience of backend operations using Python Django. - Managing and integration of the database with the application. - Maintenance and improvement of existing codebase for optimal functionality. Desirable Skills: - Proven experience in Python Django for backend development. - Hands-on experience in database ...

I've compiled a comprehensive global leads database with 8 million entries. The database includes a variety of details such as name, email, contact number, website, profession, and even Instagram username. - **Purpose**: This database is specifically designed for sales leads generation. It's meant to help businesses and organizations reach out to potential customers and grow their sales. - **Categorization**: The leads are not just categorized by one specific filter. Instead, they're a mix of different categories from various industries, countries, and professions. This eclectic mix provides a wide range of opportunities for potential buyers. - **Delivery Method**: I'm looking to sell this database through a CSV file, online access to the...

Commercial real estate agency database of GCC

About Plesk hosting upgrading the database from MariaDB 10.1 to 10.3 i would like to upgrade the database from MariaDB 10.1 to 10.3 for my hosting however, my hosting have a lot of client website in it, just would like to know if this upgrade will not affect the existing database thanks

Self Managed Home Care Providers Database

I'm seeking a data entry specialist with a knack for precision to type data from PDFs into an online database. Key Requirements: - As a data entry specialist, you will be responsible for the accurate and timely entry of data from PDFs into our online database. - The data format should match the original PDFs, with no specific validation rules needed. - The ideal candidate will be detail-oriented, with a proven track record of data entry. If you're someone who enjoys working with data and has an eye for detail, this could be an ideal project for you.

I'm looking to create a comprehensive database of self-managed home care providers in Queensland and Australia to facilitate networking within the industry. Key requirements: - The database should include the provider's: - Name - Address - Email - Prime contact Ideal skills for this project: - Proficiency in data collection and database creation - Familiarity with the home care industry in Queensland and Australia - Organizational skills, to categorize the data by region - Excellent attention to detail, ensuring accuracy in information provided The data should be organized by region for easier networking. I may also require the database to be updated periodically. The collected information should be reliable, up-to-date...

...email addresses, websites, and phone numbers from the links in the attached spreadsheet. It's crucial that the information you provide is accurate and up-to-date. The test of accuracy will be me sending emails and verifying the company. Any wrong details will need to be collected again unless it is beyond your control (e.g. company has closed down etc.) Automated collection will be erroneous as the data needs to be collected in the following way. use the company names or links from the attached spreadsheet. 2. To copy and paste the company name + UK in the Google search box. The company's operation must be based in the UK as similar names may exist in US as well. 3. Or to click company logo and collect its email addresses, websites, and phone numbe. 4. To manually c...

I need a Python developer to create a bot that scrapes data from APIs on an hourly basis. - The bot's primary function is to scrape data - The data will be sourced from APIs - The bot needs to run on an hourly basis Ideal candidate: - Proficient in Python and API data scraping - Familiarity with creating bots - Able to ensure smooth hourly operation, possibly using a scheduling library such as APScheduler

I'm looking for a proficient professional who can effectively scrape leads from LinkedIn, Facebook, and Instagram and all over the internet Key responsibilities: * Extracting Email leads, Phone number leads, and Social media leads. * Collecting specific data - Name, Job title, Company, and Location, email and phone numbers Ideal freelancers for this project should have: * Extensive experience in data scraping, especially on the platforms mentioned above. * Proficiency in data mining techniques and possessing advanced analytical skills. * Understanding of ethical data scraping practices. * Strong attention to detail - ensuring all data is accurate and up-to-date. * Proven track record of delivering quality leads in a short timeframe. Get i...

...need a proficient database developer (PHP Developer) to create a specialized system for my dental equipment repair company. The database will cater to a sizeable clientele of 5000 customers. The details to be incorporated include: * Equipment type (X-ray machines, Dental chairs, Autoclaves) * Maintenance history * Customer details (Clinic name, number, email address etc.) In order to succeed in this project, you should have: * Strong database creation skills with the ability to account for our unique needs * Experience in the healthcare sector, specifically knowledge of dental equipment * Excellent problem solving and critical thinking skills for effective database design * Understanding of confidentiality requirements given the sensitive nature of the c...

We are seeking an experienced Flutter developer to integrate 's video and call streaming services along with Firebase database into our existing Flutter application. The primary tasks include implementing 's features for seamless video streaming and call functionality, as well as utilizing Firebase database for efficient data storage and retrieval. The ideal candidate should have prior experience with SDK and Firebase integration. Additionally, the developer will be responsible for updating the app to meet the requirements for submission to both Apple Store and Android Store. If you have the necessary skills and expertise in Flutter development, we'd love to hear from you.

We need the following combination of online database and data entry interface from users + a local MS access file. Online Database and web I terface for data entry We want to have multiple users to view and edit information for subscribers (names) in a database. Those users must be able to login on a web page, with a username and password. All users will see same information. But certain fields, those they will be able to edit, will be visible only to that specific user (and admin). Multiple users must be able to enter data (different) for each subscriber. User must be able to filter certain columns, search in all fields, hide/show columns. Online (on web) visible to users, will be only the fields mentioned in table visible) MS Access (local fil...

I need a web scraping professional to create a script to extract specific data from , a popular online marketplace for trading cards, please check attachement to get the idea. Key Requirements: - Scrapping: The primary task is to scrape the following information from the platform: - Card properties 1. Hero score for last 7 days 2. Hero rank for last 7 days 3. Stars 4. Rarity 5. Name 6. Quantity listed to purchase 7. Inflation data 8. Minted count - Buy prices List Price Last Price Order book (price and quantity see picture attached) - Bidding details bids book (bid and quantity see picture attached) - Twitter activity per card View Views+ Likes Likes+ Retweets Retweets+ Replies Replies+ Quotes Quotes+ Bookmarks Bookmarks+

I'm seeking a Python developer experienced with web scraping. This job involves setting up a Python script that can scrape a popular review site. Key details to extract: - Review text - Star rating - Date of review - Reviewer name - Star-ratings for sub-categories - Review ID - Reviewed person - Reviewed product name The site does not use captchas, so it should be reasonably straightforward. All reviews for a given provider should be scraped. It would be good to have an option to start with the newest and stop at a certain date. The specific review site can be seen in the sample URL in the attached PDF. I can send further details in a private message including screenshots. Preferred frameworks would be Beautifoulsoup 4 / Scrapy if sufficient and Selenium otherwise. Please...

I'm looking for an expert to create a web-based CRM database aimed at efficiently storing and managing information. The data I intend to keep include: - Customer contact details - Sales history - Communication logs - Course details - Course Refresher notifications This project also requires the creation of functionalities to: - Add new contacts - Update existing contact information - Track sales performance Ideal freelancers should have substantial experience in CRM database development, with knowledge of implementing web-based solutions. Familiarity with training or course-based entities would be a bonus. Your expertise ought to allow seamless additions, updates, and performance tracking of stored information. Demonstrable success in similar projects will be ...

I'm looking to test database scraping on a website to extract names and potentially contact emails (if available). The data doesn't necessarily need to be organized or cleaned post-extraction. Ideal Skills: - Proficiency in web scraping tools - Understanding of database structures - Familiarity with handling contact information The data should be organized in an excel and csv based on the desired layout.

I r...scraping professional with experience in extracting text and images from multiple websites. Your task will involve the following: - Scrape data from Sephora, Cult Beauty, Space nk - Extract specifically the Text, Images, Titles, Descriptions, and Prices A strong background in web scraping, data extraction, and working proficiently across different websites is critical for this project. Knowledge in web parsing methods and ability to bypass potential anti-scraping tools or blocks set up on these websites will be highly advantageous. Your goal is to accurately scrape the necessary information without causing disruption to the target websites, and ensure the data is comprehensible and ready for further use. I would like to see an example of 1 pag...

scrape data from darty site and export it into excel file.

I need a Python Selenium application that can scrape blog posts from Site A and post them on Site B. Key Requirements: - The Python app should be built using Selenium for web scraping and automation. - It should be able to extract blog posts from Site A, specifically. - The extracted data must be posted on an existing blog section of Site B. Ideal Skills & Experience: - Proficient in Python, with experience in building web scrapers. - Strong knowledge of Selenium for web automation. - Previous experience with data extraction and manipulation. - Understanding of web protocols and site structures. - Familiarity with blog post formatting and publishing is a plus.

...proficient Access Database designer to build an advanced and fully functional task management system. Key Features: - Data Entry Forms: These should be user-friendly and designed for efficiency. - Reporting and Analysis Tools: I need to be able to easily track productivity and analyze task-related metrics. - Data Validation Rules: The system needs to ensure the accuracy of inputted data with stringent validation rules. Structure: The database should consist of 5-10 interlinked tables for comprehensive task tracking and management. Ideal skills and experience for this job would include: - Extensive experience with Access database design, specifically around task management systems. - Strong ability to translate user needs into functional syst...

...detail to perform data entry into my database. The data to be entered is text-based and extracted from various sources which may have distinct formats. Below are specifics about the job: - Handling Text Data: The job will entail entering a variety of text data into the designated database. - Format Diversity: The data comes from diverse sources, so it does not adhere to a specific format. The ideal candidate must be adaptable in handling different data formats. - Correcting Discrepancies: The freelancer will need to spot and correct discrepancies or inconsistencies within the data sources. Accuracy and keenness to details will be crucial. Ideal Skills: - Proficient in data entry - Strong attention to detail - G...

I'm looking for a skilled professional to improve the accuracy of my cloud-based database. To achieve this, the tasks at hand include: - Identifying and removing duplicate entries - Standardizing data formats to ensure consistency - Conducting routine data cleaning checks to maintain accuracy Ideal candidates should have: - Proven experience in data cleaning and management - A deep understanding of cloud-based database systems - Strong communication skills as I prefer to get updates and progress reports through an instant messaging app.

I'm seeking a skilled freelancer to assist in collecting email addresses for an upcoming email marketing campaign. The ideal candidate will have experience and expertise ...Provide the email addresses in a well-organized manner, making it easy to integrate into our marketing campaign. Target Industries: The primary focus for this collection is media, video production, photo production, TV production, film production, and music production. This means that your understanding of the sectors is crucial for the success of this project. Skills required: - Web scraping - Data collection - Experience with email marketing is a plus - Understanding of media and production industries is preferred Please reach out if you are confident in your ability to deliver high-quality, targeted e...

I'm searching for a skilled individual who can help me scrape data from a website. The data I'm interested in is text content and tables, specifically contact information. Ideal Skills: - Proficiency in web scraping tools - Strong experience with scraping text content and tables - Expertise in extracting specific information - Familiarity with structured data formats The contact information on the website is in a structured format. Your ability to navigate this and provide me with a clean, organized dataset will be crucial. Looking forward to collaborating with a detail-oriented and reliable professional. Attached is a sample format. The site is: Final file must contain all records for all schools on all pages

I'm searching for a professional who is proficient in SQL coding specifically for MySQL database design. PowerShell scripting or similar would also be beneficial. This is a basic level project taking existing Local government procedures and converting them into SQL based processes. An example of which would be creating a import procedure for traffic count data that is presented in a text format (example attached) Ideal Skills: - Experienced with MySQL Database Design - Well-versed in SQL coding - Ability to simplify complex instructions - PowerShell for anything not possible in SQL This project will demand creativity and intelligence to design procedures that simplify data entry processes. Please only bid if you can offer solutions according to the...

I am experiencing slow query processing and management issues with large ...experiencing slow query processing and management issues with large tables in my MySQL database, primarily storing transaction data. I am seeking a DBA specialist to diagnose and resolve these bottlenecks and improve the overall performance of the system. Ideal Skills and Experience: - Proven experience in MySQL database administration and optimization - Knowledge of query execution plans and optimization techniques - Proficiency in managing databases with 10-50 tables - Experience in handling databases primarily housing transaction data Tasks include: - Investigating and diagnosing slow query performance - Optimizing handling of large tables - Implementing necessary changes to enhanc...

...Developer >6 years of experience in agile development of scalable SaaS apps in the cybersecurity area: Improve our app (URL Risk assessment) Improve our app (Domain Typosquatting) Improve our project (Darknet Monitoring) Create an app "hackerview" for passive attack surfave enumeration Create an app for detecting spoofed social media profiles Create an app to scrape ransomware threat actor website and maitain stats about those sites Improve an existing app to monitor paste sites Mininmal Tech Experience: MERN, REST API (JWT), Django, Python, Github, CI/CD, Celery, Redis, Linux, Postgress, Kubernetes, Docker, Nginx, JS, HTML5, Protocols (DNS, SMTP, SSL, HTTP..).Detailed app specifications will be shared at a later stage. |--------------------------------

...currently in need of a professional who can assist in completing a database for over +14000 companies. The goal of this project is to generate high-quality sales leads. Key Project Details: - You will be required to include accurate and up-to-date contact information including phone numbers and email addresses. - In addition to the contact details, each company's key contact person's name must also be included in the database. The ideal freelancer for this project will have: - Prior experience with database generation and management. - Proficiency in data mining and web scraping techniques. - Exceptional attention to detail to ensure accuracy of information. - Proven track record in generating sales leads through database creation. This pr...

I am presently seeking a highly skilled freelancer for an email extraction project from two highly popular social media platforms - Facebook and Instagram. Key Project Specifications: - Scrape email addresses from both Facebook and Instagram. - Selection of the profiles for scraping should be primarily based on the following criteria: levels of user engagement and followers count. - Along with the email addresses, extract additional user information namely: the account name and its location. Ideal Candidate Profile: - Must have experience in deducing complex social media algorithms. - Understanding of digital privacy laws to ensure compliance during the extraction process. - Fluency in software that can automate this extraction process would be advantageous. My ultimat...