Build a semi-automated scrapper with user input

This project will be awarded to PigtailXL user. One of our employees approached him for a project called "Build a semi-automated scrapper with user input" - [url removed, login to view] . Our employee did the research and did it on our behalf. Now we can go ahead and do the project.


Original project post:

I have a client and they want to be able to create a new lead entry to Dynamics 365 by scrapping the content from [url removed, login to view] using the "Entity Name" from [url removed, login to view] (please be aware that these 2 websites are only accessible from the US or using a VPN connection).

The scrapping process will work like this:

1. user goes to [url removed, login to view], selects manually "Corporate and LLC", "Corporate" or "LLC"

2. user inputs the "SEARCH METHOD" and the "SEARCH" fields

3. the scrapper uses the company name from the bottom of "Corporation/LLC Name" and gets to the "CORPORATION FILE DETAIL REPORT"

4. the scrapper copies the "Entity Name" from the right site of the table (let's name this "copied field"

5. the scrapper goes to [url removed, login to view]

6. the user validates the Google reCaptcha

7. the scrapper searches in the "Employer" tab for state "Illinois", current date and "copied field" from the previous website, then click below "Search", then click on the search result

8. the scrapper copies the text that is below each of the following: "Insurance Coverage Provider", "Policy Number" and "Coverage Date"

9. the scrapper then uses Microsoft Dynamics 365 Web API to create a new lead inside a Dynamics 365 account that is supplied

I also attached images for all 9 steps.

Færdigheder: Datasøgning, Dynamik, Javascript, PHP, Web Skrabning

Se mere: php user input city dropdown, load video based user input, user input form, java program ask user input exam scores, let user input image php, facebook user input, php user input database example, want flash program adds numbers user input, word template user input form, dnn user input module, vb6 best grid allow user input, user input facebook app, vba excel pop gui user input data

Om arbejdsgiveren:
( 4 bedømmelser ) Chicago, United States

Projekt-ID: #14788739

Tildelt til:


Hello Sr. this is my offer, after we spoke with Madalina about the details of the project. Habilidades y experiencia relevante My skills/abilities includes website scrape and automation of processes. I will build a Wi Mere

$250 USD in 7 dage
(158 bedømmelser)

23 freelancers are bidding on average $275 for this job


I have done a lot of scrapping and can scrap any site(even protected one) on challenge. My distinction, payment after your complete satisfaction with the resulted task. Relevant Skills and Experience http://apktower.c Mere

$277 USD in 3 dage
(270 bedømmelser)

Hi I work towards providing reliable, relevant and robust IT solutions at most competitive prices to my customers. I ensure 100% customer satisfaction so lets start Thanks Relevant Skills and Experience Data Minin Mere

$250 USD in 10 dage
(374 bedømmelser)

Hi sir, I am scraping expert, I have did more than 350+ scraping project, please check my feedback then you will know. Can we discuss more details about this project? then I will provide example data/scr Mere

$264 USD in 6 dage
(329 bedømmelser)
$277 USD in 3 dage
(145 bedømmelser)

Hey Friend, We are 14 person team of developer, designer and tester provide you excellent services. Relevant Skills and Experience Myself having has 10 years experience of web site development. Expert in Custom pr Mere

$250 USD in 8 dage
(223 bedømmelser)
$257 USD in 3 dage
(54 bedømmelser)

Hi Thank's for providing us an opportunity to bid on your project. We read you project description and understand clearly so we are highly interested to work for you Relevant Skills and Experience We specialise in PHP Mere

$250 USD in 3 dage
(91 bedømmelser)
$277 USD in 3 dage
(19 bedømmelser)

Hello sir. I read your attached files and sure I can do it. A few days ago I've completed vTiger CRM project. So I am the best candidate. Relevant Skills and Experience Web scraping(PHP-curl, c#, Python, [url removed, login to view], Mere

$277 USD in 3 dage
(61 bedømmelser)
$250 USD in 3 dage
(48 bedømmelser)

Hey, I am good on automated scraping tool. I can give you a software demo for this need. Regards, Rocky Stay tuned, I'm still working on this proposal.

$250 USD in 3 dage
(46 bedømmelser)
$250 USD in 3 dage
(43 bedømmelser)

Hey, how’s it going? My name is Mike, I’m a Web Designer & Developer from Boston. I've had a look at your project description and feel that my skills match your requirements perfectly. Relevant Skills and Experience G Mere

$277 USD in 3 dage
(7 bedømmelser)

final Relevant Skills and Experience To achieve goal with 100% quality we have team of 15 Professional Software Engg/Developer. Proposed Milestones $277 USD - by delivering work of the highest quality on-time and on- Mere

$277 USD in 3 dage
(5 bedømmelser)

Hello Client, Hope you are doing well ! I would like to take a chance to show my abilities and prove that I am a right candidate for this [url removed, login to view] more then 8 years of experience in,Python,Scraping,Crawlingand Sc Mere

$250 USD in 0 dage
(5 bedømmelser)

Hello, I am a full-time freelancer and do web scraping jobs only. I am creating automated data extraction systems for more than two years now Relevant Skills and Experience I can scrape any website using any technolog Mere

$277 USD in 3 dage
(7 bedømmelser)
$277 USD in 3 dage
(7 bedømmelser)

Dear Hiring Manager: I am quite excited to apply for the job posting of a Web Designer. Relevant Skills and Experience Since I am a well qualified contractor who would be an excellent choice for this job. Proposed Mi Mere

$274 USD in 2 dage
(11 bedømmelser)

I checked your website and document details and yes will get your long along with I can do this work fast and deliver you soon. Relevant Skills and Experience I am having 6 year PHP and Wordpress and javascript and jq Mere

$333 USD in 3 dage
(1 bedømmelse)

Hello, I am a developer, web designer and computer programmer offering over +5 years of experience on both client and server sides. I work quickly and quality is my top priority. I am perfectly capable of following i Mere

$250 USD in 20 dage
(2 bedømmelser)