Lukket

Write script or code to harvest data from websites

### SIMPLE DESCRIPTION ###

I would like someone to write a semi automated script/code or software that will search [login to view URL] using a custom search criteria. It will then collect all the addresses of all the properties that appear in the search and save them.

Then I need a second script/code or software to search all the saved addresses on another website and collect additional data which will be saved in a Microsoft Access Database (.mdb) file for a mail merge.

### DETAILED STEP BY STEP EXAMPLE ###

1) Search [login to view URL] for rental properties in Toowong, QLD 4066 using the following search criteria:

- All property types

- Beds (min): any

- Beds (max): any

- Price pw (min): $350

- Price pw (max): any

- Available date: Any date

- Surrounding suburbs: no

[login to view URL],+qld+4066/list-1

PLEASE NOTE THAT THE SEARCHES WILL ALWAYS BE FOR "RENT" SECTION OF THE WEBSITE, BUT I WILL NEED THE ABILITY TO MODIFY ALL THE OTHER SEARCH CRITERIA

2) The script will then collect all the addresses for all the properties that appear in this search. Please note that several pages appear in the search. eg:

- [login to view URL],+qld+4066/list-1

- [login to view URL],+qld+4066/list-2

- [login to view URL],+qld+4066/list-3

- [login to view URL],+qld+4066/list-4

and all the addresses must be saved, eg:

- 1/39 Brisbane Street, Toowong, Qld 4066

- 2/21 Glen Road, Toowong, Qld 4066

- 601/2-6 Land Street, Toowong, Qld 4066

- 204/573 Coronation Drive, Toowong, Qld 4066

- etc etc

3) all the saved addresses will then be used to search on https://rpp.rpdata.com.... Please note that this website requires a paid account and login which will be supplied by myself.

4) The script will search all these addresses one by one. Please see image 1 for an example of the first address search. PLEASE NOTE THAT ENTERING THE ADDRESS AND PRESSING 'ENTER' DID NOT FIND THE PROPERTY. I had to click the correct address from the drop down box first. Please also note that some properties will not be found and the script needs to be able to filter out as many as possible.

5) Please see image 2 for search results for first property

6) Please see image 3 and 4 for the data shown for that property

7) The script will then collect the address shown in the 'ownership' section. PLEASE NOTE THAT I HAVE HIDDEN THE EXACT ADDRESS FOR PRIVACY REASONS.

eg:

46 XXXXGTON TCE

ROBINA QLD 4226

8) Data collected will then be saved in an .MDB file. Please see image 5 for the format to be used. Please note that the addresses need to be split into columns as shown in image 5.

- 'Owner Address Line1' is the first part of the address that was found in step 7

- 'Owner Address Line2' is the second part of the address that was found in step 7

- 'Field1' is the address collected in step 2

- 'Rental Suburb' is the suburb taken from 'Field1'

#########

I am open to suggestions. If any of this script is too difficult/expensive to write then please recommend a better option. Some parts can be manual if needed.

Please message me if you are interested. I will be ignoring automated bids so please show that you understand the job and explain how you will do it :)

Evner: Javascript, MySQL, PHP, Software Arkitektur, Web Skrabning

Se mere: write code transfer data sql server excel, collecting data websites php script, create script harvest data, extract data from webpage, scrape data from website python, extract data from website to excel, web scraping tutorial, html scraping, web scraping, how to download data from website using python, script to pull data from website, script read data websites, script scrape data websites, write java script code odd numbers, write script macro copy data website excel, write script copies data excel clipboard, showing data count field pivot script code, data scraping php script code, php script request data websites, script bot gather data websites

Om arbejdsgiveren:
( 41 bedømmelser ) Hawthorne, Australia

Projekt ID: #17977086

45 freelancere byder i gennemsnit $1180 på dette job

tarunmehan

Hello, Greetings for the day! I am ready to help you on an immediate basis to develop script that will search [login to view URL] using a custom search criteria. I have 5+ years of experience in PHP, Wordpress, Flere

$1200 AUD in 24 dage
(81 bedømmelser)
7.6
pointlogic

Hello, I always provide fastest results with quality. I have an experience of more than 10 years in web development and maintenance. I have in-depth knowledge of php, mysql, javascript , jquery, payment system integrat Flere

$750 AUD in 20 dage
(311 bedømmelser)
8.1
seaanddream

Hi, my name is Selim. I will write a java based bot with a sipmle UI for you to enter your search criteria and run it easily... I read your `[login to view URL]` project descriptions carefully before bidding. I checked Flere

$900 AUD in 7 dage
(253 bedømmelser)
7.7
mhmhz

Hi I checked your requirements and i can build fully automated scrapers that can do the search then utilize the addresses. and finally export data to Access DB. PS. the scraper will be a desktop application that Flere

$3000 AUD in 5 dage
(202 bedømmelser)
7.7
raindropsin

#Scrapping It seems like I need to create SCRIPT which scrapes data from that [login to view URL] real estate website and after gathering that data, need to store it and then also search that address with Flere

$2000 AUD in 20 dage
(106 bedømmelser)
7.7
AndreiMk

Hi, I visited [login to view URL] to see how it works and reviewed your screenshots. I would suggest to make it as a standalone Windows application for the following reasons: - if it is for your personal use, why ma Flere

$1250 AUD in 14 dage
(111 bedømmelser)
7.4
phpdeveloper100

I am expert in scrapping data from other website with all criterias as needed genraly , sometimes using proxies also , Please open Message box so that we discuss it in detail Expertise ================== - PHP Flere

$1186 AUD in 20 dage
(73 bedømmelser)
7.2
ineedWorkJob

Greetings sir, how are you today sir? hope fine. Sir, I have read your project details and i will develop a windows software that will scrap the data from your 1st website based on your set parameters on the sof Flere

$1000 AUD in 5 dage
(188 bedømmelser)
7.1
junkyfunky

Hello, I've read your project description and I want to tell you that I can write a semi automated script for you that will search [login to view URL] using a custom search criteria exactly as per your requirements. Flere

$750 AUD in 8 dage
(135 bedømmelser)
6.9
kyrbatow

Hi. I think, all steps are possible to implement. I can use phantomjs to use the same actions as real user. Also I can use http requests. For example, step on screeenshot 1. When you fill in address text, site retu Flere

$1000 AUD in 20 dage
(67 bedømmelser)
6.8
superman1987417

Greeting. Thanks for your job posting. I've read your job posting carefully and I am very interested in it. As a high skilled Scraping expert, I can do your job perfectly. I believe I possess the all required ski Flere

$1500 AUD in 20 dage
(74 bedømmelser)
6.9
bestit4u

hi Nice to meet you. I read your job posting and I am very interested. first, Thanks for your detailed description. I think you want to make a automation bot. Yes. I have a good experience in building automation Flere

$1250 AUD in 20 dage
(116 bedømmelser)
7.2
WebColorIn

All you need is a Chrome extension. Easy to use and customize, add features as well. I will build extension UI so its friendly to use. Will need API ( I will do this) that will post data to sql database if required. Flere

$1500 AUD in 25 dage
(54 bedømmelser)
6.7
luiswilliam

Hi, how are you? I'm talented web developer. I have completed lots of professional web projects successfully before. And I am continuously supporting all projects which I have done for clients.,.,,///;' However, I' Flere

$1250 AUD in 20 dage
(65 bedømmelser)
6.6
zekovicm

Hi there,I am Miljan,Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with scraping [login to view URL] ! I can start immediately a Flere

$1111 AUD in 10 dage
(68 bedømmelser)
6.8
polarjin2017

Hello? How are you? I have good skills in So I can complete your job in time. Hope to work with you. Thank you.

$800 AUD in 3 dage
(99 bedømmelser)
6.7
devi222

Hi Sir, I have scraped the [login to view URL] site before for buy, rent, sold and agents data. I can create a python 3.6.5 script(GUI) will allow you to keep the addresses in the text file or excel file as a list and h Flere

$1000 AUD in 5 dage
(110 bedømmelser)
6.5
schoudhary1553

I am expert who understands the value of time. I pride myself in my attention to detail. I am very hard working and aim to deliver in less time than quoted. I want to make you, my employer happy without changing my bid Flere

$1500 AUD in 20 dage
(61 bedømmelser)
6.4
Batista111

Hello, Similar website [login to view URL] Please have a look at my freelancer profile. https://www.freelancer.com/u/Batista111 As you can see I have worked on more than 100 projects includin Flere

$1250 AUD in 20 dage
(111 bedømmelser)
6.6
novepi

Hi there, I've checked each and every step individually, the requirements are quite clear. To be honest, I'm truly surprised to see that there's no serious measure for bot mitigation on [login to view URL] so this par Flere

$1000 AUD in 5 dage
(47 bedømmelser)
6.1