Lukket

Scrape newest real estate listings with Ruby and Active Admin as CRUD -- 2

We want to scrape real estate listings of 3 different websites. More websites will be added later. Ideally we can add more websites by configuration (ideally we can configure the regex for each variable). We will provide a briefing with all values marked on the respective listings pages.

The goal for the tool is to scrape the newest listings so we can check them and if needed, post them on our own platform (of course with a reference to the source) instead of copy-paste them by hand.

The scraper should have the following behavior:

- 1st we scrape the index/result pages to find newly added listings

- 2nd we visit and scrape individual listings

The scraper should not scrape more than 5 listings per hour per website to prevent unnecessary load and the scraper from being banned.

Scraper has to be developed in Ruby (or RoR) and we will use Active Admin as CRUD for the data management. Database will be PostgreSQL.

You should also be able to set this up on Amazon AWS (EC2/RDS/S3). We might also integrate the tool you develop into an existing setup.

In addition you know about using proxies and can implement that.

Finally, please add the result of 6+5=? to your bid, so we know you're not a bid bot.

Evner: PostgreSQL, Ruby, Ruby on Rails, Web Skrabning, Amazon Web Services

Se mere: scraping real estate listings, populate database real estate listings, real estate listings website backend, joomla real estate listings, fast loading real estate listings aspnet, populate website real estate listings, real estate portal login password admin, google maps real estate listings project, elgg real estate listings, real estate listings import table, real estate listings, free real estate listings intergration, google maps real estate listings php, drupal real estate listings, real estate listings feeds, scrape real estate listings, scrape sites real estate listings, active real estate listings, Scrape images and text from proprietary database of real estate listings

Om arbejdsgiveren:
( 26 bedømmelser ) Zollikon, Switzerland

Projekt ID: #24081228

24 freelancere byder i gennemsnit $595 på dette job

seaanddream

result = 11 Hi, my name is Selim. I am from UK. I read your "Scrape newest real estate listings with Ruby and Active Admin as CRUD --2" project descriptions carefully before bidding. I checked your requirements as well Flere

$550 USD in 7 dage
(286 bedømmelser)
8.0
zekovicm

11 Hi there,I am Web Scraping expert from Bosnia & Herzegovina,Europe. What are the URLs of those 3 websites ? Please feel free to initiate the chat so that we can discuss further details. Thank you for taking the tim Flere

$650 USD in 14 dage
(123 bedømmelser)
7.4
srinichal

You can bank on me for the expertise in scrapers and crawlers I have. Having delivered many such similar projects in the past, I look forward to discuss and start the project inline to your requirements

$500 USD in 7 dage
(66 bedømmelser)
6.7
TheScorpion93

result = 11 Please, contact me and send me the link to the site so I could make a FREE SAMPLE Please, contact me and send me the link to the site so I could make a FREE SAMPLE Hi there, I’ve read your brief, We are a Flere

$500 USD in 7 dage
(70 bedømmelser)
6.4
arvindkushwah9

Dear, I have 7+ years experienced in Web Development. When I read this job I feel very excited to be a part of your project and share my great experience in software development. Specialties: Ruby on Rails, RESTful Flere

$500 USD in 7 dage
(78 bedømmelser)
6.8
maysam

6+5=11 I have done this before for an Australian client, this is not very trivial and if you are not careful your IP would eventually get banned from their servers

$2000 USD in 30 dage
(20 bedømmelser)
6.2
MezbahAlam

6+5=11 Hi, i'm good at web scraping . Last year, i created private ruby gem for scraping specific site. Experienced on ActiveAdmin Gem , Postgresql database. Also I can deploy it on EC2 . Thanks, Mezbah Alam

$500 USD in 7 dage
(53 bedømmelser)
6.2
abhisyc70

Hi, I will build the scraper in Java(although Ruby is not a problem. I have expertise building scrapers in Java). I will set up cron jobs on EC2 instance to trigger the "NEW LISTINGS" scraper each day and "INDIVIDUA Flere

$500 USD in 6 dage
(9 bedømmelser)
5.8
rubyonrailsdev21

Dear Client , Hope you are doing well, I have reviewed the job post and would like to join you as a fullstack ROR developer. I am full time and immediately available for this job (40 hrs in a week ) and having excellen Flere

$250 USD in 5 dage
(42 bedømmelser)
5.9
nikhil929

11 Greetings, we have relevant experience in scraping Real estate website using python and scrapy and getting the output in the desired format as well Please share us the target website and the key fields Flere

$500 USD in 7 dage
(10 bedømmelser)
4.4
mquesada90

11 Hello Thank you for your posting. I am Marvin who has a lot of experiences in scraping. I am familiar with R programming and AWS service, too. In scraping, we should bypass the sites' limitation so proxy used to be Flere

$500 USD in 7 dage
(1 bedømmelse)
3.4
azam72

I have gone through the above-mentioned details very well. I have got plenty of experience in ruby on rails, web scraping, amazon web services, postgresql, ruby kinds of works and I can assure you that I can reach your Flere

$456 USD in 7 dage
(1 bedømmelse)
3.2
yushuai117

11 Hi, I can do that and have rich experience to scrape data from websites. Please contact me via private chat. Regards, Fan

$500 USD in 7 dage
(1 bedømmelse)
1.4
satarupghoshal

Upon reviewing your requirements carefully, as per my best knowledge and belief, you need Enterprise Resource Planning(ERP)/CRM application. Our customization and Integration of Management Business software ensures tha Flere

$250 USD in 7 dage
(0 bedømmelser)
0.0
gargankit642

Nice to meet you I am an Amazon Cloud Architect for the web infrastructure serving 90 million page impressions and 12 TB Internet traffic per month. The AWS services I use are EC2, ELB, MySQL RDS, VPC, CloudFront, Elas Flere

$637 USD in 9 dage
(0 bedømmelser)
0.0
Yaserove

Hi. thanks for your posting. I have read your job description very carefully. I have rich experience in web scrapping. I am very interested in your project. I can start working now. If you hire me, I'll do my best for Flere

$500 USD in 7 dage
(0 bedømmelser)
0.0
realestate9898

Hello, I can work with WordPress instead which is more user friendly and SEO organized. ***If you need a web scrapper you will need to get like Franchise solution: [login to view URL] ***Also Importer/Ex Flere

$500 USD in 7 dage
(0 bedømmelser)
0.0
jakostam027

11 Hi, there. How are you? I have just read your post carefully and I think I can work for you. Because your job is very suitable for my skill set. I think your job is requiring only experienced and skilled developer. Flere

$1300 USD in 10 dage
(0 bedømmelser)
0.0
ssuet123

11 Hello there, Hope you are doing fine. I am a full-stack web developer with more than 6 years of experience in web scrapping Ruby and PostgreSQL. I can develop a perfect tool for you that will scrape the data from 3 Flere

$250 USD in 2 dage
(0 bedømmelser)
0.0
AITSoft

Hello there, How are you doing? Just saw your project posted. I read the brief details and I felt I could help you with it. Lets start the chat and discuss it in detail. Please check my porfolio: My Portfolio: https:/ Flere

$750 USD in 22 dage
(0 bedømmelser)
0.0