Lukket

Scrape API

Program written in whatever language you want that will run on a linux server, communicate with a mysql database, support multithreading, and make use of multiple ips.

1. Write a class to communicate with an HTTP XML api

1. Use this class to scrape listings off the website

1. Support configurable scraping intervals and randomize those intervals to avoid detection

2. Make use of multiple ips on a linux server for the web requests. Website has a minimum polling rate of 2 minutes per ip. Use multiple ips to poll every ~5 seconds.

3. Use pagination.

4. Use regex to extract a value

5. Insert listings into a mysql database

6. Create algorithm to link duplicate listings by the same user together in database

7. Create algorithm to link users with multiple accounts together in database

8. Create algorithm to compare listing prices to local database

9. Compare listings against a configurable table of criteria

2. Create methods to list/edit/post/delete listings on website

3. Create methods to send/receive/list messages on website

1. Insert all conversations into local mysql database

2. Automatically send message with preconfigured text. Attempt to exact answers from any replies

4. Once daily check listings in local database against website for any changes. Insert any changes in a table

5. Integrate Plivo to send/receive text messages

1. Send message with preconfigured text. Attempt to exact answers from any replies.

This program needs to have clear and concise code. Please do not bid unless you are very experienced. I also need a website front end designed and possibly an iPhone app. If you are able to do this as well let me know.

Færdigheder: HTML, Linux, PHP, Python, Software Arkitektur

Se mere: front end mssql database, front end view database, flags delete post, bulk delete post wordpress, front end excel database

Om arbejdsgiveren:
( 3 bedømmelser ) Regina, Canada

Projekt-ID: #12549271

55 freelancere byder i gennemsnit $1214 for dette job

mituld

Hi I work towards providing reliable, relevant and robust IT solutions at most competitive prices to my customers. I ensure 100% customer satisfaction so lets start Thanks

$927 CAD in 28 dage
(353 bedømmelser)
8.1
Envire

We are your perfect outsourcing partner. We have many years of experience in writing web scrapers. Last project we worked on was a movies database, where we had to scrap existing information of more than 13000 movies, Mere

$1200 CAD in 20 dage
(27 bedømmelser)
7.2
sushant003

Dear Sir/Madam, We are in top 25 company in freelancer.com , we made lots of system and as well also earned more then 1000000+ USD and give us one chance then you will know our level of expertise and quality wor Mere

$1111 CAD in 20 dage
(168 bedømmelser)
7.4
digitalaptech

We already work on a product listing and price comparison website, kindly have a look on our similar kind of job and let me know your views: http://www.vergelijkprijs.nu Here, I am sharing my main tasks what I ne Mere

$1250 CAD in 25 dage
(46 bedømmelser)
7.4
$1546 CAD in 20 dage
(95 bedømmelser)
7.1
mmadi

Dear Client, Greetings from Flowgica technologies, I have experience with these skills. We do have similar experience doing something similar to yours therefore I am looking forward to discuss more about more details a Mere

$1050 CAD in 24 dage
(41 bedømmelser)
6.9
AppXonedotCom

Hi I am Mustafa from Appxone. I am interested to accomplish your project of hiring people like freelancer.com. I will take care of your project from start to end and source code will be provided. My profile:   Mere

$1263 CAD in 20 dage
(47 bedømmelser)
7.1
webbookstudio

Hello, my name is Olya. I represent Ukrainian IT Company «Webbook». We provide website design and web and app development services for organizations, public and government institutions, company or private web-pages. Mere

$1200 CAD in 20 dage
(63 bedømmelser)
7.3
eagleblackdesign

Hello! We are a professional team of web developers with huge experience in using python for custom webapps based on django and odoo. We are available and will be happy to help you with the project. Looking forward Mere

$1350 CAD in 25 dage
(39 bedømmelser)
6.8
malviyamanish

Dear Client , We gone through project description We are Really interested to do work with you , We are Web & Software development company having more than 8 year experience in Software development we totally co Mere

$1250 CAD in 20 dage
(179 bedømmelser)
7.2
mike199

My name is Mike and I’m from UK. I work with individual clients and also provide outsourcing services for a number of UK and USA based agencies. Your project description sounds interesting to me and I do have skills & Mere

$1250 CAD in 20 dage
(47 bedømmelser)
6.9
prashushinde9

Hello, I understood the initial scope of this project. Although i want to discuss further this job in order to prepare the final concept for this project. After Complete discussion over the call or in chat, i wi Mere

$1546 CAD in 20 dage
(60 bedømmelser)
7.1
maxpl

Hi, Im web developer from Poland, I have 5+ years of experience in webdesign/ development, WordPress, OperCart, E-commerce, obile Development, SEO and I have done number of projects. I can handle project indep Mere

$888 CAD in 10 dage
(36 bedømmelser)
6.7
suhelshaikh

I have gone through the requirement and still need some more brief of the project. I have more than 6 years of experience in skills like Ecommerce, Enable Shopping cart, Payment and API Implement/Integration, Javas Mere

$842 CAD in 20 dage
(35 bedømmelser)
6.5
BitLabs

Hello, I have gone through your outsourced requirements "Scrape API" and have analyzed that I have right skills (HTML, Linux, PHP, Python, Software Architecture) to execute your esteemed project. I will complete Mere

$1229 CAD in 365 dage
(113 bedømmelser)
6.4
SevenStarInfo

Hello ! We want to discuss about your project as we have experience in it. What Differentiates us from the other freelancers : # Experience of more than 5 years in Unity 3D, Xcode, CoCoa 2d, Phonegap and major Mere

$1500 CAD in 20 dage
(62 bedømmelser)
6.8
szymszteinsl

Hi! I am professional C/C++/C#/Java/Python programmer. I can do this project with highest quality! Best Regards, Szymszteinsl

$1500 CAD in 15 dage
(55 bedømmelser)
6.3
bhaveshkhatarani

Hi, We are go through your brief and can see that you would like to build an application. We make a detail review of your given description and understand it very well. We will build with all features as you requ Mere

$1250 CAD in 20 dage
(63 bedømmelser)
6.2
keithn

Hello, Sounds like a pretty complicated project, what website is this going to be scraping/posting/using? Also, when you mentioned website front end, did you just mean a control panel for this or an actual public Mere

$1400 CAD in 20 dage
(65 bedømmelser)
6.3
richestuser

Hello, Hope you are doing Good. I am available to start asap. Please lemme know more details about the project. I am 8+ year experienced in Web Designing as well as Development and have linux experience too. Have Mere

$1250 CAD in 20 dage
(78 bedømmelser)
6.1