Lukket

Price Crawler for E-Commerce websites

We need to do the following :

Collect the prices of all items being sold on 30 different e-commerce websites daily.

Once collected, these prices should be? collated so as to allow an individual to easily see what different merchants are charging for the same product.? ?

The daily deliverable will need to be in consistent form and format as agreed upon at the start of the project.?

We are agnostic to the means of accomplishing this task.

The deliverable can be the code that accomplishes the above defined task - with detailed instructions for how to setup and configure on our servers here. Alternately, if its possible, it could also be the daily report.?

If the latter, we can work out an alternative payment scheme by month or by day that allows for continued delivery of the report so long as the information in it remains accurate.

## Deliverables

List of websites to crawl :

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

Walgreens?

CVS

All the hayneedle baby sites

Freshdirect

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

[url removed, login to view]

Vitamin Shoppe,?

Beauty Encounter

[url removed, login to view]?

iHerb

Vitacost

Drugstore

Skinstore

Follica

Ulta

Sephora

[url removed, login to view] (amazon carried)

Target

Walmart

The last three are much bigger than the previous 27 in terms of the numbers of products. I do already have a ruby based crawler that can grab prices from Target and Walmart, so if these seem like too much of a challenge, we can manage.

Some more details on what we need to allow you to fully create a bid.

We do not need a website - we just need the reports provided in complete format.

The fields that we need are as follows (Pipe Delimited)?

**Product Detail Table :**?

**ID | Title | Quantity | Price | Avail | ProductURL| CategoryName | CategoryURL? **

ID = Any identifier shown. If there are more than one shown then grab both, and create an additional field for that website.

Title = The Product Name/Title?

Price = Price of the product?

Quantity = Some cases, such as [url removed, login to view] [url removed, login to view] etc. indicate if it is a 12 pack, has 60 capsules etc. This is important information as it is likely that the same product also comes in different sizes.?

Avail = Availability of the Product (Ships today, in stock, out of stock etc.)?

ProductURL = the URI to the product Detail page on the e-commerce website.?

Category Name = The leaf level category that the product belongs to.?

CategoryURL = the URL to the above Category Name.?

Not all these fields are possible to grab from all websites, but the Identifier, the Title, Price, Availabity, and ProductURL are usually available.?

Here is an example of that data from [url removed, login to view]

**VS-4202 / 1619196 | E-200 Basics | 60 | $2.99 | In stock. Ships within 24 hours. | [url removed, login to view] | Vitamin E D'Alpha | [url removed, login to view]? **

Our preferred technology choice is Ruby scripts etc. but as mentioned the deliverables are all that we truly care about. If it works, we will accept any technology choice.?

In addition to the above, we would need one more table, which linked the various products together correctly...

An **Example** of this might be as follows :

**ID | [url removed, login to view] ID | [url removed, login to view] ID | [url removed, login to view] ID |...**

**1 ? | VS2003 | 2345789981208 | UL234**

etc.

However, if there was another way to achieve this, we would be interested.

This last part will most likely involve some manual effort. This manual effort will likely have to be extended with each crawl as new products are added, and removed etc.

Feel free to give us a 'monthly' bid that will involve delivering these reports to us daily if that is the approach you would like to take. Since some of you are single member code-writing teams, this is by no means a requirement, and we will accept the code that accomplishes the above today, and attempt to extend it ourselves as and when needed.

When you bid, please let us know which format you are hoping to deliver your work in - the reports, daily after you've had them collated or the code that delivers the prices from each website, and you are leaving the collating up to us. The former is preferred, but the latter is acceptable.?

Also, since this is meant to be a long term project - over a course of a year, we would like to continue to work with the same team to iterate, and build out successive versions of this.

Evner: Lidt af Hvert, Dataindførsel, Ingeniørarbejde, MySQL, PHP, Projekt Ledelse, Software Arkitektur, Software Testning, Web Hosting, Hjemmeside Management, Hjemmeside Testning

Se mere: amazon walmart, www walgreens com, www walgreens, www ulta com, www toysrus com, www freshdirect com, www drugstore com, www buybuybaby com, writing out numbers, writing numbers 1 20, writing numbers 1 10, websites prices, websites net, websites like up work, walgreens .com, walgreens com, us pipe, ulta com, the vitamin shoppe, technology websites

Om arbejdsgiveren:
( 9 bedømmelser ) United States

Projekt ID: #3315171

19 freelancere byder i gennemsnit $1486 på dette job

canlevw

See private message.

$4250 USD in 14 dage
(63 bedømmelser)
7.0
eye4tech

See private message.

$3102.5 USD in 14 dage
(43 bedømmelser)
7.0
temp

See private message.

$1700 USD in 14 dage
(29 bedømmelser)
6.0
incredible4u

See private message.

$1275 USD in 14 dage
(43 bedømmelser)
5.5
codelabsl

See private message.

$637.5 USD in 14 dage
(66 bedømmelser)
5.1
miesterphp

See private message.

$1105 USD in 14 dage
(15 bedømmelser)
5.2
moamenm

See private message.

$2550 USD in 14 dage
(31 bedømmelser)
5.0
callosmart

See private message.

$3859 USD in 14 dage
(6 bedømmelser)
4.8
onlinechamp

See private message.

$3419.55 USD in 14 dage
(23 bedømmelser)
4.2
autotesting

See private message.

$425 USD in 14 dage
(5 bedømmelser)
3.8
visionsol

See private message.

$425 USD in 14 dage
(12 bedømmelser)
3.7
chad101vw

See private message.

$1020 USD in 14 dage
(8 bedømmelser)
2.4
coneac

See private message.

$595 USD in 14 dage
(5 bedømmelser)
2.3
socialwebca

See private message.

$1000.45 USD in 14 dage
(2 bedømmelser)
0.5
webgoldsolutions

See private message.

$782 USD in 14 dage
(2 bedømmelser)
0.0
amitusaineu

See private message.

$1530 USD in 14 dage
(0 bedømmelser)
0.0
prabhin

See private message.

$850 USD in 14 dage
(0 bedømmelser)
0.0
rupertgvw

See private message.

$1147.5 USD in 14 dage
(0 bedømmelser)
0.0
macsolutionsvw

See private message.

$595 USD in 14 dage
(0 bedømmelser)
0.0
webdevelopesllph

See private message.

$680 USD in 14 dage
(2 bedømmelser)
0.0