Web crawler for downloading images from [url removed, login to view] based on some parameters (search term, size and date).

The web crawler should be written in python and run on Windows from the command line.

The command line will have 2 parameters:

1. A name of a CSV file that configures which images to download.

2. An output directory (for saving the downloaded images).

Each line in the CSV configuration file will specify one search definition, and include:

1. search term (e.g.: "curtain", "hand", "man with glasses" etc.)

2. start date

3. end date

4. minimum size (if an image doesn't exists in this size - get the next bigger size)

5. max number of images

For each such line (defining a search), the crawler will open a sub-directory in the output folder,

and put the images for this search there.

Next to each downloaded image, the crawler will create a .txt file with the name of the image

(with a .txt extension), and in this text file it will put:

1. Image name

2. Image date (YYYY-MM-DD)

3. Size in pixels

4. Flickr tags

5. Flickr description

6. The search term used


1. The user should be able to stop the crawler, and then restart from it from the same state it was when stopped

(we intend to schedule it to run only during nights and weekends, and then pause during work days).

2. The crawler should run in several threads, in order to accelerate the performance.

Færdigheder: Python

Se mere: flickr image crawler, crawler flickr, web crawler images flickr, web-crawler, flickr crawler python, python download file, download file python, python web, flickr, python create file, python file create, python download, python text image, web crawler python, max extension, python csv text, command web, search image folder, search python, python restart, search download images, max file extension, csv images, image python, user term

Om arbejdsgiveren:
( 2 bedømmelser ) Israel

Projekt-ID: #4065396

Tildelt til:


Hello, I've been working professionally with Python for about five years now and have substantial experience with web scraping and general application development. Please check your private message box for a more in-de Mere

$500 USD in 14 dage
(19 bedømmelser)

15 freelancers are bidding on average $461 for this job


hi, dear I am expert in python, expert in scripting and web scrapper. I can do this easily. more details in bmp. thanks

$490 USD in 14 dage
(17 bedømmelser)

I can help in your project, please check PMB and our ratings/reviews to get idea of our experience. Please let me know if you have any queries.

$250 USD in 5 dage
(3 bedømmelser)

Interested in this project.

$300 USD in 5 dage
(9 bedømmelser)

Hi, I'm interested.

$600 USD in 17 dage
(1 bedømmelse)

Sir, I have done many similar projects before. I can get this crawler coded for you quickly and efficiently. If you want, I can code a compact GUI with a start/stop button to accompany the crawler. I am ready to begin Mere

$125 USD in 7 dage
(8 bedømmelser)

Hi Ser. I've read your requirements, and I can deliver application You need. I'm an expert in Python programming, and this task will be easily completed. For the start, I've written test application that does most of Mere

$250 USD in 5 dage
(1 bedømmelse)

I can deliver the crawler you require for you. please check PMB

$1500 USD in 7 dage
(2 bedømmelser)

We are the group of the experts to satisfy you with the quality service. Please send the full details of the project to proceed further. Thanks and Regards.

$1000 USD in 20 dage
(0 bedømmelser)

Hello, thank you for the chance to bid on this project for you. I am a professional computer programmer with over 10 years experience. I would love the chance to develop a professional application for you.

$225 USD in 7 dage
(0 bedømmelser)

Hello, I'm ready to start the work.

$800 USD in 20 dage
(0 bedømmelser)

Expert here..Lets start...

$150 USD in 7 dage
(0 bedømmelser)

Hi, I'm a professional developer. I can do this project for you.

$200 USD in 10 dage
(0 bedømmelser)

Hello, I am highly interested in this kind of project. I can get the job done.

$400 USD in 20 dage
(0 bedømmelser)

I have done this kind of project before in Python. I know how to use multiprocessing/gevent to achieve parallelism and asynchronous I/O (fetch multiple Flickr results at once, make smart use of computer resources).

$500 USD in 5 dage
(0 bedømmelser)

I'm an experienced system administrator working with similar scripts daily. I'll be glad to do this for you.

$120 USD in 6 dage
(0 bedømmelser)