Lukket

Python Script to Download

I have a set of urls that are like this:

[url removed, login to view]

(which redirects to [url removed, login to view])

The valid values for file are not incremental. I have a list (in the millions) of valid ones. I can prepare the list as a text file, sqlite, whatever we want. The idea is to start the script in a threaded manner, download 10,000 files, zip them, download another 10,000, zip them, and so on until the list is exhausted.

:-)

Want to get this done asap.

Færdigheder: MySQL, Python, SQLite

Se mere: list get python, get python asap, python download file, download file python, python script, download files list urls, python domain, python download, download zip files, python script download, jsp mysql list, mysql jsp list, script convert text csv using python, mysql com pdf, python script convert text file csv file, jsp list mysql, jsp asap, pdf python, python sqlite, sqlite python, mysql sqlite, python script convert text, script text pdf, Mysql python, script download

Om arbejdsgiveren:
( 2 bedømmelser ) Evansville, United States

Projekt-ID: #6025530

24 freelancers are bidding on average $30/hour for this job

superior5

I am expert in desired skills for this project and have done similar tasks already. Please get back to me, so I can show you some of the work I have done. I will not be asking for any upfront only pay me when you are s Mere

$38 USD / time
(53 bedømmelser)
7.3
srinichal

I am an expert in delivering custom scripts and willing to discuss further about the project specifications.

$52 USD / time
(32 bedømmelser)
6.0
NTechcorporate

Dear Client I hope you are doing well! We have gone through your requirement and we understand that you are looking for highly skilled, qualified, and experience Python expert for this project. We have worked Mere

$30 USD / time
(10 bedømmelser)
5.5
alinawaz88

A proposal has not yet been provided

$47 USD / time
(14 bedømmelser)
5.2
XmuFive

Hi, sir: this is a simple case for me. I can assist u with this, check my past feedbacks. And i think fixed price will be a better choice.(not waste your money :) ). You just need to give me the site url, and the f Mere

$33 USD / time
(6 bedømmelser)
4.6
tinkamako

Hi, I can work on this now. I will do the jobs for a fix price of $60usd. I will make a python script with a queue to process a plain text with your url and I will make each thread downloads up to 10000 files and zi Mere

$25 USD / time
(5 bedømmelser)
3.4
KennyLedet

Hey, how's it going? I have over 7 years of solid Python experience under my belt, and my best and most used area of expertise within it has been web crawling/scraping and automation, including multithreaded soluti Mere

$25 USD / time
(2 bedømmelser)
2.5
grimeton

Hello, shouldn't be a problem. What will be done with the urls that failed to download? Written to another file/database/whatever to try later? Any authentication necessary? KR, Oliver

$27 USD / time
(1 bedømmelse)
1.9
priyamehtag

I am highly interested in this project, I can complete the project as per your expectation and withing the deadline. I am having vast exposure of the technologies you mentioned. I am open to met your budget and deadlin Mere

$28 USD / time
(2 bedømmelser)
1.8
karthip26

Hi, I have experience in this type of work. Kindly give the information so that we can start Thanks in advance Karthi palanisamy

$25 USD / time
(3 bedømmelser)
1.2
cplaiasu

Hello, I can write this script for you today. It will split the list in smaller of 10000 entries and after it will download to a folder1 first 10000 files, zip the folder1, delete folder, start again again for fold Mere

$33 USD / time
(1 bedømmelse)
1.0
iticus

Hello, This looks like a very interesting project. I have extensive experience with HTTP libraries under Python (I have used urllib2, tornado, requests, mechanize) and with threaded programming (especially the mult Mere

$30 USD / time
(1 bedømmelse)
0.6
beej0y

HI, after checking the initial requires, i am here for your kind concern that some people bid with $144 or $5550 which is default in system and totally a fake estimate. They increase amount after you knock them lol ... Mere

$27 USD / time
(3 bedømmelser)
0.0
sathishpendota

A proposal has not yet been provided

$25 USD / time
(0 bedømmelser)
0.0
nhayyal

Hello, I have around 9+ yrs of experience in perl/python/C/C++/C++11. I worked in reputed companies like IBM, Alcatel-Lucent. etc. I wish to take up this project and deliver it on time. Thanks Nagaraj

$41 USD / time
(0 bedømmelser)
0.0
sudofly

I have the script to do the same work. I am the first time to get a work in [url removed, login to view], so I ask for very very little pay.

$25 USD / time
(0 bedømmelser)
0.0
JohnDeeney

This should be a very quick project. I could easily have it done by Friday. I have experience with Python and threading.

$27 USD / time
(0 bedømmelser)
0.0
takemitsu

Sir , I have already had a python script for automatically downloading urls(for scratch a ebook site, links are listed in file), I can modify it to fit your demand ASAP Thank you:-)

$27 USD / time
(1 bedømmelse)
0.0
ferchault

Hi, starting from the text file is enough. Implementing parallel downloads with python is straight-forward. I would start multiple workers to get their own set of 10,000 files and start downloading them. This way yo Mere

$25 USD / time
(0 bedømmelser)
0.0
pritishkamath

I am a Computer engineer. If accepted, this will be my first job on freelancer. But trust me when I say that I know what I am doing and your project is very simple to complete. It will take me less than an hour to Mere

$25 USD / time
(0 bedømmelser)
0.0