Python- Loops, data, csv

Scenario: Website has 100 categories, and roughly 50 amount of pages in each category. On each page, I'll be taking names. I have already created a working system that gets users from the first page, I need help with looping it to the next page, and than the next category when pages are ended for that category. From there to save all names to a .csv file column. Than we can remove the duplicates.


category = 1

page = 1

web = ("wget [url removed, login to view]" + category + page)

output = [url removed, login to view](web)

names = [url removed, login to view]('name=')[1:]

for i in names:

print([url removed, login to view]('">')[0])

if [url removed, login to view]("[url removed, login to view]") == -1:

print "Set loop to go to next page"


print "End of category pages, continue to next category.."


^sample code, will not work as is but gives you a great idea.

Need someone who is proficient in python. If you can multi thread this be faster, let me know also.

Evner: Linux, Python

Se mere: python programming loops, python csv data processing, import csv data sql express 2005, mysql update csv data, csv data feed creator, import yellowpage csv data, excel chart provide csv data, csv data feed web page, csv data compiler, create invoice import csv data, csv data capture, website csv data feed reader, mysql read delimited csv data, csv data dating profiles, import csv data sql server table, convert php python, modules python, python system programming, python client google apps, python twisted ldap, python hmi, stock control python, php create table csv data, python parse file database, email feedback loops

Om arbejdsgiveren:
( 15 bedømmelser ) New Jersey, Canada

Projekt ID: #14083327

Tildelt til:


Hi I have years of python experience and have done some big projects that require multithreading. I can help you accomplish your goals and get everything working exactly as you want it. If you want to know more about m Flere

$15 USD på 1 dag
(1 bedømmelse)

22 freelancere byder i gennemsnit $34 på dette job


I can create fast and efficient threaded Python spider for you. Just give me target site URL and output you want. Thanks. Roman

$55 USD på 1 dag
(119 bedømmelser)
$70 USD på 1 dag
(30 bedømmelser)
$40 USD på 1 dag
(29 bedømmelser)

can loop through pages , and can make multithreaded version either. But I have to look what you have there already, and check out target website for this tas.

$60 USD på 1 dag
(19 bedømmelser)

hello I have read your requirement. I can help you to finish this work. Can you provide more information about this project? Thank you

$50 USD på 1 dag
(17 bedømmelser)

I understand about your requirements. I have 5+ years of Python, PHP programming experience. I think I can do your work perfectly. If you choose me, I will finish it in time and do my best. I will provide you one m Flere

$30 USD på 1 dag
(8 bedømmelser)

i am post doc research my research area is about computer vision and robotics, I am expert on python, i have many academic papers about it. you can check my google scholar page here is [login to view URL] Flere

$30 USD på 1 dag
(7 bedømmelser)
$25 USD på 1 dag
(3 bedømmelser)
$25 USD på 1 dag
(16 bedømmelser)

Hey We are a team of Technical Developers and have got expertise in such stuff. Ping me if you are looking for a quick resolution

$35 USD på 1 dag
(3 bedømmelser)

Hey there, I am willing to work on this project. More discussions over chat. "I can start work right away." Thanks for looking forward to my proposal.

$34 USD på 1 dag
(2 bedømmelser)

i have already worked for multithreaded content fetch from the websites. The application will provide an easy interface for the project holder

$25 USD in 2 dage
(1 bedømmelse)
$25 USD på 1 dag
(0 bedømmelser)
$25 USD på 1 dag
(0 bedømmelser)
$55 USD in 2 dage
(0 bedømmelser)

I can give it a try. I like to do this type of work. And I will also try to optimize the solution for you....

$25 USD på 1 dag
(0 bedømmelser)

Hi I am Zubair, expert in web scrapping, Data mining, and web research. I have gone through your project and I am interested in your project. We can have a detailed discussion on the project over chat… Thanks and Rega Flere

$10 USD på 1 dag
(1 bedømmelse)

A proposal has not yet been provided

$35 USD in 15 dage
(0 bedømmelser)

Dear Sir/Madam, Confident in this project. I am experienced in Python and i have a lot experience for parsing data into excel spreadsheet. Thanks,

$25 USD på 1 dag
(0 bedømmelser)

sir i worked on many python assignments and projects i can do this task easily if you hire me please. thanks hi7

$25 USD på 1 dag
(0 bedømmelser)