I gang

Python- Loops, data, csv

Scenario: Website has 100 categories, and roughly 50 amount of pages in each category. On each page, I'll be taking names. I have already created a working system that gets users from the first page, I need help with looping it to the next page, and than the next category when pages are ended for that category. From there to save all names to a .csv file column. Than we can remove the duplicates.

======================================================

category = 1

page = 1

web = ("wget [url removed, login to view]" + category + page)

output = [url removed, login to view](web)

names = [url removed, login to view]('name=')[1:]

for i in names:

print([url removed, login to view]('">')[0])

if [url removed, login to view]("[url removed, login to view]") == -1:

print "Set loop to go to next page"

else:

print "End of category pages, continue to next category.."

========================================================

^sample code, will not work as is but gives you a great idea.

Need someone who is proficient in python. If you can multi thread this be faster, let me know also.

Færdigheder: Linux, Python

Se mere: python programming loops, python csv data processing, import csv data sql express 2005, mysql update csv data, csv data feed creator, import yellowpage csv data, excel chart provide csv data, csv data feed web page, csv data compiler, create invoice import csv data, csv data capture, website csv data feed reader, mysql read delimited csv data, csv data dating profiles, import csv data sql server table, convert php python, modules python, python system programming, python client google apps, python twisted ldap, python hmi, stock control python, php create table csv data, python parse file database, email feedback loops

Projekt-ID: #14083327

Tildelt til:

Acetolyne

Hi I have years of python experience and have done some big projects that require multithreading. I can help you accomplish your goals and get everything working exactly as you want it. If you want to know more about m Mere

$15 USD på 1 dag
(0 bedømmelser)
0.0

23 freelancere byder i gennemsnit $33 for dette job

gangabass

I can create fast and efficient threaded Python spider for you. Just give me target site URL and output you want. Thanks. Roman

$55 USD på 1 dag
(110 bedømmelser)
6.2
$70 USD på 1 dag
(29 bedømmelser)
5.0
$40 USD på 1 dag
(29 bedømmelser)
4.7
deaswang

hello I have read your requirement. I can help you to finish this work. Can you provide more information about this project? Thank you

$50 USD på 1 dag
(14 bedømmelser)
4.3
leemilun

I understand about your requirements. I have 5+ years of Python, PHP programming experience. I think I can do your work perfectly. If you choose me, I will finish it in time and do my best. I will provide you one m Mere

$30 USD på 1 dag
(7 bedømmelser)
3.5
algispetkuns

can loop through pages , and can make multithreaded version either. But I have to look what you have there already, and check out target website for this tas.

$60 USD på 1 dag
(11 bedømmelser)
3.9
$25 USD på 1 dag
(12 bedømmelser)
3.7
MetaoriginLab

Hey We are a team of Technical Developers and have got expertise in such stuff. Ping me if you are looking for a quick resolution

$35 USD på 1 dag
(3 bedømmelser)
2.2
$25 USD på 1 dag
(2 bedømmelser)
1.0
LancerYang

Dear Sir/Madam, Confident in this project. I am experienced in Python and i have a lot experience for parsing data into excel spreadsheet. Thanks,

$25 USD på 1 dag
(0 bedømmelser)
0.0
teknogeek

A proposal has not yet been provided

$35 USD in 15 dage
(0 bedømmelser)
0.0
TusharCoder

I can give it a try. I like to do this type of work. And I will also try to optimize the solution for you....

$25 USD på 1 dag
(0 bedømmelser)
0.0
$55 USD in 2 dage
(0 bedømmelser)
0.0
$25 USD på 1 dag
(0 bedømmelser)
0.0
techlogics4

Dear Prospect Hiring Manager. Thank you for giving me a chance to bid on your project. i am a serious bidder here and i have already worked on a similar project before and can deliver as u have mentioned I have Mere

$28 USD in 6 dage
(0 bedømmelser)
0.0
$25 USD på 1 dag
(0 bedømmelser)
0.0
jamdarvikas

I have 4 years of expereince in python. I have worked in Core Python libaries, python web development. My skill are : Python2.7, Linux,HTML,CSS,Bootstrap,JQuery,REST,GIT,SVN. I would like to hear more from you for t Mere

$25 USD på 1 dag
(0 bedømmelser)
0.0
Zubairashraf123

Hi I am Zubair, expert in web scrapping, Data mining, and web research. I have gone through your project and I am interested in your project. We can have a detailed discussion on the project over chat… Thanks and Rega Mere

$10 USD på 1 dag
(0 bedømmelser)
0.0
techfinity3

Dear Prospect Hiring Manager. Thank you for giving me a chance to bid on your project. i am a serious bidder here and i have already worked on a similar project before and can deliver as u have mentioned I have Mere

$25 USD på 1 dag
(0 bedømmelser)
0.0
hi7technologies

sir i worked on many python assignments and projects i can do this task easily if you hire me please. thanks hi7

$25 USD på 1 dag
(0 bedømmelser)
0.0