Daily Trending Products Detection Program

Lukket Opslået 3 måneder siden Betalt ved levering
Lukket Betalt ved levering

The goal of this project is to develop a program that can identify trending products on a daily basis from specific e-commerce websites (the list will be provided later). The program should retrieve relevant product data, analyze it to identify trending products, and then output the results in a useful and structured format.

**Key Responsibilities**:

1. **Data Acquisition**: You are responsible for developing a system that retrieves product data from the provided list of e-commerce websites. This may involve web scraping or API integration, depending on what each platform allows and provides. Python, with libraries such as BeautifulSoup and requests for web scraping, or requests alone for API integration, is our preferred language for this task.

2. **Data Analysis**: The program should analyze the retrieved data to identify trending products. A product's trendiness can be determined by factors such as a high number of recent sales, a spike in social media mentions, or a rapid climb in the sales rank. Tools like pandas, NumPy, or SciPy in Python can be used for this task.

3. **Automation**: This entire process needs to run automatically on a daily basis. Depending on the deployment environment, this can be accomplished by setting up a cron job, using a task scheduler, or other methods.

4. **Output**: The program should output the results in a clear and structured format. This should be a CSV file, a JSON file, and a database.

5. **Error Handling and Logging**: It's crucial to handle potential errors gracefully so the program can recover or, at the very least, log the error for troubleshooting. Logging mechanisms need to be implemented throughout the program.

**Required Skills**:

1. Python programming

2. Familiarity with web scraping libraries such as BeautifulSoup, Scrapy, etc.

3. Experience with API integration

4. Data analysis and manipulation with pandas, NumPy, or similar libraries

5. Task automation and scheduling

6. Logging and error handling

7. Familiarity with JSON, CSV, or databases for data storage and output


1. Source code of the program.

2. Documentation detailing how to run, maintain, and troubleshoot the program. The documentation should also describe the data flow, and explain the logic behind how trending products are determined.

3. A sample output of the program.

**Additional Notes**:

1. All web scraping should respect the target website's terms of service and [login to view URL] files, and comply with all relevant laws and regulations.

2. While developing, always consider the load you're putting on the target websites and design your program in such a way that it minimizes the potential disruption.

3. Ensure the program is designed with scalability and maintainability in mind.

4. Communication is key. Regular progress updates are expected.

Datasøgning PHP Python Software Arkitektur Web Skrabning

Projekt ID: #36706095

Om projektet

25 bud Remote projekt Aktiv 2 måneder siden

25 freelancere byder i gennemsnit $595 timen for dette job


Hello, Warm Greetings! I am pretty sure I can produce high-quality and perfect results for your project. By using Python, I used to make AI engines, BOT, Web Scraping Tools, and so on. PHP and Python are my majors, so Flere

$750 USD in 7 dage
(196 bedømmelser)

Hello, With over 10 years of industry experience, I offer expertise in web scraping, Python programming, and data mining. I specialize in efficiently extracting data from websites, automating data collection processes Flere

$900 USD in 10 dage
(76 bedømmelser)

I'm a senior Python & ML developer and owner & founder of Dedeoglu Dev Company. Kindly send me a message to get in touch with me, Thanks, Yusuf

$500 USD in 7 dage
(26 bedømmelser)

<<< السلام عليكم >>> I'm sure that I can help you. I'm artificial intelligence engineer experienced in Data Science, Machine/Deep Learning for more 9 years. Feel free to contact me for further details because I am l Flere

$850 USD in 7 dage
(30 bedømmelser)

Hello there! My name is Ali and I'm a Web Developer, App Developer and Graphic Designerr with 10 years of professional working experience. I understand that you are looking for a program that can identify trending prod Flere

$500 USD in 7 dage
(11 bedømmelser)

Greetings, I have gone through your project description. I find myself as a perfect fit for this job. I am working as a Python Developer from last 2 year. Some of my expertise is in the fields: 1. Web Scraping/Web Au Flere

$250 USD in 2 dage
(74 bedømmelser)

Hi, i have already worked on similar jobs. using python scrapy and/or selenium, i will develop a bot that would go through the eCommerce websites collecting products with relative data to help us determine the trendi Flere

$450 USD in 5 dage
(16 bedømmelser)

Hi there! My name is Salman ullah, and I'm a freelance developer with expertise in Python, machine learning, and Django. I've worked on a wide variety of projects throughout my career, which has given me firsthand expe Flere

$500 USD in 7 dage
(7 bedømmelser)

Results-oriented, meticulous and innovative and experienced Web, software developer and automation engineer with expertise in systems analysis, Web site design, and application integration. Ability to increase reliabi Flere

$500 USD in 25 dage
(15 bedømmelser)

I understand you are looking for a program that can identify trending products on a daily basis from specific e-commerce websites. Python with the libraries such as BeautifulSoup and Requests would be my best choice fo Flere

$300 USD in 2 dage
(3 bedømmelser)

Hello, sir! I'm a python(Django, Flask) development expert with 8+ years experience and I'm very familiar with web scraping and data mining using BS4, selenium, Data Scraping, Data Entry and undetectable chrome driver Flere

$500 USD in 7 dage
(3 bedømmelser)

Hi Mate, Surely I can help you in creating a program that will identify trending products on a daily basis from specific e-commerce websites. The program will retrieve all relevant product data, analyze it to identif Flere

$500 USD in 7 dage
(1 bedømmelse)

Experienced freelancer in SolidWorks, logo design, programming, and scriptwriting. I offer expertise in these areas and deliver high-quality results. Let's work together to bring your project to life. Contact me now! # Flere

$250 USD in 2 dage
(0 bedømmelser)

Hello there! My name is Bala Niranchan, and I'm a data science specialist with a strong background in Python, machine learning algorithms, deep learning algorithms, statistics, data analytics, natural language processi Flere

$500 USD in 7 dage
(0 bedømmelser)

Hello, my name is Soham and I am an accomplished data analyst with 4 years of experience in the field. I specialize in transforming raw data into valuable insights that drive strategic decision-making. As a part of my Flere

$300 USD in 7 dage
(0 bedømmelser)