Code a webcrawler wich crawls the web for specified keywords and build excerpts

We need a webcrawler, wich crawls the whole german languaged based web, to find specified keywords and extract then excerpts from pages. A bit like Google or Bing, but of course with specified keywords.

The goal is to find business signals about new buildings or relocations of companies so that we can offer our products there. Companies post messages about it on their own websites or on social media platforms.

We want to set various keywords after crawling to find these messages. For example, these are the words "neubau" which means new building, "baut neu" wich means build new and "errichtet" wich meens build.

Since we then also receive messages that, for example, ships are being newly built, we need exclusion keywords in the next step. So we would define "ship" as an exclusion, and these excerpts then do not need to be displayed. For example, another exclusion keyword would be "warehouse" because these companies do not need our products. We need to be able to conveniently add both included and excluded keywords at any time from the backend of the homepage.

Duplicate excerpts should be filtered out. Similar entries should be grouped together if possible. An excerpt should show (as shown in the example) about 50-100 words around the keyword found, so that we can assess whether this message fits our intent or not.

A database should be created, with a web page view for the results. On the left, the company with address, phone, etc. (see example) on the right side the different business signals found for this company. In different tables in the database to implement rights and access management later. The admin zone for regulating this and the keywords should already be created. The website can run on our IIS for the time being, but should go online later. If necessary we want to market the software for other customers (with other keywords) later on. There should already be a login for our employees. And it should also be possible to export the data so that we can transfer it to our CRM system.

We can send you two screenshots to describe the searched output. If you understand german language it is simpler for you to interpret the samples. Please request the samples before submitting a price.

Evner: Datasøgning, Databehandling, Python, Data Scraping, Web Skrabning

Se mere: code inserting movie file web design, javascript code correctly redirect user web page, web developers can build club penguin, convert web service maven build, source code create hit counter web page, php code show video mysql web page, write html code upload xls file web page, code example orbital gateway web service example, php code show mysql table web page, crawls web email addresses, ecommerce web design reviews build jewelry, code java client net web service, sip softphone html code flash php online web, code embed flash player web page, code embed wmv firefox web page, code flash player controls web page, responsive web design projects build a product landing page free code camp, responsive web design projects build a tribute page, responsive web design projects - build a tribute page

Om arbejdsgiveren:
( 7 bedømmelser ) Bad Oldesloe, Germany

Projekt ID: #29730296

8 freelancere byder i gennemsnit €184 timen for dette job


Hi, I am Python script developer with 10 years of experience. I can build a script/bot for you by python with instructions very short time. Can we discuss please? Thanks.

€175 EUR in 3 dage
(89 bedømmelser)
(66 bedømmelser)

Hi, can you please share the sample? I have experience in python data scraping using request, selenium and many other ways. Would like to discuss more in detail. Thanks

€175 EUR in 7 dage
(6 bedømmelser)

I can do it. Hi i am an Senior Python web crawling , web scraping Expert. As 9+ years experiences in these field. I can give good quality work. I have read the guidelines of your work.I believe that i can provide you Flere

€200 EUR in 5 dage
(32 bedømmelser)
(13 bedømmelser)

I am an highly experienced freelancer. I am offering services in Web Applications, Machine Learning, Deep Leaning, Arduino programming , Raspberry pi Android app development, Data Science, Natural Language Processing, Flere

€175 EUR in 5 dage
(1 bedømmelse)

Dear Client. I have read the description carefully. I fully understand what you want and it is doable for me. I am ready now for you. Let's chat so that we can discuss details. Thank you.

€175 EUR in 7 dage
(0 bedømmelser)

Hello, I have gone through your project description and understood what has to be done in this task and can give you a complete assurance that I can do the job. I have sound experience in performing such kind of work Flere

€175 EUR in 7 dage
(0 bedømmelser)