We need a script, which can sort websites list (we will provide) into different categories (i will provide) by check meta or keywords of websites.
for example, website [url removed, login to view]
<meta name="keywords" content="CNC machining,machine,lathe,mill,drill,machined parts,anodizing,equipments manufacturer,valves,Process automation,Power,textile,food,medical equipments,oil exploration equipments,cryogenic equipments" />
then we can sort it as "manufacturer"
some website has no meta so the script must check the content and decide by keywords of content.
this script must run fast since we need to sort 100-200K websites per day.
we will work closely in this project.