353055 PHP parse data. assign catgory

Joomla PHP - parse keyword data & assign article category. This is PHP & MYSQL for Joomla. I have a very large database of articles that are not assigned to proper categories. Each article has a dedicated field with keyword statistics encoded in it. This data must be parsed and calculated to determine mathematically which category the article should be assigned to. There are hundreds of thousands of articles and 10 categories into which each must be assigned. The keyword statistics field contains between 1 - 10 pieces of data that must be parsed and calculated to make the proper determination for each article. I have already built a simple regex example to parse the datafield and display key portions of the data. The data field is fomatted in a way that will allow it to be extracted using REGEX. Simple mathematical functions must be performed on this data to decide which category. I wish to achieve a somewhat balanced number of articles assigned to each category. In order to achieve this, I wish to apply a BIAS (multiplier) to each category (to increase or decrease its value), thus increasing or decreasing the probability of more or fewer articles landing in the respective categories (this is visually explained in the attached word doc). I have built a basic joomla site containing several hundred of these articles randomly assigned to categories, that can be used for development purposes (on your local server - restore via JoomlaCloner). When the code runs on the full database it will access hundreds of thousands of records. Please include a provision to deal with this issue (i.e. multiple passes of smaller sets). This should be developed within Joomla, perhaps as a module. It does not have to be "user friendly" as it will be used only once (many iterations) to make these assignments. It does not need a user interface, and minor PHP code tweaks are acceptable to cause it to change its behavior. The mathematical result for each article should be stored to a new or unused database field so that the algorithm and results can be checked for accuracy. I have done some minor data processing related to this using MOD_PHP ([login to view URL]). This module allows PHP source to be entered directly into the module, which processes the data on each page load. This method might be adequate for this project, if the BIAS feature mentioned above is easy to manage/tweak in the source code. I have attached a WORD document with more details about the data formatting and data processing requirements. The document also contains a link to the demo Joomla site that will be supplied for development purposes. I wish to move quickly.