I would like to have some improvements made to one of the PERL scripts that my Auto Test reporting tool uses.
My goal is to change the auto test report so that it can report the compared results of two auto test runs aligned in a single page,(it reports one now.)
You can start with the existing PERL script that has 338 lines of code.
The PERL script reads a *.runlog file that has data about each test on a single line. There are hundreds of test results listed in the file and they are also grouped in sets.
The changes I need are as follows:
1. Currently the script takes one “dir”, argument, this would be increased to take two arguments; “dir_1” and “dir_2”
2. Currently the report has five empty columns that are supposed to report performance data tha is in the *.runlog file. I would like to have these fixed so that they do report.
3. Currently the report takes an argument for “datestr”, which specifies the date of the report to read. I would like to change the code to use the latest test.
4. Currently the report takes an argument for “onlyfailures”, this optionally limits the report to show only failed tests. Since the improved version will report results of two test sets, the “onlyfailures” argument will now relate to reports from “dir_2=” because the main purpose of this report is to show which tests are failing in “dir_2” that are not failing in “dir_1”. When the "onlyfailures" argument is set to "true", only tests that failed in dir_2 will be shown in the web report.
5. If any of the performance data mentioned in item 3 (above) shows an increase of more than 10% in the reports from “dir_2” (as compared to dir_1) the results cells will be are colored yellow, if the increase is greater than 20% the cells that are colored red.