System Tests; done on Windows XP through Cygwin (with Perl installed).




Test Performed:  Attempting to include files in the filelist that do not exist 
in both specified revisions.

Date: 10/29/07

Expected Result:  The tool should run and report turmoil metrics correctly on the 
files that do exist across both revisions.  Because empty temporary files are 
created, the tool is expected (at this point) to calculate "0" metrics on the 
files that are only in one revision.

Result Achieved:  The expected result (from above) does indeed happen, along with 
the output from Subversion
   "svn: path:/repository/file.type has no URL"




Test Performed:  Order of flags given to tool

Date: 10/30/07

Expected Result:  The order of the flags (and their arguments) should not affect 
the tool's execution.

Result Achieved:  The expected result (from above).  the tool's execuation is not 
affected.




Test Performed:  Giving the tool the same flag multiple times

Date: 10/30/07

Expected Result:  Multiple flags (like calling the tool with "-i" given several 
times) should not affect the tool's execution.

Result Achieved:  The expected result (from above).  The tool's execuation is not 
affected.




Test Performed:  Attempting to use backslashes ( "\" ) instead of forward slashes 
( "/" ) in the file path arguments.

Date: 10/30/07

Expected Result: Based on the knowledge that the tool creates empty temporary files, 
we expect the tool to execute normally, and report no turmoil ("0"), and all the 
files in the filelist to be marked as "new"

Result Achieved: The expected result (from above), along with the Subversion output 
(to stderr) that informs the user that the given path is not a working copy, and 
that the file cannot be found.




Test Performed:  Attempting to pass in a file path that doesn't exist.

--The Date, Expected Result, and Result Achieved is the same for this test as it 
is for the previous test "...using backslashes".




Test Performed:  Attempting to pass in a filelist that doesn't exist.

Date:  10/30/07

Expected Result:  For nothing to happen, including notification to the user.

Results Achieved:  Turmoil is not reported.  (This is different than a turmoil 
measurement of 0.)  The output files are created, but they are empty.  An error is 
sent to the command line (stderr) from the "rm" utility, stating that the temporary 
directories cannot be removed because they do not exist.




Test Performed:  Attempting to pass the tool a single revision that does not exist.

Date: 10/30/07

Expected Result:  For the tool to try to calculate and report metrics, even though 
an entire revision does not exist.

Result Achieved:  The tool does execute and report turmoil.  This measurement is 
different than that reported from a nominal call to the tool, and different than 
the call to the tool that included passing in a non-existing path: all the lines 
in the files are reported as lines added.




Test Performed:  Attempting to pass the tool non-existing revisions on BOTH file paths.

Date: 10/30/07

Expected Result:  For the tool to try to calculate and report metrics, even though 
both revisions do not exist.

Result Achieved:  The result achieved is the same as that achieved for the test 
"...using backslashes": turmoil is reported as "0", and all the files are marked as 
new.