Changes between Version 5 and Version 6 of AutomatedTesting

Timestamp:

Aug 18, 2010 5:58:55 AM (14 years ago)

Author:

bennylp

Comment:

--

AutomatedTesting

@@ -16 +16 @@
 == Introduction ==
 
-The automated testing framework automatically and continuously updates, configures, builds, and performs various unit tests, and submit the result to [http://my.cdash.org/index.php?project=PJSIP PJSIP's CDash] test dashboard. The scenario uses [http://trac2.pjsip.org/ccdash CCDash] (client for CDash; note the extra "c") framework to automate the tasks.
+The automated testing framework automatically and continuously updates, configures, builds, and performs various unit tests on PJSIP distribution, and submit the result to [http://my.cdash.org/index.php?project=PJSIP PJSIP's CDash] test dashboard. The scenario uses [http://trac2.pjsip.org/ccdash CCDash] (client for CDash; note the extra "c") framework to automate the tasks.
 
 Supported targets:
@@ -24 +24 @@
  - [wiki:Getting-Started/iPhone iPhone/iPad]
 
+[[BR]]
+
 == Installation ==
  1. Checkout PJSIP source code from SVN
@@ -29 +31 @@
  1. Download and install any features to be used/tested, e.g. Intel IPP, Symbian APS/VAS plugin, etc.
 
+[[BR]]
+
 == Configuring and Running Test Scenarios ==
 
-The general steps to configure automated test script on a platform:
+The general steps to configure automated test script on a platform are as follows:
 
  0. Go to directory '''{{{tests/automated}}}''' inside pjsip distribution.
- 1. Choose the appropriate scenario ''template'' for your target/test objective. A template is an XML file containing command to perform automated tests for a particular target. The templates are listed below:
+ 1. Choose the appropriate scenario ''template'' for your target/test objective. A template is an XML file containing ccdash commands to perform automated tests for a particular target. The PJSIP distribution have been equipped with the following templates:
 
     || '''Target platform ''' ||  '''Template file name ''' ||  '''Description ''' ||  '''Requirements ''' ||
     || Makefile based (Linux, Mac OS X) || {{{gnu.xml.template}}} || Default settings || - ||
-    || Linux, Mac OS X ||  {{{gnu-ipp.xml.template}}} || Intel IPP || [wiki:Intel_IPP_Codecs Intel IPP and samples] ||
-    || MSVC/Win32 ||  {{{msvc.xml.template}}} || Default settings || - ||
+    || Linux, Mac OS X with IPP ||  {{{gnu-ipp.xml.template}}} || Intel IPP || [wiki:Intel_IPP_Codecs Intel IPP and samples] ||
+    || MSVC/Win32 inc. WM ||  {{{msvc.xml.template}}} || Default settings || - ||
     || Symbian/S60 3rd Ed||  {{{symbian.xml.template}}} || Default settings || - ||
     || Symbian/S60 3rd Ed ||  {{{symbian-aps.xml.template}}} || Nokia APS and APS-Direct || [wiki:APS Nokia APS plugin] ||
@@ -49 +53 @@
      $ ./configure.py scenario.xml.template -o scenario.xml
     }}}
+    The above command will produce '''{{{scenario.xml}}}''' scenario file.
  3. For testing, run the scenario by running:
     {{{
      $ ./run_scenario.py scenario.xml
     }}}
-    This will perform the automated tests and submit the result under "Experimental" group. Depending on which test is being run, it may take between two minutes to two hours to complete. You may press Ctrl-C to stop the execution.
- 4. Once you're satisfied that the scenario(s) will work correctly, run this to perform both "Continuous" and "Nightly" builds on the specified scenario(s):
+    This will perform the automated tests and submit the result under "Experimental" group on CDash. Depending on which test is being run, it may take between two minutes to two hours to complete. You may press Ctrl-C to stop the execution.
+ 4. Once you're satisfied that the scenario(s) will work correctly, run '''{{{run_continuous.py}}}''' to perform both "Continuous" and "Nightly" builds on the specified scenario(s):
     {{{
      $ ./run_continuous.py scenario1.xml [scenario2.xml ...]
     }}}
-    The script will run the automated tests everytime changes occur in the repository, or at every 00:00:00 GMT for the "Nightly" build.
- 5. Go to [http://my.cdash.org/index.php?project=PJSIP PJSIP's CDash] test dashboard to check the test results. Note that test results are only submitted once all tests are completed.
+    The script will run the automated tests in the scenario(s) everytime changes occur in the repository, or at every 00:00:00 GMT for the "Nightly" build.
+ 5. Go to [http://my.cdash.org/index.php?project=PJSIP PJSIP's CDash] test dashboard to check the test results. Note that test results are only submitted once all tests in a scenario are completed.
  6. Now the automated test will run everytime there is a new checkin in the repository, or at every 00:00:00 GMT for the "Nightly" build.
 
 
-The detailed steps for each template will be explained below.
+[[BR]]
+
+== The Templates ==
+
+The detailed steps to configure each template will be explained below.
+
+[[BR]]
 
 === gnu.xml.template ===
@@ -72 +83 @@
  $ ./run_scenario.py gnu.xml
 }}}
+
+[[BR]]
 
 === gnu-ipp.xml.template ===
@@ -96 +109 @@
 
 
+[[BR]]
+
 === iphone.xml.template ===
 
@@ -114 +129 @@
 
 
+[[BR]]
+
 === msvc.xml.template ===
 
@@ -121 +138 @@
 
 
+[[BR]]
+
 === symbian.xml.template ===
 
@@ -126 +145 @@
 
 TBD.
+
+[[BR]]
 
 === symbian-aps.xml.template ===
@@ -133 +154 @@
 TBD.
 
+
+[[BR]]
 
 === symbian-vas.xml.template ===