diff options
author | wisberg <wisberg> | 2003-04-26 21:15:23 +0000 |
---|---|---|
committer | wisberg <wisberg> | 2003-04-26 21:15:23 +0000 |
commit | 0557b906e87ef2179694dc919ad67b9fbf0fa077 (patch) | |
tree | f69b331242f88eeac72282932693842ef617c0ce /build/readme-build-and-test-aspectj.html | |
parent | 1e502f504f2ad333ad5627d8e9d106315c38ecc0 (diff) | |
download | aspectj-0557b906e87ef2179694dc919ad67b9fbf0fa077.tar.gz aspectj-0557b906e87ef2179694dc919ad67b9fbf0fa077.zip |
moving release testing list to tests/, added some old stuff.
TODO: write test-release.xml ant script
Diffstat (limited to 'build/readme-build-and-test-aspectj.html')
-rw-r--r-- | build/readme-build-and-test-aspectj.html | 109 |
1 files changed, 4 insertions, 105 deletions
diff --git a/build/readme-build-and-test-aspectj.html b/build/readme-build-and-test-aspectj.html index 8c1b36bd2..e7829c658 100644 --- a/build/readme-build-and-test-aspectj.html +++ b/build/readme-build-and-test-aspectj.html @@ -305,111 +305,10 @@ For bug fixes, associated tests in <code>tests/ajcTests.xml</code>. -<p>Before a release, run the following tests using a Java 1.3 VM -(the minimum required by the AspectJ tools): -<ol> - <li>JUnit tests. Run these before the final build - using <code>tests/junitModules.xml</code> - (which runs all the - <code>modules/{module}/testsrc/{module}ModuleTests.java</code>). - <p> - </li> - - <li>All compiler tests in <code>tests/ajcTests.xml</code> - and <code>tests/ajcTestsFailing.xml</code>. - Run these before the final build using the test harness, - as follows: -<pre> - cd tests/ - java -jar {..}/testing-drivers-all.jar ajcTests.xml -release -</pre> - The <code>-release</code> option skips tests - marked <code>purejava</code> or <code>knownLimitation</code> - and only emits one-line results for each test: -<pre> -PASS one test identifier() -FAIL another test identifier() -... -</pre> - (Use <code>-help</code> on the harness to see the full - definition of the <code>-release</code> alias.) - Run with and without the <code>-emacssym</code> option, - saving the output - to the appropriate subdirectory of the - <a href="../../releases">org.aspectj/releases</a> directory - with the name - <code>ajcTests-result-{version}.txt</code> - or <code>ajcTests-result-{version}-emacssym.txt</code>. - <p> - Compare results with a prior release or test run using TestDiffs: -<pre> - set CLASSPATH="{..}/testing-drivers-all.jar" - java org.aspectj.testing.util.TestDiffs {first-run}.txt {second-run}.txt -</pre> - This will generate lists of tests fixed, broken, missing, or - added. For a release, no tests from <code>ajcTests.xml</code> - should be broken, and missing tests (those in the first run absent from the - second run) should be justified (usually the test was - removed as invalid). A test will show up as - missing from the first run and added to the second run if - it is renamed between runs. - For a final release, no test should be <code>FAIL</code> unless it is - deferred (including those from <code>ajcTestsFailing.xml</code>). - <p> - For more information, see the instructions for building and running - the test harness and the tests - <a href="../tests/readme-tests-module.html"> - ../tests/readme-tests-module.html</a>. - <p> - </li> - <li>Examples. Run these on the built/installed release. -The following should build and run the spacewar example: -<pre> - cd {aspectj-install}/doc/examples - {ant 1.5.1} -f build.xml -</pre> -Also run 2-3 other targets from Ant and some examples directly: -<ul> -<li> -The target <code>all</code> -runs all examples, and <code>nonGui</code> runs those -that do not require manual operation; -</li> - -<li>The target<code>tracing-bc</code> does bytecode weaving; -</li> -<li> -Run some of the compiled examples in a 1.1 VM - (the minimum required for running AspectJ code). -</li> -</ul> -<p> -This quick test verifies that the -<code>aspectjtools.jar</code> and <code>aspectjrt.jar</code> -are installed and have a matching version, that the examples actually -compile and run, etc. - <p> - </li> - <li>If there are any bugs which are closed with this release - but which do not have an automated test case run using - JUnit or the harness, those bugs should be manually tested - against the release. - <p> - </li> - <li>Any other tests warranted by release objectives. - E.g., make sure it works as expected for any demos or - for any clients (e.g., Emacs, AJDT). - </li> -</ol> -<p>Some failures with past releases to consider checking: -<ul> - <li>debug info not included in .class files</li> - <li>API not included in documentation</li> - <li>Ant variables not filtered into doc files (e.g., ant-tasks.html)</li> - <li>Manual dates not changed in docs or readme</li> - <li>Inconsistent version information between runtime and tools classes</li> -</ul> - +<p>Before a release, run the release tests as described in + <a href="../tests/readme-release-tests.html"> + ../tests/readme-release-tests.html</a>. + <h4>Release completion</h4> When the release build is accepted, tag the tree with the release version |