From 96ef52e8580b3fc5f670b577445e75de020a9fdd Mon Sep 17 00:00:00 2001 From: arved Date: Thu, 10 May 2001 01:44:04 +0000 Subject: K. Liddle: testing support git-svn-id: https://svn.apache.org/repos/asf/xmlgraphics/fop/trunk@194237 13f79535-47bb-0310-9956-ffa450edef68 --- test/Testing | 59 +++++++++++++++++ test/basictests.xml | 14 +++++ test/testsuite.dtd | 178 ++++++++++++++++++++++++++++++++++++++++++++++++++++ test/xml/1.xml | 9 +++ test/xsl/copy.xsl | 4 ++ test/xsl/doc.xsl | 35 +++++++++++ 6 files changed, 299 insertions(+) create mode 100644 test/Testing create mode 100644 test/basictests.xml create mode 100644 test/testsuite.dtd create mode 100644 test/xml/1.xml create mode 100644 test/xsl/copy.xsl create mode 100644 test/xsl/doc.xsl (limited to 'test') diff --git a/test/Testing b/test/Testing new file mode 100644 index 000000000..180e73d87 --- /dev/null +++ b/test/Testing @@ -0,0 +1,59 @@ +Testing procedure for FOP + +(to be written using appropriate xml document) + +1) Aim + +Need an infrastructure to develop and perform tests. +Prevent regressions and make checking results easier. +Quantify the features and conformance. + +This must be done in a uniform and simple way. + +Ideally the testing and verification should all be automatic. + +A new release must not break any previously working features. + +Every time a new feature is added then tests should be made that test the feature in all possible situations. + +2) Infrastructure + +Each test for a feature must be designed to test only that feature and contain no other possible interactions. + +Tests should be as simple as possible and demonstrate the feature working. + +2.1) Options +1. For each possible parameter have a file which fully excercises the parameter over all reasonable bounds. This will mean that the fo must be in a format that will ensure each test is independant (which may not always be possible). A typical test will be large and have some overhead. + +2. For each individual test have a separate fo file or fo fragment. + +The tests are specified in an xml file which is processed using an xsl file (which may simply copy the xml). + +This will be done as a build target. + +There should be an indication about whether the test is correct for the reference FOP snapshot. This will mean that all changes after the snapshot must not break the test and may improve the result for tests that do not work. + +2.2) Details + +make a "test" dir at top level +have a script which can update the code to the snapshot tag, build and create an FOP jar. +this will then be used as the reference point for comparing results. +the tests are run and compared with the results from the reference FOP. +all differences are reported, especially ones that change a test that is marked as working (ie. regressions) + +the output will not be compressed so that the pdf markup can be compared using a diff. + +Each test must contain a unique id, catagory, a description, the test fo data and pass/fail status. + +There will be a number of catagories of test fo files (and possibly sub-catagories). +These will include conformance, bugtests and system tests. + + +3) Problems + +The reference build must be done on a clean cvs build for the appropriate tag. +The information must be updated appropriately to ensure that the results are correct. + + + + diff --git a/test/basictests.xml b/test/basictests.xml new file mode 100644 index 000000000..9a710d885 --- /dev/null +++ b/test/basictests.xml @@ -0,0 +1,14 @@ + + + + + + + +6-4-2-1.xml contains only one fo:root element. + + + + + + diff --git a/test/testsuite.dtd b/test/testsuite.dtd new file mode 100644 index 000000000..bf32ea23b --- /dev/null +++ b/test/testsuite.dtd @@ -0,0 +1,178 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/test/xml/1.xml b/test/xml/1.xml new file mode 100644 index 000000000..0b41cccc3 --- /dev/null +++ b/test/xml/1.xml @@ -0,0 +1,9 @@ + + + + +text text text text + + + + diff --git a/test/xsl/copy.xsl b/test/xsl/copy.xsl new file mode 100644 index 000000000..4e3e6109f --- /dev/null +++ b/test/xsl/copy.xsl @@ -0,0 +1,4 @@ + + + + diff --git a/test/xsl/doc.xsl b/test/xsl/doc.xsl new file mode 100644 index 000000000..71a2cc434 --- /dev/null +++ b/test/xsl/doc.xsl @@ -0,0 +1,35 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + -- cgit v1.2.3