hanchenye-llvm-project/lldb/test
Enrico Granata 165f8af8c5 Initial commit of a new testsuite feature: test categories.
This feature allows us to group test cases into logical groups (categories), and to only run a subset of test cases based on these categories.

Each test-case can have a new method getCategories(self): which returns a list of strings that are the categories to which the test case belongs.
If a test-case does not provide its own categories, we will look for categories in the class that contains the test case.
If that fails too, the default implementation looks for a .category file, which contains a comma separated list of strings.
The test suite will recurse look for .categories up until the top level directory (which we guarantee will have an empty .category file).

The driver dotest.py has a new --category <foo> option, which can be repeated, and specifies which categories of tests you want to run.
(example: ./dotest.py --category objc --category expression)

All tests that do not belong to any specified category will be skipped. Other filtering options still exist and should not interfere with category filtering.
A few tests have been categorized. Feel free to categorize others, and to suggest new categories that we could want to use.

All categories need to be validly defined in dotest.py, or the test suite will refuse to run when you use them as arguments to --category.

In the end, failures will be reported on a per-category basis, as well as in the usual format.

This is the very first stage of this feature. Feel free to chime in with ideas for improvements!

llvm-svn: 164403
2012-09-21 19:10:53 +00:00
..
api/check_public_api_headers Make the test suite work again on Mac OS X without the LLDB_BUILD_TYPE env var 2012-05-30 05:40:23 +00:00
arm_emulation <rdar://problem/11358639> 2012-05-08 01:45:38 +00:00
attic Initial commit of a new testsuite feature: test categories. 2012-09-21 19:10:53 +00:00
benchmarks Test file renaming. 2012-04-23 17:54:40 +00:00
example Initial commit of a new testsuite feature: test categories. 2012-09-21 19:10:53 +00:00
expression_command Initial commit of a new testsuite feature: test categories. 2012-09-21 19:10:53 +00:00
functionalities Initial commit of a new testsuite feature: test categories. 2012-09-21 19:10:53 +00:00
help Reimplemented the code that backed the "settings" in lldb. There were many issues with the previous implementation: 2012-08-22 17:17:09 +00:00
lang Initial commit of a new testsuite feature: test categories. 2012-09-21 19:10:53 +00:00
logging Second batch of adding @dsym_test/@dwarf_test decorators to existing test cases. 2012-04-06 19:54:10 +00:00
macosx <rdar://problem/11358639> 2012-05-08 01:45:38 +00:00
make Compile shared libraries with dSYM files when requested on darwin. Prior to this, we never had dSYM files for shared libraries unless it was a dylib only Makefile. 2012-09-20 21:43:11 +00:00
pexpect-2.4
plugins Fix the wrong comment in TestUUIDMismatchWarnings.py. 2012-08-20 22:36:58 +00:00
python_api Initial commit of a new testsuite feature: test categories. 2012-09-21 19:10:53 +00:00
settings Reimplemented the code that backed the "settings" in lldb. There were many issues with the previous implementation: 2012-08-22 17:17:09 +00:00
source-manager Make git not delete some empty dirs. Otherwise a git checkout would be different from an svn checkout. 2012-07-25 10:34:53 +00:00
terminal Continue the cleanup started on r158737 2012-06-20 10:13:40 +00:00
types <rdar://problem/11757916> 2012-08-29 21:13:06 +00:00
unittest2
warnings/uuid Make TestAddDsymCommand not fail since bundles were accepted as add-dsym arguments. 2012-09-12 14:43:45 +00:00
.categories Initial commit of a new testsuite feature: test categories. 2012-09-21 19:10:53 +00:00
Makefile Update the Makefile to expect the lldb package 2012-05-29 14:06:40 +00:00
README-TestSuite Add some descriptions about the default executable name being 'a.out' and can be overwritten 2011-07-28 21:15:39 +00:00
bench-history Add bench entries. 2011-11-29 19:13:38 +00:00
bench.py Establish a baseline for bench.py score by using a fixed lldb executable as the 2011-10-26 22:58:02 +00:00
blacklist.py Don't set DYLD_LIBRARY_PATH in the Python environment (which will get passed down to 2011-08-03 17:41:28 +00:00
dosep.ty Remove invalid docstring (due to cut-and-paste error). 2011-11-16 18:48:48 +00:00
dotest.py Initial commit of a new testsuite feature: test categories. 2012-09-21 19:10:53 +00:00
lldbbench.py Tests decorated with @benchmarks_test do not participate in the remote-macosx test suite run. 2012-04-19 23:50:00 +00:00
lldbtest.py Initial commit of a new testsuite feature: test categories. 2012-09-21 19:10:53 +00:00
lldbutil.py Fix a wrong variable name. 2012-07-06 16:20:13 +00:00
redo.py Take '--help' as well as '-h' as hint to emit the usage output. 2012-08-23 23:45:26 +00:00