replica
/
diffblue-cbmc
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
diffblue-cbmc/regression/smt2_strings
History
Joel Allred 17b55d13d8 Fix smt_strings .desc file 2019-03-29 09:59:22 +00:00
..
concat_const_sat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
concat_const_unsat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
concat_input_sat SMT2 string tests for nondet strings 2019-03-22 18:07:30 +00:00
concat_input_unsat SMT2 string tests for nondet strings 2019-03-22 18:07:30 +00:00
contains_const_sat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
contains_const_unsat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
contains_input_sat SMT2 string tests for nondet strings 2019-03-22 18:07:30 +00:00
contains_input_unsat SMT2 string tests for nondet strings 2019-03-22 18:07:30 +00:00
indexof_const_sat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
indexof_const_unsat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
indexof_input_sat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
indexof_input_unsat SMT2 string tests for nondet strings 2019-03-22 18:07:30 +00:00
int_to_str_const_sat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
int_to_str_const_unsat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
int_to_str_input_sat SMT2 string tests for nondet strings 2019-03-22 18:07:30 +00:00
int_to_str_input_unsat SMT2 string tests for nondet strings 2019-03-22 18:07:30 +00:00
length_const_sat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
length_const_unsat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
length_input_sat SMT2 string tests for nondet strings 2019-03-22 18:07:30 +00:00
length_input_unsat SMT2 string tests for nondet strings 2019-03-22 18:07:30 +00:00
lex_order_const_sat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
lex_order_const_unsat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
lex_order_input_sat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
lex_order_input_unsat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
prefixof_const_sat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
prefixof_const_unsat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
prefixof_input_sat SMT2 string tests for nondet strings 2019-03-22 18:07:30 +00:00
prefixof_input_unsat SMT2 string tests for nondet strings 2019-03-22 18:07:30 +00:00
reflexive_lex_order_const_sat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
reflexive_lex_order_const_unsat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
reflexive_lex_order_input_sat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
reflexive_lex_order_input_unsat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
regexp_all_sat Skip 3rd party cvc4 known bugs 2019-03-28 17:34:07 +00:00
regexp_allchar_sat Rename allchar tests 2019-03-22 18:07:30 +00:00
regexp_allchar_unsat Rename allchar tests 2019-03-22 18:07:30 +00:00
regexp_concat_const_sat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
regexp_concat_const_unsat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
regexp_concat_input_sat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
regexp_concat_input_unsat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
regexp_inter_const_sat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
regexp_inter_const_unsat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
regexp_inter_input_sat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
regexp_inter_input_unsat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
regexp_loop_const_sat Skip 3rd party cvc4 known bugs 2019-03-28 17:34:07 +00:00
regexp_loop_const_unsat Skip 3rd party cvc4 known bugs 2019-03-28 17:34:07 +00:00
regexp_loop_input_sat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
regexp_loop_input_unsat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
regexp_nostr_const_unsat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
regexp_opt_const_sat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
regexp_opt_const_unsat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
regexp_opt_input_sat Fix smt_strings .desc file 2019-03-29 09:59:22 +00:00
regexp_plus_const_sat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
regexp_plus_const_unsat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
regexp_plus_input_sat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
regexp_plus_input_unsat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
regexp_range_const_sat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
regexp_range_const_unsat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
regexp_range_input_sat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
regexp_range_input_unsat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
regexp_star_const_sat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
regexp_star_const_unsat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
regexp_star_input_sat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
regexp_union_const_sat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
regexp_union_const_unsat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
regexp_union_input_sat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
regexp_union_input_unsat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
replace_all_const_sat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
replace_all_const_unsat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
replace_all_input_sat Fix badly named smt2_strings test files 2019-03-29 09:59:22 +00:00
replace_const_sat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
replace_const_unsat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
replace_input_sat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
str_at_const_sat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
str_at_const_unsat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
str_at_input_sat SMT2 string tests for nondet strings 2019-03-22 18:07:30 +00:00
str_at_input_unsat SMT2 string tests for nondet strings 2019-03-22 18:07:30 +00:00
str_in_re_const_sat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
str_in_re_const_unsat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
str_in_re_input_sat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
str_in_re_input_unsat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
str_to_int_const_sat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
str_to_int_const_unsat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
str_to_int_input_sat SMT2 string tests for nondet strings 2019-03-22 18:07:30 +00:00
str_to_int_input_unsat SMT2 string tests for nondet strings 2019-03-22 18:07:30 +00:00
str_to_re_const_sat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
str_to_re_const_unsat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
str_to_re_input_sat Skip 3rd party Z3 known bugs 2019-03-28 17:57:16 +00:00
str_to_re_input_unsat Fix badly named smt2_strings test files 2019-03-29 09:59:22 +00:00
substr_const_sat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
substr_const_unsat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
substr_input_sat SMT2 string tests for nondet strings 2019-03-22 18:07:30 +00:00
substr_input_unsat SMT2 string tests for nondet strings 2019-03-22 18:07:30 +00:00
suffixof_const_sat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
suffixof_const_unsat Add FUTURE tests for SMT2 string operations 2019-01-31 17:28:04 +00:00
suffixof_input_sat Delete erroneously added line in test 2019-03-28 17:22:32 +00:00
suffixof_input_unsat SMT2 string tests for nondet strings 2019-03-22 18:07:30 +00:00
.gitignore gitignore 2019-01-31 17:28:04 +00:00
CMakeLists.txt Add smt2_strings test suite directory 2019-01-31 17:28:01 +00:00
Makefile test.pl: check for EXIT and SIGNAL patterns if -e is set 2019-02-21 15:04:42 +00:00
README.md Document running 3rd party smt2 solver (with skips) 2019-03-28 17:34:07 +00:00

README.md

Test Suite for SMT2 String Operations

The purpose of this suite is to test the level of string support of CBMC's SMT2 backend.

It can also be used to test the level of string support of any SMT2 solver, by using a command such as:

../test.pl -p -CKFT -c <path_to_solver_binary>

(note the -CKFT option to consider all testing levels ("CORE", "KNOWNBUG", "FUTURE", "THOROUGH"), as these are relevant to CBMC only.

More specifically, tests are tagged according to the expected support by the 3rd party solver. The commands below will only run the tests where support is expected:

CVC4:

../test.pl -p -CKFT -X cvc4_bug -c <path_to_cvc4_binary>

Note: Most of the string operations are only supported when cvc4 is passed the --strings-exp option. For running the tests, suggest creating a script that calls cvc4 with --strings-exp, and pass the path to that script to the command above.

Z3:

../test.pl -p -CKFT -X z3_bug -c <path_to_z3_binary>