e9f9a42c7a
mesontest: Don't run tests if no tests were selected
...
The output is very confusing otherwise. Before it said
'No suitable tests defined' and then showed a list of tests that
passed/failed.
Now it will just say 'No suitable tests defined' and exit.
8 years ago
07c3d35d4b
mesontest: Set MALLOC_PERTURB_ to a random value
...
This is useful enough that we can enable this for everyone. If people
really don't want this, they can pass MALLOC_PERTURB_=0 in the
environment or in the test.
8 years ago
85304bd8cf
[mesontest] Implement a quiet option.
...
Implement a quiet option that can be used to hide OK messages for
successful tests to better highlight the failing ones.
8 years ago
2e30912447
vs: Fix running of tests to use mesontest.py
...
Back in November when this broke, we didn't notice because our tests
are run in-process, so we don't check that `msbuild RUN_TESTS.vcxproj`
and `ninja test` actually work.
Now we do.
8 years ago
6778d0e2da
mesontest: Don't add '.' at the end of some prints
...
Makes it difficult to copy the filename/datetime by double-clicking
since that includes the '.' at the end.
8 years ago
d9a4b367b4
mesontest: Don't overwrite test status on timeout
...
Earlier it would mark tests as "FAIL" even if it skipped.
8 years ago
550761d97b
cleanup: @staticmethod
8 years ago
c9423cc3a8
cleanup: Replace assignment with augmented assignment
8 years ago
969be1f679
cleanup: Remove redundant parentheses
8 years ago
7a28f387e2
More readable total statistics.
8 years ago
b90956c2f2
mesontest: Improve test suite selection.
...
Suite option can now be given to specify in more detail which tests should
be run.
8 years ago
5b626ab4cb
style: [E1**] Indentation
8 years ago
ebea1e3bd9
mesontest: Print test stats even if in verbose mode.
8 years ago
01be50fdd9
mesontest: Unify testing behaviour between the test target and mesontest.
...
Also add a test summary to the end of the test output.
8 years ago
fc17e3b9cc
mesontest: Show the test command in truncated test logs.
8 years ago
bf281fd4c4
mesontest: Remove excess newline and whitespace from test logs.
8 years ago
b3d51abff2
Can put external programs to test suite exe wrappers directly.
8 years ago
74f15263b6
Can set envvars in test setups.
8 years ago
ee8a6e6fc5
Can specify test setups and run them with mesontest.
8 years ago
969dc7e995
style: fix E124 violations
...
E124: closing bracket does not match visual indentation
Signed-off-by: Igor Gnatenko <i.gnatenko.brain@gmail.com>
8 years ago
116da33cdd
style: fix E128 violations
...
E128: continuation line under-indented for visual indent
Signed-off-by: Igor Gnatenko <i.gnatenko.brain@gmail.com>
8 years ago
ef608f217d
style: fix E222 violations
...
E222: multiple spaces after operator
Signed-off-by: Igor Gnatenko <i.gnatenko.brain@gmail.com>
8 years ago
2017d8578a
style: fix E226 violations
...
E226: missing whitespace around arithmetic operator
Signed-off-by: Igor Gnatenko <i.gnatenko.brain@gmail.com>
8 years ago
f0b30baa39
style: fix E225 violations
...
E225: missing whitespace around operator
Signed-off-by: Igor Gnatenko <i.gnatenko.brain@gmail.com>
8 years ago
b55235dfbd
Fix space before :.
8 years ago
3fc67f4951
Minimal fixes to make tests pass when cross compiling.
8 years ago
2b65083463
Fix cross test and run them if a cross compiler is available.
8 years ago
f2b3ab826b
If/elif fix so running just mesontest actually runs the tests after doing a rebuild.
8 years ago
22aedda6d0
Use a big timeout when running gdb interactively and a typo fix.
8 years ago
4c74b47cfd
mesontest: Fix exception
8 years ago
10e2b9bca0
mesontest: Rebuild all before running tests
...
Only supporting ninja backend for now.
8 years ago
8be0df1443
Typo fix.
8 years ago
c1efaafec4
Stray debug print removal.
8 years ago
16bdc044e4
mesontest: Properly let user know when a test timeout out in verbose mode
8 years ago
e2782f7864
tests: Allow user to change timeout time
...
For example if we know the tests takes more time because, for example
we are tracing it, or running with very high debug log level we might
not want the test to timeout.
8 years ago
56a6f86827
mesontest: Do not timeout when running inside GDB
8 years ago
6203e3ae34
mesontest: Let user work with gdb when not running in a loop
...
In the normal case the user probably wants to set break point or
anything when running an app in gdb, we should let him a chance to
do so.
In the case he is running in a loop, it probably means he want to
reproduce a crash or a race inside gdb so we should just go and
run in gdb.
We probably miss a few options to give him more control.
8 years ago
3d05b91e37
mesontest: Respect repeat argument even when running testsuites
8 years ago
7afb4c6552
mesontest: Error out even in verbose mode when running repeatidly
8 years ago
1cb9d2bc0d
Support skipped tests
...
Knowing whether a test failed to run as its prerequisites were not
available, or whether those prerequisites were available and produced
unexpected/incorrect results, is a useful differentiation.
Add support for skipped tests by testing for exit code 77, used through
autotools/piglit/etc to denote a test which detected this and decided to
skip.
8 years ago
5d866bb4f3
mesontest: Add a 'verbose' mode which does not capture stdout/err
...
And reuse that mode when running inside gdb instead of reimplementing
running test for that particular use case.
8 years ago
2584a9f27d
mesontest: Fix usage of test.env as it can be a build.EnvironmentVariables
8 years ago
3f6e06c930
mesontest: Fix the --wd option and rename it to -C to be coherent with ninja
8 years ago
9644e8b8de
mesontest: Fix --list option
...
The listing code path could not be hit when running mesontest --list
8 years ago
1ebc5c1ea0
Can run special tests with the new tool.
8 years ago
c7ddce163f
All testing is now in mesontest.py, which simplifies a lot of stuff.
8 years ago
39df22bf53
Made Meson test into a class rather than abusing global variables and as preparation for moving it elsewhere.
8 years ago
e24229eae7
Can run benchmarks.
8 years ago
077741097a
Run all tests if none are specified.
8 years ago
951262d759
Removed Valgrind from core.
8 years ago
Nirbheek Chauhan
Hemmo Nieminen
Mike Sinkovsky
Jussi Pakkanen
Igor Gnatenko
Patrick Griffis
Thibault Saunier
Daniel Stone