Craig Tiller
49f6132053
Teach run_tests about individual Python tests
...
Allows:
- running python tests in parallel
- clearer Travis output
- subjects each python test to the five minute run_tests timeout,
instead of ALL the tests to the five minute timeout
- easier benchmarking of which tests are slow
10 years ago
murgatroid99
132ce6a232
Added CONFIG environment variable to build and test scripts, fixed some bugs
10 years ago
Jan Tattermusch
1970a5b7de
added C# to run_tests.py
10 years ago
murgatroid99
b7063f1416
Added python tests to .travis.yml
10 years ago
murgatroid99
6a4c4fabf3
Added ruby tests to run_tests.py
10 years ago
Craig Tiller
2cc2b84a13
Allow starting from non-root directory
10 years ago
Craig Tiller
86fa1c5541
Save makefile var clobbering
10 years ago
Craig Tiller
8451e87ced
Extend timeouts for Travis 2x
10 years ago
Nicolas "Pixel" Noble
9db7c3b174
Adding flaky attribute for tests.
10 years ago
Nicolas "Pixel" Noble
a7df3f9e2c
Improving travis output.
10 years ago
Craig Tiller
c1f1162787
Drastic speed up
10 years ago
Craig Tiller
fe406ec601
Support taking a regex on test short name
...
Allows run_tests to focus on one particular test if necessary.
Useful in combination with runs_per_test.
10 years ago
Craig Tiller
1a305b1d9d
Make valgrind a bit more useful
10 years ago
Craig Tiller
c2c792113e
Add copyrights to Python code
10 years ago
Craig Tiller
96bd5f6b76
Add ubsan support
10 years ago
David Klempner
2573958e84
Change TestCache to parameterize whether to skip running tests.
...
This allows caching results with --runs_per_test.
10 years ago
Nicolas Noble
0af000bfba
Fixing valgrind's codepath in run_tests.py.
10 years ago
David Klempner
5e35b14094
Disable test caching when runs_per_test > 1
...
Otherwise the tests just stop once they succeed, or don't even run at
all if they passed in a previous run.
10 years ago
David Klempner
1d0302d03d
Add a tsan suppression file with OPENSSL_cleanse and use it in run_tests
10 years ago
David Klempner
f94838b0a3
Make several python scripts explicitly python2.7
...
I tried actually doing a build on my home desktop, and none of these
run with python 3.3, which is /usr/bin/python on my home desktop.
10 years ago
Craig Tiller
547db2b3ef
Allow specifying environment variables.
...
Refactor the code a little to make this easier to munge around.
10 years ago
Craig Tiller
eb272bc6ca
Fix valgind
10 years ago
Craig Tiller
9977582850
Clean up formatting
10 years ago
Craig Tiller
e68de0e4c9
Small tweaks
...
Run faster on smaller machines.
Don't watch '.' prefixed files for changes. These files don't typically contribute to builds, and are used as vim temp files.
10 years ago
murgatroid99
666450ef14
Updated comment
10 years ago
murgatroid99
c279165f72
Got run_tests.py and node tests working
10 years ago
murgatroid99
564b944b3c
Started fixing php test runner
10 years ago
murgatroid99
2c8d5165a6
Added node test runner
10 years ago
Nathaniel Manista
840615ed27
Add Python to run-tests.
10 years ago
Craig Tiller
06b4ff2b71
Simplify Python code
10 years ago
Craig Tiller
e9c959d78e
Only run language specified tests
...
Add a template to generate a complete list of tests for C/C++, and use it to generate the list of binaries to run tests for.
10 years ago
Craig Tiller
261dd98e5e
Use Python json module
...
Instead of third party simplejson module, to save a dependency.
10 years ago
Craig Tiller
c7449166d2
PHP unit tests run with run_tests.py
10 years ago
Craig Tiller
f1973b0652
Add support for building outside of the Makefile
10 years ago
Craig Tiller
1cc11dbf58
Fix run_test.py so it runs the first time
10 years ago
Craig Tiller
b50d166634
Make run_tests.py pass lint
10 years ago
Craig Tiller
71735185a1
Cache for successful test runs
...
By default don't re-run tests that have already run successfully, to
reduce latency between making a change and seeing if it fixed the last
thing that you were trying to fix.
10 years ago
Craig Tiller
f8cc166605
Allow language to be specified to run_tests.py
10 years ago
Craig Tiller
686fb26b30
Allow language to be specified to run_tests.py
10 years ago
Craig Tiller
ec0b8f3f77
Compile OpenSSL differently for each config.
...
MSAN, TSAN, ASAN need to see all the code. Valgrind, MSAN want -DPURIFY.
10 years ago
Nicolas Noble
b09078f202
Addressing pull request comments.
...
-) Fixing long line length.
-) Changed the logic of the exit message.
10 years ago
Nicolas Noble
044db7422a
Various cosmetic improvements to run_tests.py
...
-) Adding a new command line flag to be able to see which tests are passing.
-) Adding more status when the tool is idle in forever mode.
-) Adding a last status when the tool is finished so to avoid leaving the console in a weird state.
-) Adding a status message in the forever mode if the previous run failed.
-) Swapped the message and its explanation, so you don't have to scroll up to see which test failed.
-) Fixed a race condition in the watch_dir.py code if a file is deleted during the loop.
10 years ago
Craig Tiller
2aa4d64947
Helgrind support for run_tests.py
...
Also allow maxjobs to be tweaked based upon which configs are being run,
to prevent memory starvation.
10 years ago
Craig Tiller
d63b7896cc
Helgrind support for run_tests.py
...
Also allow maxjobs to be tweaked based upon which configs are being run,
to prevent memory starvation.
10 years ago
Craig Tiller
0d65c784db
Filter out ssl tests in the sans: they dont work yet
10 years ago
Craig Tiller
d86a394ce2
Fix return behavior of run_tools.py
...
If not running in forever mode, and a test fails, fail run_tests.py
also.
If running in forever mode and make fails, wait for the next run.
10 years ago
Craig Tiller
3f8bd048af
Fix return behavior of run_tools.py
...
If not running in forever mode, and a test fails, fail run_tests.py
also.
If running in forever mode and make fails, wait for the next run.
10 years ago
Craig Tiller
be56a9684e
Build all targets for a config at once
10 years ago
Craig Tiller
e4fcd6aa0e
Build all targets for a config at once
10 years ago
Craig Tiller
934baa3bb1
Add tools/run_tests/run_lcov.sh
...
This is a tool for collecting coverage reports from our tests and
combining them with the open-source tool 'lcov'.
10 years ago