5b030b5aef
Add grpcio-admin and grpcio-csds to verification script ( #26329 )
4 years ago
6f23b3fb02
Revert "Provide custom sponge configs to exclude manual runs from testgrid ( #26283 )" ( #26325 )
...
This reverts commit 113cd9546d
4 years ago
12372fb69f
Fix invalid argument in README example for loadtest_config.py ( #26277 )
...
This example crashes the driver process, since `bq_upload_result.py` expects
the `big_query_table` argument to have the format `<dataset name>.<table name>`.
The project ID is already encoded in the script.
```
+ python3 /src/code/tools/run_tests/performance/bq_upload_result.py --bq_result_table=grpc-testing.e2e_benchmarks.experimental_results_hork_x5
Traceback (most recent call last):
File "/src/code/tools/run_tests/performance/bq_upload_result.py", line 177, in <module>
dataset_id, table_id = args.bq_result_table.split('.', 2)
ValueError: too many values to unpack (expected 2)
```
4 years ago
113cd9546d
Provide custom sponge configs to exclude manual runs from testgrid ( #26283 )
...
* Provide custom sponge configs
* Correct the script
* Allow test scripts to produce artifacts through Docker
* Overcome the direcotry clone in our docker script
* Expose TESTGRID_EXCLUDE and GIT_ORIGIN_URL through docker run
* Make sanity tests happy
4 years ago
1e187b58db
Run all kokoro performance tests on dedicated node pools. ( #26286 )
...
* Run all kokoro performance tests on dedicated node pools.
Both official and experimental tests run with kokoro are set to run on separate node pools with the suffix "-ci" (drivers-ci, workers-8core-ci, workers-32core-ci), separate from the default pools used for manual runs.
4 years ago
0c5808603f
Add a flag to ensure firewall rule exists ( #26255 )
...
* Add CSDS validation ability to PSM Sec framework
* Add firewall create/delete functionality
* Polish the PR
* Re-number the sub tests
* Add a flag to ensure firewall rule exists
* Add ensure_firewall to local-dev.cfg.example
* Update the firewall creation interface
* Address comments
* Address comments
* Update the firewall script to run smoothly
* Polish firewall creation and deletion && address comments
* Update tools/run_tests/xds_k8s_test_driver/framework/xds_k8s_testcase.py
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
* Move allowed ports to cls property
* Improve readability & prevent attr error
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
4 years ago
2bb4f5676b
Update load test deadlines and differentiate kokoro runs. ( #26281 )
...
This change sets the deadline of master and experimental kokoro jobs to match their running interval (4 hours and 12 hours), and makes a change so runs initiated by kokoro are marked 'kokoro' for the master job and 'kokoro-test' for the experimental job.
4 years ago
c8350cce04
add a new job for "official" runs of oss benchmark harness ( #26280 )
4 years ago
a94274a224
List pods that may be left over from previous kokoro run. ( #26266 )
4 years ago
374e7b2cb4
Add CSDS validation ability to PSM Sec framework ( #26230 )
...
* Add CSDS validation ability to PSM Sec framework
* Add firewall create/delete functionality
* Polish the PR
* Re-number the sub tests
* Remove firewall create/delete ability
* Apply suggestions from code review
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
* Make Kokoro's yapf happy
* TIL how yapf and list-trailing-comma work
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
4 years ago
abe8e854e5
Update Java client version in interop matrix. ( #26251 )
4 years ago
b6038f8e9f
Save 8-core and 32-core performance test results to separate tables. ( #26262 )
4 years ago
049d4e5bb1
log timing info for image build and test runner ( #26261 )
4 years ago
32024e3e46
Adjust concurrency levels for performance tests. ( #26241 )
...
Experiments show that 4 tests running concurrrently (two on 8-core nodes and two on 32-core nodes) is enough to run all tests within two hours with time to spare.
4 years ago
7e14d23ab4
Address feedback on performance tests continuous runs. ( #26232 )
4 years ago
a543f77886
Update test runner invocation in performance tests. ( #26235 )
...
* Removes optional flag -a, allowing it to be changed later to a long-form flag.
* Updates concurrency levels to one more than what each worker node pool can support (each test requires two workers, and there are nine nodes in each pool, so each node can support four tests).
4 years ago
60c74c29f5
Integrate test runner into kokoro performance runs. ( #26225 )
4 years ago
e002ab4f4a
Just update the timeout ( #26223 )
4 years ago
9e86baaea6
Revert grpc_xds_k8s_python timeout to 120mins ( #26221 )
...
Seems to have been inadvertently increased in #26187
4 years ago
fadd0534c2
Revert grpc_xds_k8s job timeouts back to 120 mins ( #26219 )
4 years ago
8a2754487c
Employ prebuilt images in continuous build. ( #26184 )
...
* Employ prebuilt images in continuous build.
This commits updated Kokoro build job to use prebuilt images to
run tests. The loadtest template was generated using
loadtest_template.py.
4 years ago
9990ce0dc4
Fix typo ( #26215 )
4 years ago
a989179ace
Bump master to v1.39.0 ( #26207 )
...
* Bump version to v1.39.0
* Regenerate projects
* Buildifier format
4 years ago
0aecb90a9c
Add steps to run xDS in a non-exclusive project ( #26204 )
...
* Add steps to run xDS in a non-exclusive project
* Update tools/run_tests/xds_k8s_test_driver/README.md
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
* Update tools/run_tests/xds_k8s_test_driver/README.md
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
* Add .cfg and clean-up sections
* Use a newer commit hash
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
4 years ago
7d8a59cc6e
Python simpler distribtests ( #26176 )
...
* add single-job python distribtests for linux
* add kokoro job config grpc_distribtests_python.cfg
* address review comments
4 years ago
cf7f5a0b85
Revert "[xDS interop] Updating the config update timeout to 600s ( #26090 )" ( #26197 )
...
This reverts commit 9bc421c6cf
4 years ago
2ee8c49af0
buildscripts: switch xds-k8s cluster to 1.20.x ( #26181 )
4 years ago
eec83fb2b2
Workaround quota issue with target-grpc-proxies ( #26192 )
4 years ago
2c2b82e7c0
Maximize 32 cores ( #26188 )
4 years ago
24e9a6978b
Increase artifact build timeout for windows-C# ( #26179 )
...
The 30min timeout has caused the multiarch artifact build to fail twice
in the past week. See
http://sponge2/55f7f6f8-d3c0-4b6e-91c8-c0c316f4717b
4 years ago
9b4bf90753
Increase xds job timeouts ( #26187 )
4 years ago
9bc421c6cf
[xDS interop] Updating the config update timeout to 600s ( #26090 )
...
* Updating the config update timeout to 600s
* Remove unnecessary lines and comments
4 years ago
32e83431d1
Add explanatory comments ( #26177 )
4 years ago
25f5399b41
Add grpcio-admin Python package ( #26166 )
...
* Add grpcio-admin Python package
* Polish package content
* Make Linux artifact build happy
* Improve documentation
4 years ago
9b87fb33bf
Fixes broken tests by using an upgraded pip ( #26154 )
4 years ago
1c49176a24
Add load test that measures QPS for dashboard display. ( #26153 )
...
This changes adds a test that measures QPS. The tests currently running measure latency, which is more variable.
4 years ago
dc63d6a53e
Add CSDS API to Python ( #26114 )
...
* Add grpcio-csds pacakge
* Remove unused file
* Fix the proto import path issue
* Update the CSDS package and xds-protos for PY2
* Make tests happy
* Fix Bazel proto dependency
* Add Python2 tests for CSDS
4 years ago
44a4a2ea62
Fix typos and format of LoadTest generator output. ( #26149 )
...
This change fixes typos and makes minor changes to the format of the generated yaml files for LoadTest configuration (embedded scenarios end in newline, and element lists are indented). The templates generated earlier are also updated.
4 years ago
d61db49b48
Add python3.8 aarch64 wheel distribtest ( #26136 )
...
* add python3.8 aarch64 distribtest
* register qemu emulator for linux distribtests
4 years ago
81276fff2e
Update protobuf version to 3.15.8 ( #26105 )
...
* Update protobuf version to 3.15.8
* Run tools/distrib/python/make_grpcio_tools.py
4 years ago
68aed165a7
Add xDS TD API interop tests: metadata_filter, forwarding_rule_port_match, api_listener ( #26065 )
4 years ago
4c40ee3f78
move parse_address and sockaddr_utils out of iomgr directory ( #26077 )
...
* move parse_address and sockaddr_utils out of iomgr directory
* clang-format
* fix python
* fix for import
* fix build file for import
4 years ago
802375393a
Use go1.16 for go interop tests and for newly added interop_matrix tests. ( #26124 )
...
* use go1.16 for go interop tests
* add go1.16 runtime support for interop_matrix tests
* update copyright headers
4 years ago
26ceb8693a
Enable Traffic Director time tracer ( #26111 )
4 years ago
fe56d1a39a
Update boringssl submodule ( #26101 )
...
* update submodule boringssl-with-bazel with origin/master-with-bazel
* Update boringssl dependency to master-with-bazel commit SHA
* Generate projects
* Updated boringssl sha256
* Generate boringssl prefix headers
* Increment podspec version
4 years ago
457fd3d41c
RBAC Engine implementation. ( #25948 )
4 years ago
5f3fb66688
Run test that will show on the dashboard. ( #26096 )
4 years ago
d0256d9085
xds-k8s: retry tearDown multiple times, and doesn't fail test results ( #26104 )
4 years ago
f9b667243b
xds-k8s buildscript should use the latest version of the driver ( #26100 )
4 years ago
368b9077e2
xds-k8s kokoro buildscripts: exclude from tests suites ( #26098 )
4 years ago
Richard Belleville
Lidi Zheng
AJ Heller
Paulo Castello da Costa
Jan Tattermusch
Chengyuan Zhang
Yash Tibrewal
Wanlin Du
Eric Gribkoff
Sergii Tkachenko
Esun Kim
yifeizhuang
Mark D. Roth
Ashitha Santhosh