Lidi Zheng
113cd9546d
Provide custom sponge configs to exclude manual runs from testgrid ( #26283 )
...
* Provide custom sponge configs
* Correct the script
* Allow test scripts to produce artifacts through Docker
* Overcome the direcotry clone in our docker script
* Expose TESTGRID_EXCLUDE and GIT_ORIGIN_URL through docker run
* Make sanity tests happy
4 years ago
Paulo Castello da Costa
1e187b58db
Run all kokoro performance tests on dedicated node pools. ( #26286 )
...
* Run all kokoro performance tests on dedicated node pools.
Both official and experimental tests run with kokoro are set to run on separate node pools with the suffix "-ci" (drivers-ci, workers-8core-ci, workers-32core-ci), separate from the default pools used for manual runs.
4 years ago
Lidi Zheng
0c5808603f
Add a flag to ensure firewall rule exists ( #26255 )
...
* Add CSDS validation ability to PSM Sec framework
* Add firewall create/delete functionality
* Polish the PR
* Re-number the sub tests
* Add a flag to ensure firewall rule exists
* Add ensure_firewall to local-dev.cfg.example
* Update the firewall creation interface
* Address comments
* Address comments
* Update the firewall script to run smoothly
* Polish firewall creation and deletion && address comments
* Update tools/run_tests/xds_k8s_test_driver/framework/xds_k8s_testcase.py
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
* Move allowed ports to cls property
* Improve readability & prevent attr error
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
4 years ago
Paulo Castello da Costa
2bb4f5676b
Update load test deadlines and differentiate kokoro runs. ( #26281 )
...
This change sets the deadline of master and experimental kokoro jobs to match their running interval (4 hours and 12 hours), and makes a change so runs initiated by kokoro are marked 'kokoro' for the master job and 'kokoro-test' for the experimental job.
4 years ago
Jan Tattermusch
c8350cce04
add a new job for "official" runs of oss benchmark harness ( #26280 )
4 years ago
Paulo Castello da Costa
a94274a224
List pods that may be left over from previous kokoro run. ( #26266 )
4 years ago
Lidi Zheng
374e7b2cb4
Add CSDS validation ability to PSM Sec framework ( #26230 )
...
* Add CSDS validation ability to PSM Sec framework
* Add firewall create/delete functionality
* Polish the PR
* Re-number the sub tests
* Remove firewall create/delete ability
* Apply suggestions from code review
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
* Make Kokoro's yapf happy
* TIL how yapf and list-trailing-comma work
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
4 years ago
Chengyuan Zhang
abe8e854e5
Update Java client version in interop matrix. ( #26251 )
4 years ago
Paulo Castello da Costa
b6038f8e9f
Save 8-core and 32-core performance test results to separate tables. ( #26262 )
4 years ago
Jan Tattermusch
049d4e5bb1
log timing info for image build and test runner ( #26261 )
4 years ago
Paulo Castello da Costa
32024e3e46
Adjust concurrency levels for performance tests. ( #26241 )
...
Experiments show that 4 tests running concurrrently (two on 8-core nodes and two on 32-core nodes) is enough to run all tests within two hours with time to spare.
4 years ago
Paulo Castello da Costa
7e14d23ab4
Address feedback on performance tests continuous runs. ( #26232 )
4 years ago
Paulo Castello da Costa
a543f77886
Update test runner invocation in performance tests. ( #26235 )
...
* Removes optional flag -a, allowing it to be changed later to a long-form flag.
* Updates concurrency levels to one more than what each worker node pool can support (each test requires two workers, and there are nine nodes in each pool, so each node can support four tests).
4 years ago
Paulo Castello da Costa
60c74c29f5
Integrate test runner into kokoro performance runs. ( #26225 )
4 years ago
Lidi Zheng
e002ab4f4a
Just update the timeout ( #26223 )
4 years ago
Yash Tibrewal
9e86baaea6
Revert grpc_xds_k8s_python timeout to 120mins ( #26221 )
...
Seems to have been inadvertently increased in #26187
4 years ago
Yash Tibrewal
fadd0534c2
Revert grpc_xds_k8s job timeouts back to 120 mins ( #26219 )
4 years ago
Wanlin Du
8a2754487c
Employ prebuilt images in continuous build. ( #26184 )
...
* Employ prebuilt images in continuous build.
This commits updated Kokoro build job to use prebuilt images to
run tests. The loadtest template was generated using
loadtest_template.py.
4 years ago
Yash Tibrewal
9990ce0dc4
Fix typo ( #26215 )
4 years ago
Yash Tibrewal
a989179ace
Bump master to v1.39.0 ( #26207 )
...
* Bump version to v1.39.0
* Regenerate projects
* Buildifier format
4 years ago
Lidi Zheng
0aecb90a9c
Add steps to run xDS in a non-exclusive project ( #26204 )
...
* Add steps to run xDS in a non-exclusive project
* Update tools/run_tests/xds_k8s_test_driver/README.md
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
* Update tools/run_tests/xds_k8s_test_driver/README.md
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
* Add .cfg and clean-up sections
* Use a newer commit hash
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
4 years ago
Jan Tattermusch
7d8a59cc6e
Python simpler distribtests ( #26176 )
...
* add single-job python distribtests for linux
* add kokoro job config grpc_distribtests_python.cfg
* address review comments
4 years ago
Eric Gribkoff
cf7f5a0b85
Revert "[xDS interop] Updating the config update timeout to 600s ( #26090 )" ( #26197 )
...
This reverts commit 9bc421c6cf
.
4 years ago
Sergii Tkachenko
2ee8c49af0
buildscripts: switch xds-k8s cluster to 1.20.x ( #26181 )
4 years ago
Eric Gribkoff
eec83fb2b2
Workaround quota issue with target-grpc-proxies ( #26192 )
4 years ago
Esun Kim
2c2b82e7c0
Maximize 32 cores ( #26188 )
4 years ago
AJ Heller
24e9a6978b
Increase artifact build timeout for windows-C# ( #26179 )
...
The 30min timeout has caused the multiarch artifact build to fail twice
in the past week. See
http://sponge2/55f7f6f8-d3c0-4b6e-91c8-c0c316f4717b
4 years ago
Eric Gribkoff
9b4bf90753
Increase xds job timeouts ( #26187 )
4 years ago
Lidi Zheng
9bc421c6cf
[xDS interop] Updating the config update timeout to 600s ( #26090 )
...
* Updating the config update timeout to 600s
* Remove unnecessary lines and comments
4 years ago
AJ Heller
32e83431d1
Add explanatory comments ( #26177 )
4 years ago
Lidi Zheng
25f5399b41
Add grpcio-admin Python package ( #26166 )
...
* Add grpcio-admin Python package
* Polish package content
* Make Linux artifact build happy
* Improve documentation
4 years ago
AJ Heller
9b87fb33bf
Fixes broken tests by using an upgraded pip ( #26154 )
4 years ago
Paulo Castello da Costa
1c49176a24
Add load test that measures QPS for dashboard display. ( #26153 )
...
This changes adds a test that measures QPS. The tests currently running measure latency, which is more variable.
4 years ago
Lidi Zheng
dc63d6a53e
Add CSDS API to Python ( #26114 )
...
* Add grpcio-csds pacakge
* Remove unused file
* Fix the proto import path issue
* Update the CSDS package and xds-protos for PY2
* Make tests happy
* Fix Bazel proto dependency
* Add Python2 tests for CSDS
4 years ago
Paulo Castello da Costa
44a4a2ea62
Fix typos and format of LoadTest generator output. ( #26149 )
...
This change fixes typos and makes minor changes to the format of the generated yaml files for LoadTest configuration (embedded scenarios end in newline, and element lists are indented). The templates generated earlier are also updated.
4 years ago
Jan Tattermusch
d61db49b48
Add python3.8 aarch64 wheel distribtest ( #26136 )
...
* add python3.8 aarch64 distribtest
* register qemu emulator for linux distribtests
4 years ago
Yash Tibrewal
81276fff2e
Update protobuf version to 3.15.8 ( #26105 )
...
* Update protobuf version to 3.15.8
* Run tools/distrib/python/make_grpcio_tools.py
4 years ago
yifeizhuang
68aed165a7
Add xDS TD API interop tests: metadata_filter, forwarding_rule_port_match, api_listener ( #26065 )
4 years ago
Mark D. Roth
4c40ee3f78
move parse_address and sockaddr_utils out of iomgr directory ( #26077 )
...
* move parse_address and sockaddr_utils out of iomgr directory
* clang-format
* fix python
* fix for import
* fix build file for import
4 years ago
Jan Tattermusch
802375393a
Use go1.16 for go interop tests and for newly added interop_matrix tests. ( #26124 )
...
* use go1.16 for go interop tests
* add go1.16 runtime support for interop_matrix tests
* update copyright headers
4 years ago
Lidi Zheng
26ceb8693a
Enable Traffic Director time tracer ( #26111 )
4 years ago
Yash Tibrewal
fe56d1a39a
Update boringssl submodule ( #26101 )
...
* update submodule boringssl-with-bazel with origin/master-with-bazel
* Update boringssl dependency to master-with-bazel commit SHA
* Generate projects
* Updated boringssl sha256
* Generate boringssl prefix headers
* Increment podspec version
4 years ago
Ashitha Santhosh
457fd3d41c
RBAC Engine implementation. ( #25948 )
4 years ago
Paulo Castello da Costa
5f3fb66688
Run test that will show on the dashboard. ( #26096 )
4 years ago
Sergii Tkachenko
d0256d9085
xds-k8s: retry tearDown multiple times, and doesn't fail test results ( #26104 )
4 years ago
Sergii Tkachenko
f9b667243b
xds-k8s buildscript should use the latest version of the driver ( #26100 )
4 years ago
Sergii Tkachenko
368b9077e2
xds-k8s kokoro buildscripts: exclude from tests suites ( #26098 )
4 years ago
Ben Beasley
d483841001
Explicitly import importlib.abc; required on Python 3.10. Fixes #26062 . ( #26083 )
4 years ago
Sergii Tkachenko
ef930b7703
buildscripts: xds-k8s pin pip to 21.0.1
...
pip 21.1 released on Apr 24 introduced a regression for python 3.6.1.
The regression was identified on Apr 24, the fix merged on Apr 25.
The fix is expected to be delivered in the 21.1.1 patch.
There's no clear date, when 21.1.1 will be released.
Until then, pin is temporarily pinned to the previous release, 21.0.1.
4 years ago
Richard Belleville
3732ee0317
ADD Python xDS security interop test CI scripts ( #26073 )
4 years ago