Menghan Li
ef68db91da
xds/interop: more affinity tests ( #26831 )
...
* xds/interop: more affinity tests
- send RPCs without affinity header (they will pick random backends)
* add second test
- multiple header
* cleanup
* c0
* REVERT THIS, regenerate resources
* Revert "REVERT THIS, regenerate resources"
This reverts commit 18ea36f1fe
.
3 years ago
Sergii Tkachenko
bf186156bc
xds-k8s: Link xDS test client and test server logs in Logs Explorer ( #26844 )
3 years ago
ZHANG Dapeng
ca482bdbc7
Enable xds retry test for cpp ( #26828 )
...
* enable retry
* enable cpp
* fix cpp format
* fix indent
3 years ago
Eric Gribkoff
1b758b7660
Avoid unsetting target_proxy when it is actually a gRPC target proxy ( #26824 )
...
Otherwise, unless force_cleanup is set to true, the HTTP target proxy
deletion fails but still unsets the target_proxy field, resulting in the
gRPC target proxy deletion being skipped (and preventing all subsequent
cleanup operations)
3 years ago
Lidi Zheng
176c77f52d
Fix TestNonMatchingFaultInjection for Python ( #26801 )
3 years ago
ZHANG Dapeng
5011372677
Add xds retry interop test to GKE test framework ( #26791 )
...
* Add xds retry interop test to GKE test framework
* s/Affinity/Retry/
* more informative test name
* enable retry
* update java test server
* add missing import
3 years ago
Lidi Zheng
2231c2ba77
Introduce Python import sorting to our sanity test suite ( #26768 )
...
* Add isort_code.sh to sanity tests
* Run tools/distrib/isort_code.sh
* Fine tune the import order for relative imports
* Make pylint and project generation happy
* Fix a few corner cases
* Use --check instead of --diff
* The import order impacts test result somehow
* Make isort print diff and check output at the same time
* Let tools/run_tests/python_utils be firstparty library
* Run isort against latest HEAD
3 years ago
Sergii Tkachenko
467c5ac73e
xds-k8s: Fix regression with returning multiple test servers ( #26786 )
...
Introduced in #26759
3 years ago
Lidi Zheng
48ce79f7e5
Allow url-map tests to run concurrently ( #26764 )
...
* Allow url-map tests to run concurrently
* Clean-up client namespace if everything goes smoothly
* Make isort happy
* Update tools/internal_ci/linux/grpc_xds_url_map_python.sh
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
* Add logging && change suffix generation
* Move the suffix generation to helpers
* Remove unused import
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
3 years ago
Lidi Zheng
f31d8a2fb2
Skip affinity tests for Golang clients ( #26771 )
3 years ago
Menghan Li
ee17927fce
xds/interop: basic header based affinity test ( #26759 )
...
* affinity test
- most basic affinity test
- verify that the received RDS and CDS are correctly configured for affinity
- verify that all RPCs are only sent to the one backend
- verify that only one sub-channel is connected, the other 2 are IDLE
And infra changes:
- add argument to set affinity config when creating backend service
- add a new backend service "affinity" to be shared by all affinity test
- this backend service is configured to do header affinity
- it has 3 endpoints
- replica support copied from PR https://github.com/grpc/grpc/pull/26360
- update backend services from GRPC to HTTP2, to disable validate-for-proxyless
- this will be reverted later
- add channelz function to query subchannels
- add method to configure the initial RPC config (RPC types and RPC metadata) when creating the client
- set env var to enable RING_HASH support
* c1
* REVERT THIS: update strategy to trigger a manual build
* config: suffix to prefix
* Revert "REVERT THIS: update strategy to trigger a manual build"
This reverts commit 830776fef9
.
3 years ago
Lidi Zheng
6995dcd958
Fix the url-map and backend creation conflict attempt 2 ( #26748 )
...
* Move url-map creation down
* Revert "Fix the backend service creation problem in xds k8s framework (#26713 )"
This reverts commit b465284489
.
3 years ago
Lidi Zheng
b465284489
Fix the backend service creation problem in xds k8s framework ( #26713 )
3 years ago
Sergii Tkachenko
b6d9aedba0
xds-k8s: Adapt URL Map tests to use resource prefix/suffix ( #26671 )
3 years ago
Sergii Tkachenko
2dc2ef02c3
xds-k8s: Allow multiple instance of the driver to run concurrently ( #26542 )
3 years ago
Lidi Zheng
ee4f6854bd
Migrating urlMap related test cases to K8s framework ( #26367 )
...
* Build url-map test case class & migrate two test cases
- Migrated header matching
- Migrated path matching
* Polish some details
* Give sanity test the trailing line return it wants
* Address comments & add timeout cases
* Add fault injection and CSDS test cases
* Squashed commit of the following:
commit 0bf96a0e3eae59d76a456b7deed2c6c1314f4228
Author: Lidi Zheng <lidiz@google.com>
Date: Tue Jun 8 12:35:19 2021 -0700
Bazel
commit 81b4bf926b656295f1db78ab4c2ff934ab5602af
Author: Lidi Zheng <lidiz@google.com>
Date: Mon Jun 7 00:04:28 2021 -0700
Enable Bazel
commit 245026ed696357308141944aa8c4c9f5b2013a4b
Author: Lidi Zheng <lidiz@google.com>
Date: Fri Jun 4 10:37:48 2021 -0700
Reuse
commit 564d39d28b2201803bfdb379f78e8298623c4029
Author: Lidi Zheng <lidiz@google.com>
Date: Fri Jun 4 01:44:56 2021 -0700
Keep`
commit 83c437d72a76b71948314f7d5389aadca39b3d07
Author: Lidi Zheng <lidiz@google.com>
Date: Thu Jun 3 18:50:47 2021 -0700
1800s timeout
commit 1e790a53cd01a1e54bf7df6793381812a9c58c01
Author: Lidi Zheng <lidiz@google.com>
Date: Thu Jun 3 18:45:41 2021 -0700
Go
commit 68a99640a100ecf2989f0808bd69a8e17f7156bd
Author: Lidi Zheng <lidiz@google.com>
Date: Thu Jun 3 17:26:29 2021 -0700
No
commit d4f6fa5d4a1208c9dfac76e58ca15daa64231c2e
Author: Lidi Zheng <lidiz@google.com>
Date: Thu Jun 3 17:20:46 2021 -0700
L
commit 5ccd048f185c1f5a8d5fdd4359f3157d8d64ea2a
Author: Lidi Zheng <lidiz@google.com>
Date: Thu Jun 3 16:30:55 2021 -0700
Go
commit 411887c7181a593ba3c98fe09bf9f74d52a6ad9c
Author: Lidi Zheng <lidiz@google.com>
Date: Thu Jun 3 15:51:34 2021 -0700
Test
commit 8d005e5203e608c18ffe89fb2f60f81b1ba4ffa8
Author: Lidi Zheng <lidiz@google.com>
Date: Thu Jun 3 15:11:44 2021 -0700
Go
commit 7c189cb59077ecfb981ca99a8458cf44f3c10526
Author: Lidi Zheng <lidiz@google.com>
Date: Thu Jun 3 15:11:03 2021 -0700
Go
commit 8fa65a68ca9d5b71c47c8bdf5367ed3189e49cba
Author: Lidi Zheng <lidiz@google.com>
Date: Thu Jun 3 13:08:11 2021 -0700
Go
* Port changes from dev branch and polish
* Remove unused code
* Fix Bazel build
* Finally find out the secret about rpc-behavior
* Prepare for merging
* Fix bash script and use a more serious name
* Enable port forwarding
* Resolve comments
* Reuse existing code && stylish changes
* Update for interface changes
* Refactor to remove load_tests and explicit global variables
* Improve readability
* Disable AlwaysDelay for now
* Fix issues with resource creation
* Fix unexpected behavior of TestLoader.discover
* Add load_tests to timeout_test
* Improve documentation
* I really shouldn't run tests in parallel at this point
* Resolve reviewers' comments && revert DO-NOT-MERGE changes
* Two small cleanups
* Fix GCP resource creation path
* Polish some test logic
* Correct the non-failfast logic
* Put the accidentally deleted copyright line back
* Separate the Kokoro job from security tests
* Deflake configure and get_stats && remove DO-NOT-MERGE changes
3 years ago
Sergii Tkachenko
0e20a5fce8
xds-k8s: Add code quality helpers ( #26553 )
...
* xds-k8s: add yapf helper
* add isort helper
* Remove workaround for Segmentation fault imports
* Run isort
* Update README.md
3 years ago
Sergii Tkachenko
49e9ef2e39
xds-k8s: fix a bug with ordering flags in run.sh ( #26550 )
...
Append run.sh arguments after the flagfile, so they it's possible to override flags set in the flagfile.
3 years ago
Richard Belleville
80cef13b93
xds-k8s: dataclasses backport not applicable for 3.7+ ( #25924 )
3 years ago
Sergii Tkachenko
ff0c16ad2d
xds-k8s: Fix retries in IAM API wrapper, improve error handling ( #26525 )
3 years ago
Sergii Tkachenko
433c5ea261
xds-k8s: grant roles/iam.workloadIdentityUser automatically ( #26487 )
4 years ago
Easwar Swaminathan
ca9102722d
Add bootstrap_generator to non-secure server deployments as well ( #26355 )
...
In gRPC-Go repo, as part of the PSM security interop tests, we changed
the xDS interop server to register admin services (in both secure and
non-secure modes). Attempting to register CSDS without an xds bootstrap
file causes the server binary to exit.
While we work to find a graceful solution to the problem of registering
CSDS without an xds bootstrap file, adding the bootstrap generator to
the non-secure server deployment fixes the issue.
Also, it looks like we would need an xds bootstrap file for non-secure
servers in the near future to test other server features.
4 years ago
Sergii Tkachenko
3ba36cc0c9
xds-k8s: add run and cleanup helpers, document bin/ scripts ( #26344 )
4 years ago
Lidi Zheng
0c5808603f
Add a flag to ensure firewall rule exists ( #26255 )
...
* Add CSDS validation ability to PSM Sec framework
* Add firewall create/delete functionality
* Polish the PR
* Re-number the sub tests
* Add a flag to ensure firewall rule exists
* Add ensure_firewall to local-dev.cfg.example
* Update the firewall creation interface
* Address comments
* Address comments
* Update the firewall script to run smoothly
* Polish firewall creation and deletion && address comments
* Update tools/run_tests/xds_k8s_test_driver/framework/xds_k8s_testcase.py
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
* Move allowed ports to cls property
* Improve readability & prevent attr error
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
4 years ago
Lidi Zheng
374e7b2cb4
Add CSDS validation ability to PSM Sec framework ( #26230 )
...
* Add CSDS validation ability to PSM Sec framework
* Add firewall create/delete functionality
* Polish the PR
* Re-number the sub tests
* Remove firewall create/delete ability
* Apply suggestions from code review
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
* Make Kokoro's yapf happy
* TIL how yapf and list-trailing-comma work
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
4 years ago
Lidi Zheng
0aecb90a9c
Add steps to run xDS in a non-exclusive project ( #26204 )
...
* Add steps to run xDS in a non-exclusive project
* Update tools/run_tests/xds_k8s_test_driver/README.md
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
* Update tools/run_tests/xds_k8s_test_driver/README.md
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
* Add .cfg and clean-up sections
* Use a newer commit hash
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
4 years ago
Sergii Tkachenko
d0256d9085
xds-k8s: retry tearDown multiple times, and doesn't fail test results ( #26104 )
4 years ago
Seth Vargo
3223b4fe98
Naming fix (secrets manager -> secret manager) ( #25990 )
4 years ago
Sergii Tkachenko
72632aebd7
xds-k8s: Use latest TD bootstrap supporting new secrets dir ( #25925 )
4 years ago
Sergii Tkachenko
9a2c2c0afc
xds-k8s: Update GKE workload certificates: fix annotation ( #25882 )
4 years ago
Sergii Tkachenko
1e065a0918
xds-k8s: Update Private CA GKE workload certificates config ( #25875 )
4 years ago
Sergii Tkachenko
5f8b529506
xds-k8s: Update to TD bootstrap with server_listener_resource_name_template support ( #25746 )
...
Related:
* https://github.com/GoogleCloudPlatform/traffic-director-grpc-bootstrap/pull/14
* https://github.com/grpc/grpc-java/pull/7978
4 years ago
Sergii Tkachenko
65ea33e427
xds-k8s Fix NameError name 'cls' is not defined ( #25615 )
4 years ago
Yash Tibrewal
44e5409a4e
Option to disable local_certificate check from PSM security tests ( #25595 )
...
* Remove local_certificate check from PSM security tests
* Reviewer comments
* Update tools/run_tests/xds_k8s_test_driver/framework/xds_k8s_testcase.py
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
* YAPF code
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
4 years ago
Sergii Tkachenko
ee375222a0
Double WAIT_FOR_BACKEND_SEC ( #25603 )
4 years ago
Sergii Tkachenko
ad461a3c7c
xds-k8s: Update local-dev.cfg.example ( #25552 )
4 years ago
Sergii Tkachenko
900e47b1a9
xds-k8s: set GRPC_XDS_EXPERIMENTAL_NEW_SERVER_API ( #25529 )
4 years ago
Sergii Tkachenko
5426770c73
xds-k8s driver: remove "Client subchannel must have no sockets" check ( #25460 )
4 years ago
Sergii Tkachenko
e98cd15c2e
fixup! xds-k8s driver: switch Backend Health Check from TCP to GRPC
4 years ago
Sergii Tkachenko
21871dcb88
xds-k8s driver: switch Backend Health Check from TCP to GRPC
4 years ago
Sergii Tkachenko
a2aa83abe7
xds-k8s driver: increase timeouts for k8s cleanup operations
4 years ago
Sergii Tkachenko
6a294c38be
xds-k8s driver: Change Endpint Config Selector type to GRPC_SERVER
4 years ago
Sergii Tkachenko
bde2b79cbd
xds-k8s driver: wait server channelz - adjust RPC timeouts
4 years ago
Sergii Tkachenko
e0789a796b
xds-k8s driver: do not override wait for deployment timeout_sec
4 years ago
Sergii Tkachenko
e7616e56bd
xds-k8s driver: increase wait time for deployment available replicas
4 years ago
Hu Shuai
6c6926954d
Fix typo
...
Signed-off-by: Hu Shuai <hus.fnst@cn.fujitsu.com>
4 years ago
Sergii Tkachenko
8db79e2e71
Python style: reformat code using updated yapf 0.30.0
4 years ago
Sergii Tkachenko
d08468b844
xds-k8s driver: support --xds_server_uri flag
4 years ago
Sergii Tkachenko
a05a84b34b
xds-k8s driver: implement PSM security server-authz-error test
4 years ago
Sergii Tkachenko
fb50064d9c
xds-k8s driver: implement PSM security mtls_error test
4 years ago