7d2f9ff515
Build visibility macro system ( #26252 )
...
A corresponding update to the build system will need to occur before this is submitted.
Add a way of labelling in build configuration meta-visibility-rules, so that these can be leveraged to restrict visibility in Google's build system upstream.
4 years ago
12372fb69f
Fix invalid argument in README example for loadtest_config.py ( #26277 )
...
This example crashes the driver process, since `bq_upload_result.py` expects
the `big_query_table` argument to have the format `<dataset name>.<table name>`.
The project ID is already encoded in the script.
```
+ python3 /src/code/tools/run_tests/performance/bq_upload_result.py --bq_result_table=grpc-testing.e2e_benchmarks.experimental_results_hork_x5
Traceback (most recent call last):
File "/src/code/tools/run_tests/performance/bq_upload_result.py", line 177, in <module>
dataset_id, table_id = args.bq_result_table.split('.', 2)
ValueError: too many values to unpack (expected 2)
```
4 years ago
dbde1a21dc
Don't use legacy EDS-only flow for google-c2p resolver. ( #26284 )
4 years ago
2bb20d25a4
Revert "ring_hash LB policy implementation ( #26285 )" ( #26303 )
...
This reverts commit c55c7c065e
4 years ago
0f80378a21
Resolve race between OnReadDone(ok=false) and IsCancelled ( #26245 )
...
* Resolve and test race between OnReadDone(ok=false) and IsCancelled
* Fix retry case
* Fix health check case
* Address reviewer comments.
* ADD TODO requested by markdroth
4 years ago
113cd9546d
Provide custom sponge configs to exclude manual runs from testgrid ( #26283 )
...
* Provide custom sponge configs
* Correct the script
* Allow test scripts to produce artifacts through Docker
* Overcome the direcotry clone in our docker script
* Expose TESTGRID_EXCLUDE and GIT_ORIGIN_URL through docker run
* Make sanity tests happy
4 years ago
d7954e8300
Move async connect to Executor, keep Executor alive longer ( #26258 )
4 years ago
1e187b58db
Run all kokoro performance tests on dedicated node pools. ( #26286 )
...
* Run all kokoro performance tests on dedicated node pools.
Both official and experimental tests run with kokoro are set to run on separate node pools with the suffix "-ci" (drivers-ci, workers-8core-ci, workers-32core-ci), separate from the default pools used for manual runs.
4 years ago
0c5808603f
Add a flag to ensure firewall rule exists ( #26255 )
...
* Add CSDS validation ability to PSM Sec framework
* Add firewall create/delete functionality
* Polish the PR
* Re-number the sub tests
* Add a flag to ensure firewall rule exists
* Add ensure_firewall to local-dev.cfg.example
* Update the firewall creation interface
* Address comments
* Address comments
* Update the firewall script to run smoothly
* Polish firewall creation and deletion && address comments
* Update tools/run_tests/xds_k8s_test_driver/framework/xds_k8s_testcase.py
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
* Move allowed ports to cls property
* Improve readability & prevent attr error
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
4 years ago
c55c7c065e
ring_hash LB policy implementation ( #26285 )
...
* ring_hash LB policy (#25697 )
* Ring Hash Policy implementation
* Code review comment fixing
* Fixing code review comments.
* Code review comment fixing
* Fixing reconnect logic
* adding helper method for pick
* Holding on to ref to parent
* first attempt at calling AttemptToConnect
* Fixing state change
* Fixing code review comments
* Fixing the reconnect from channel watcher code
* Fixing the BUILD to include new policy
* Fixing major code review suggestion
* Fixing code review comments
* Fixing code review suggestions
* Initial 2 tests.
* Adding channel id case.
* Fixing code review comments.
* Small change to get the spread of backends
* Add header hashing tests
* Added more tests and debugging
* Fixing Header hash
* Added more tests
* cleanup
* removing debugs
* Fixing code review comments.
* code review fixing
* combining code and match design
* fixing code review comments.
* Fixed IDLE case
* Moving tests
* Fixing code review comments
* Adding more tests according to code review comments.
* Added tests with differetn types of weights
* Adding terminal policy case
* Remove hash_func as there is only 1
* Added nack invalid hash function
* Added NACK cases
* fixing build error
* fixing build
* small warning
* adding regex test
* Adding policy tests
* fixing warning
* fixing warning
* fixing code reivew comments.
* fixing IDLE case
* Code review comments.
* fixing code review comments
* Making a helper function
* fixing reattempt case
* Added afew more tests.
* Adding more tests
* Added backward compatible test
* FIxing the reattempt test
* Clean up
* fixing clang error
* fixing clang error
* Fix logic discovered during code review
* code review comments
* code review comments
* code review comment
* clean up tests
* fixing code review comments
* clean up tests
* Separated test
* Fixing test
* fixing test
* fixing clang error
* Addressing code review suggestions
* Fixing last bit of code review comments
* Fixing flaky tests
* Fixing last bit of code review comments
* clean debugs
* Remove a verbose log
* Relaxing deadline exceeded for 1st RPC until ring is optimized.
Making Hash more efficient for random case.
4 years ago
467c0d742c
fix xds resolver to add XdsClient to channel args even on errors ( #26282 )
4 years ago
2bb4f5676b
Update load test deadlines and differentiate kokoro runs. ( #26281 )
...
This change sets the deadline of master and experimental kokoro jobs to match their running interval (4 hours and 12 hours), and makes a change so runs initiated by kokoro are marked 'kokoro' for the master job and 'kokoro-test' for the experimental job.
4 years ago
c8350cce04
add a new job for "official" runs of oss benchmark harness ( #26280 )
4 years ago
a94274a224
List pods that may be left over from previous kokoro run. ( #26266 )
4 years ago
c20356c1ba
Update conditional matcher ctors and include NotMatcher. ( #26256 )
4 years ago
374e7b2cb4
Add CSDS validation ability to PSM Sec framework ( #26230 )
...
* Add CSDS validation ability to PSM Sec framework
* Add firewall create/delete functionality
* Polish the PR
* Re-number the sub tests
* Remove firewall create/delete ability
* Apply suggestions from code review
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
* Make Kokoro's yapf happy
* TIL how yapf and list-trailing-comma work
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
4 years ago
abe8e854e5
Update Java client version in interop matrix. ( #26251 )
4 years ago
b6038f8e9f
Save 8-core and 32-core performance test results to separate tables. ( #26262 )
4 years ago
620b064622
Rotation to Esun.
4 years ago
770989b554
Normalize grpc_error_handle usage ( #26240 )
4 years ago
049d4e5bb1
log timing info for image build and test runner ( #26261 )
4 years ago
cc9326c936
Correctly reset msg_controllen before processing TCP error queue. ( #26250 )
...
When we call recvmsg(), we are allowed to set msg_control and
msg_controllen to receive ancillary messages from the TCP socket.
msg_controllen is set to available buffer length for such sockets
before we call recvmsg(); after the call returns successfully, it
contains the amount of available data in the ancillary buffer.
Existing behaviour is buggy; it calls recvmsg() in a loop but does not
set msg_controllen to the size of the full buffer correctly on each
iteration. This leads to a surfeit of error log messages, claiming the
ancillary messages had to be truncated due to insufficient buffer
space.
This patch correctly sets the ancillary buffer size before each call
to recvmsg() when processing the TCP error queue.
4 years ago
f36a31b6aa
Revert "ring_hash LB policy ( #25697 )" ( #26238 )
...
This reverts commit 2aefb26f5d
4 years ago
32024e3e46
Adjust concurrency levels for performance tests. ( #26241 )
...
Experiments show that 4 tests running concurrrently (two on 8-core nodes and two on 32-core nodes) is enough to run all tests within two hours with time to spare.
4 years ago
7e14d23ab4
Address feedback on performance tests continuous runs. ( #26232 )
4 years ago
a543f77886
Update test runner invocation in performance tests. ( #26235 )
...
* Removes optional flag -a, allowing it to be changed later to a long-form flag.
* Updates concurrency levels to one more than what each worker node pool can support (each test requires two workers, and there are nine nodes in each pool, so each node can support four tests).
4 years ago
2aefb26f5d
ring_hash LB policy ( #25697 )
...
* Ring Hash Policy implementation
* Code review comment fixing
* Fixing code review comments.
* Code review comment fixing
* Fixing reconnect logic
* adding helper method for pick
* Holding on to ref to parent
* first attempt at calling AttemptToConnect
* Fixing state change
* Fixing code review comments
* Fixing the reconnect from channel watcher code
* Fixing the BUILD to include new policy
* Fixing major code review suggestion
* Fixing code review comments
* Fixing code review suggestions
* Initial 2 tests.
* Adding channel id case.
* Fixing code review comments.
* Small change to get the spread of backends
* Add header hashing tests
* Added more tests and debugging
* Fixing Header hash
* Added more tests
* cleanup
* removing debugs
* Fixing code review comments.
* code review fixing
* combining code and match design
* fixing code review comments.
* Fixed IDLE case
* Moving tests
* Fixing code review comments
* Adding more tests according to code review comments.
* Added tests with differetn types of weights
* Adding terminal policy case
* Remove hash_func as there is only 1
* Added nack invalid hash function
* Added NACK cases
* fixing build error
* fixing build
* small warning
* adding regex test
* Adding policy tests
* fixing warning
* fixing warning
* fixing code reivew comments.
* fixing IDLE case
* Code review comments.
* fixing code review comments
* Making a helper function
* fixing reattempt case
* Added afew more tests.
* Adding more tests
* Added backward compatible test
* FIxing the reattempt test
* Clean up
* fixing clang error
* fixing clang error
* Fix logic discovered during code review
* code review comments
* code review comments
* code review comment
* clean up tests
* fixing code review comments
* clean up tests
* Separated test
* Fixing test
* fixing test
* fixing clang error
* Addressing code review suggestions
* Fixing last bit of code review comments
* Fixing flaky tests
* Fixing last bit of code review comments
* clean debugs
* Remove a verbose log
4 years ago
98ccb7fd94
Add C# plugin "file_suffix" option defaulting to "Grpc.cs" ( #26162 )
...
* add C# plugin "file_extension" option defaulting to "Grpc.cs"
* rename to "file_suffix" to avoid confusion
* address review feedback
4 years ago
60c74c29f5
Integrate test runner into kokoro performance runs. ( #26225 )
4 years ago
c6fbf43390
Add "GeneratedCode" attribute to generated service stubs ( #26164 )
...
* mark generated members in *Grpc.cs as [GeneratedCode]
* regenerate protos
4 years ago
e002ab4f4a
Just update the timeout ( #26223 )
4 years ago
9e86baaea6
Revert grpc_xds_k8s_python timeout to 120mins ( #26221 )
...
Seems to have been inadvertently increased in #26187
4 years ago
fadd0534c2
Revert grpc_xds_k8s job timeouts back to 120 mins ( #26219 )
4 years ago
cbcb0253a0
Additional logging for proto deserialization ( #26159 )
...
* Fix build failures in xds_end2end_test
* Change Status::OK to StatusCode::OK
* Added additional logging for proto deserialization failure
* Added additional logging for serialization failure
* Revert "Added additional logging for serialization failure"
This reverts commit 2dbbbed9d431f4e6e3c8
4 years ago
7080182ae9
Add EventEngine's port.h to the podspec ( #26220 )
...
This file is needed for the Objective-C cocoapod build.
4 years ago
8a2754487c
Employ prebuilt images in continuous build. ( #26184 )
...
* Employ prebuilt images in continuous build.
This commits updated Kokoro build job to use prebuilt images to
run tests. The loadtest template was generated using
loadtest_template.py.
4 years ago
9990ce0dc4
Fix typo ( #26215 )
4 years ago
534843d476
Add test for spm build. ( #26178 )
4 years ago
c90fae35cb
IPMatcher implementation. ( #26132 )
4 years ago
a989179ace
Bump master to v1.39.0 ( #26207 )
...
* Bump version to v1.39.0
* Regenerate projects
* Buildifier format
4 years ago
44b113b3c1
PHP: stop reading composer.json file just to read the version string ( #26156 )
...
* PHP: remove reading from composer.json just for the version string
* Be extra defensive
4 years ago
bba425fa11
add php math_server ( #26201 )
4 years ago
34ea49a9b1
fix status code ( #26203 )
4 years ago
0aecb90a9c
Add steps to run xDS in a non-exclusive project ( #26204 )
...
* Add steps to run xDS in a non-exclusive project
* Update tools/run_tests/xds_k8s_test_driver/README.md
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
* Update tools/run_tests/xds_k8s_test_driver/README.md
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
* Add .cfg and clean-up sections
* Use a newer commit hash
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
4 years ago
5b035265ce
Describe status codes on the EventEngine API ( #26180 )
...
This continues the work of ironing out EventEngine API details.
4 years ago
7d8a59cc6e
Python simpler distribtests ( #26176 )
...
* add single-job python distribtests for linux
* add kokoro job config grpc_distribtests_python.cfg
* address review comments
4 years ago
cf7f5a0b85
Revert "[xDS interop] Updating the config update timeout to 600s ( #26090 )" ( #26197 )
...
This reverts commit 9bc421c6cf
4 years ago
2ee8c49af0
buildscripts: switch xds-k8s cluster to 1.20.x ( #26181 )
4 years ago
eec83fb2b2
Workaround quota issue with target-grpc-proxies ( #26192 )
4 years ago
2c2b82e7c0
Maximize 32 cores ( #26188 )
4 years ago
Craig Tiller
AJ Heller
Mark D. Roth
donnadionne
Vijay Pai
Lidi Zheng
Paulo Castello da Costa
Jan Tattermusch
Ashitha Santhosh
Chengyuan Zhang
Nicolas "Pixel" Noble
Esun Kim
Arjun Roy
Yash Tibrewal
Alisha Nanda
Wanlin Du
yulin liang
Stanley Cheung
Hannah Shi
Eric Gribkoff
Sergii Tkachenko