Menghan Li
e523825c75
xds/cleanup: update build in cleanup kokoro script ( #28654 )
3 years ago
yifeizhuang
b4b6862352
Add api listener test for k8s ( #27534 )
...
This ports the api listener test case to k8s.
3 years ago
Craig Tiller
d2042c1c05
Convert client_authority_filter to a promise. ( #28565 )
...
* Initial ideation
* progress
* progress
* x
* Automated change: Fix sanity tests
* erorrs
* better ordering
* working on it
* xx
* comment
* comment
* Get metadata pointer semantics temporarily right
* fix
* fix
* fix
* fix
* fix
* retry: send at most one cancel_stream op on each call attempt
* fixes
* revert earlier change
* split filter defn from impl
* add tests
* fixes
* Automated change: Fix sanity tests
* review feedback
* review feedback
Co-authored-by: ctiller <ctiller@users.noreply.github.com>
Co-authored-by: Mark D. Roth <roth@google.com>
3 years ago
Esun Kim
55d7631a99
Bump clang 12 to 13 ( #28639 )
3 years ago
Esun Kim
01011ab259
Revert "Buildify Envoy upb ( #28558 )" ( #28648 )
...
This reverts commit 97584d8346
.
3 years ago
Esun Kim
97584d8346
Buildify Envoy upb ( #28558 )
...
* Buildigy xds
* Generate project
* Buildify envoy
* Added new upb files
* Removed unused upb targets
* Fix grpc_cel_engine
* Update envoy-api to the latest
* Regen upb
* Regen projects
* Fix bazel build on MacOS
* More fix on bazel mac
* Disable grpc_tool_test on Mac
* Regen projects
3 years ago
Craig Tiller
74a2cb6e2b
Revert "Revert "Reland slice changes ( #28601 )" ( #28615 )" ( #28624 )
...
* Revert "Revert "Reland slice changes (#28601 )" (#28615 )"
This reverts commit 939bbfc336
.
* Change random seed back to nanoseconds
3 years ago
Craig Tiller
939bbfc336
Revert "Reland slice changes ( #28601 )" ( #28615 )
...
This reverts commit b33e0d40af
.
3 years ago
Jan Tattermusch
fda6158600
Build ruby artifacts in parallel ( #28243 )
...
* build ruby artifacts in parallel
* fine tune grpc_distribtests_ruby.sh parallelism
* fine tune linux/grpc_build_artifacts.sh parallelism
* cleanup in bundle_install_wrapper
* address review comments
3 years ago
Vignesh Babu
aeea02fab8
TLS Session Keys export for GRPC C++ ( #26812 )
...
* Adding TLS Key export logic to core and c++ wrappers
* Adding and end2end cpp tls key export test and updating broken test due to interface changes
* regenerate projects
* updating tls key export core logic with addition of APIs to grpc_security.h
* undoing changes to tls_security_connector_test
* regenerate projects
* changing the logging format enum name as per GRFC comments
* regenerate projects
* removing some commented code
* updating changes as per review comments
* adding GRPCAPI annotations to functions defined in grpc_security.h
* regenerate projects
* fixed some code styling issues
* removing grpc_security.h include from tls_credentials_options.h
* updating files as per review comments
* minor fixes
* moving some code around
* removing key log format from tls session key log config and converting it to a simple string
* regenerate projects
* fixing mistakes in recent merge with master
* regenerate projects
* regenerate projects
* fixing some distrib and snity errors
* fixing formatting errors
* fixing more sanity checks and raising supported openssl versions to 1.1.1
* updating min supported openssl version to 1.1.1
* updating min supported openssl version in tls_key_export_test
* updating test to fix incorrect vector initialization
* updating as per latest comments
* fixing sanity checks
* addressing review comments
* fixing sanity checks
* fixed c++ comment style
* Automated change: Fix sanity tests
* fixing review comments
Co-authored-by: Vignesh2208 <Vignesh2208@users.noreply.github.com>
3 years ago
Jan Tattermusch
a215992f0e
speedup C# basictests: only build C# once for coreclr and mono tests ( #28587 )
...
* only build C# once for coreclr and mono tests
* one more attempt
* only build C# once for coreclr and mono
3 years ago
Jan Tattermusch
7924a5fde7
add task_runner.py --inner_jobs support for C++ distribtests ( #28594 )
...
* add support for task_runner.py --inner_jobs for C++ distribtests
* fine tune linux c++ distribtests parallelism
* yapf code
3 years ago
Craig Tiller
b33e0d40af
Reland slice changes ( #28601 )
...
* Revert "Revert "Eliminate slice interning (#28363 )" (#28598 )"
This reverts commit 03bf699600
.
* fix?
3 years ago
Jan Tattermusch
03bf699600
Revert "Eliminate slice interning ( #28363 )" ( #28598 )
...
This reverts commit 6703186b7a
.
3 years ago
Craig Tiller
6703186b7a
Eliminate slice interning ( #28363 )
...
Eliminate slice interning, and structures in slices to support it.
Reduces grpc_slice_refcount from 40 bytes (+ a required 8 bytes elsewhere) to 16 bytes.
Removes a pointer dereference for every slice ref/unref.
Co-authored-by: ctiller <ctiller@users.noreply.github.com>
3 years ago
Lidi Zheng
7069770ee0
Merge the 3 repeating Python binary compilations (Attempt 2) ( #28543 )
...
* Revert "Revert "Merge the 3 repeating Python binary compilations (#28500 )" (#28539 )"
This reverts commit 0554cbee9c
.
* Update hardcoded Python path
* Repect existing images and only use new path for newer releases
* fix interop_matrix testcases
Co-authored-by: Jan Tattermusch <jtattermusch@google.com>
3 years ago
Yousuk Seung
c02fe64bea
Support custom xDS channel creds ( #28486 )
...
This patch introduces a factory to allow supporting custom xDS channel
creds. Three types currently supported (fake, insecure, google_default)
are registered by default for backward-compatibility.
3 years ago
Esun Kim
e0a3a513a9
Buildify upb targets for validate & udpa ( #28531 )
...
* Buildify upb targets for validate & udpa
* Fix sanity test
3 years ago
Sergii Tkachenko
fd3dbcb371
xds-k8s: Fix ModuleNotFoundError: No module named 'packaging' ( #28556 )
...
`packaging` was explicitly used in xds_url_map_testcase.py,
but wasn't added to the requirements.txt.
It (unintentionally) worked before because `packaging` is
a transitive dependency of `google-api-python-client@1.12.8`
via `google-api-core@1.31.5`.
With `google-api-python-client` upgraded to `1.12.10`, it's not
the case anymore.
3 years ago
Jan Tattermusch
32b087e674
Ruby artifact speedup ( #28542 )
...
* fix ruby native extension build parallelism defaults
* allow overriding ruby artifact build parallelism with GRPC_RUBY_BUILD_PROCS
* honor --inner_jobs for ruby artifact build
* always start building ruby artifacts first
* fine tune grpc_distribtests_ruby.sh
* address review feedback
* strip newline from nproc output
3 years ago
Jan Tattermusch
d61b564ac0
Update third_party/boringssl-with-bazel ( #28510 )
...
* Update third_party/boringssl-with-bazel
* regenerate projects
* regenerate boringssl prefix headers
* Increase boringssl podspec version
* regenerate projects (2nd time)
3 years ago
Jan Tattermusch
42c08b9b56
Update third_party/protobuf to v3.19.2 ( #28511 )
...
* Update third_party/protobuf
* run tools/distrib/python/make_grpcio_tools.py
* regenerate protos for csharp, ruby, php
* update build_handwritten.yaml
* regenerate projects
3 years ago
Jan Tattermusch
0554cbee9c
Revert "Merge the 3 repeating Python binary compilations ( #28500 )" ( #28539 )
...
This reverts commit 2d4f3c5600
.
3 years ago
Craig Tiller
e29bdfe4e8
Add a test for includes without paths ( #28532 )
...
* Add a test for includes without paths
* fix path
* fix
* Automated change: Fix sanity tests
Co-authored-by: ctiller <ctiller@users.noreply.github.com>
3 years ago
Jan Tattermusch
98999225be
Speedup linux portability build_only tests ( #28461 )
...
* try speeding up linux portability test
* remove gcc8.3 portability test
* c-ares is the default resolver on linux
* dont set parallel run_tests jobs too high
* original parallelism might lead to better results
3 years ago
Lidi Zheng
2d4f3c5600
Merge the 3 repeating Python binary compilations ( #28500 )
...
* Merge the 3 repeating Python binary compilations
* Restore grpcio_metadata.py
* run_tests.py is running on <3.6
* Restore the Windows gevent version pin
3 years ago
Craig Tiller
d2d2d0650a
Allow MetadataMap to be a status in TrySeq ( #28490 )
...
* Enable metadata to be a 'status' for TrySeq
Begins to allow us to return trailing metadata and get the right
behaviors.
* comment
3 years ago
apolcyn
95b313de82
Remove ruby 2.4 support ( #28522 )
...
* changes to remove ruby 2.4 support
* some fixes
* remove opensuse since eol
* fixes
* remove unused x86 dockerfile
* stop building for ruby 2.4
* update build scripts
* fix scripts
* fix sanity
Co-authored-by: Jan Tattermusch <jtattermusch@google.com>
3 years ago
Jan Tattermusch
f23e1d9e85
task_runner.py improvements (foundations for future speedup) ( #28480 )
...
* add --dry_run support for task_runner.py
* dont sort task_runner targets before running
* fixup dry run
* support task_runner.py --inner_jobs
* pass inner_jobs to build_jobspec for task_runner.py
* support inner_jobs for C# artifacts
* support inner_jobs for protoc artifacts
* inner jobs support for src/csharp/experimental/build_native_ext_for_android.sh
* address review feedback
3 years ago
Menghan Li
dde00b6b91
xds/interop: add gke TD resource cleanup to daily cleanup script ( #28370 )
3 years ago
Craig Tiller
4b881c5947
Remove grpc_mdelem ( #28267 )
...
* Automated change: Fix sanity tests
* content-type
* Automated change: Fix sanity tests
* clang-format
* fix
* Move colon prefixed metadata
* Automated change: Fix sanity tests
* Automated change: Fix sanity tests
* try to fix windows failure
* try and scale sizes better
* ambiguity fix?
* wip metadatavalueasslice
* Fix status code for resource exhaustion
* Revert "Revert "Move a bunch of slice typed metadata to new system (#28107 )" (#28208 )"
This reverts commit 7717587063
.
* fix test
* Automated change: Fix sanity tests
* Automated change: Fix sanity tests
* slice helper
* x
* noinline
* try and scale sizes better
* Automated change: Fix sanity tests
* fixes
* fix
* fix
* fixes
* fix build
* fix overflow
* progress
* Automated change: Fix sanity tests
* fix
* initial work
* progress
* fix
* fix
* Automated change: Fix sanity tests
* progress
* fix
* fix
* fix
* Automated change: Fix sanity tests
* fix
* compressor for path/authority
* Automated change: Fix sanity tests
* Automated change: Fix sanity tests
* legalize
* legalize
* status-enc
* fmt
* fix
* fix
* fix
* fix
* fix/opt
* fix
* fix
* fix
* fix
* Automated change: Fix sanity tests
* fix
* comment
* fmt
* remove arg
* Automated change: Fix sanity tests
* remove name
* Automated change: Fix sanity tests
* sketch
* Automated change: Fix sanity tests
* progress
* add specialized encoders for compression metadata
* progress
* review feedback
* fix
* missoing files
* remove crud
* xxxxx
* more
* Small improvement in memory usage and performance
* Automated change: Fix sanity tests
* Automated change: Fix sanity tests
* Fix caching
* Automated change: Fix sanity tests
* omg
* fix crash in alts
* default everything
* Automated change: Fix sanity tests
* review feedback
* fixes
* fixes
* fixes
* Automated change: Fix sanity tests
* speedup
* fix
* fix
* clang-format
* fixes
* progress
* fixes
* fixes
* Automated change: Fix sanity tests
* fix
* fix
* progress
* update timeout encoding algorithm
* Automated change: Fix sanity tests
* fix
* fix
* review feedback
* progress
* progress
* progress
* progress
* builds
* Automated change: Fix sanity tests
* remove debug code
* fix ub
* unname things
* coax compilers
* reduce failures
* fix
* fix
* fix
* fix
* cleanup
* compile fix
* preserve concatenation rule
* spew
* fix
* fix
* postfix operator++ for msvc
* fix
* fix
* remove unused code
* lower cost of hpack table construction
* fix refcounting
* review feedback
* fixes
* fixes
* support multivalued traits
* Automated change: Fix sanity tests
* fix
* clearer clear
* appeasing 4.9
Co-authored-by: ctiller <ctiller@users.noreply.github.com>
3 years ago
krestofur
7759632a2d
Add CRL checking to gRPC Core ( #28418 )
3 years ago
Yash Tibrewal
ab6d7b4f02
Reland rbac filter ( #28442 )
...
* Revert "Revert "xDS: Add support for RBAC HTTP filter (#28309 )" (#28441 )"
This reverts commit 7aae5c66df
.
* Fix internal clang errors
* Ipv6 addresses are 128 bit
3 years ago
Craig Tiller
27662173e7
Clip long summaries ( #28401 )
3 years ago
Craig Tiller
7aae5c66df
Revert "xDS: Add support for RBAC HTTP filter ( #28309 )" ( #28441 )
...
This reverts commit 6ea8214879
.
3 years ago
apolcyn
3c368a5b2c
Don't gem install rake-compiler on macos setup scripts ( #28415 )
...
* Don't gem install rake-compiler on macos setup scripts
3 years ago
Yash Tibrewal
6ea8214879
xDS: Add support for RBAC HTTP filter ( #28309 )
...
* xDS: ADD RBAC HTTP filter support
* sanity, upb regenerate files
* Revert PerChannelArg changes
* Reviewer comments
* Reviewer comments
* Reviewer comments
* Remove unnecessary header
* Fix sanity
* Add RBAC service config parsing tests
* Don't make a copy of the metadata batch
* Revert expr_proto changes
* Some more tests
* Reviewer comments
* Reviewer comments
* No metadata changes needed
* Fix leak of DynamicXdsServerConfigSelectorProvider
* Fix deadlock issues
* Fix test compilation
3 years ago
Vignesh Babu
24778bf8ea
Revert "Enable CRL checking in gRPC core ( #26287 )" ( #28416 )
...
This reverts commit 7d8c9ae890
.
3 years ago
krestofur
7d8c9ae890
Enable CRL checking in gRPC core ( #26287 )
...
* enable crl checking in gRPC C core
3 years ago
Lidi Zheng
83e7cb24fe
Fix the setuptools distutils overriding issue ( #28393 )
...
* Fix the distutil install issue
* Try to move setuptools install forward
* Try pin the distribution tools
* Enforce local distutil
* Fix script order of definition
* Add comment
* Try to fix the setuptool monkey patch
* Clean-up imports for commands.py
* Pin 59.6.0 instead of 59.7.0 (incomplete release)
3 years ago
apolcyn
1a8d2b6760
API to cancel grpc_resolve_address ( #27883 )
...
Add an API to cancel grpc_resolve_address
3 years ago
Craig Tiller
264c321d83
Move compression related metadata to the new system ( #28223 )
...
* Eliminate most of grpc_message metadata handling
* Eliminate most of host metadata handling
* Remove more callouts without fixing code
* fiiixes
* typo
* Automated change: Fix sanity tests
* try-shrink
* Automated change: Fix sanity tests
* size tweaks
* less tricks
* deunique
* commonize
* commonize
* Automated change: Fix sanity tests
* size tuning, fixes
* Automated change: Fix sanity tests
* fix
* size tuning, fixes
* remove constexpr
* fix
* reuse code
* fix
* tweak code
* more tweaks
* tell no lies
* fixes
* fixes
* Automated change: Fix sanity tests
* fix
* fix
* fix
* fix
* fix?
* fix binder
* fix
* fix
* fixes
* Automated change: Fix sanity tests
* fix
* initial refactoring
* optimize status encoding
* Automated change: Fix sanity tests
* Automated change: Fix sanity tests
* content-type
* Automated change: Fix sanity tests
* clang-format
* fix
* Move colon prefixed metadata
* Automated change: Fix sanity tests
* Automated change: Fix sanity tests
* try to fix windows failure
* try and scale sizes better
* ambiguity fix?
* wip metadatavalueasslice
* Fix status code for resource exhaustion
* Revert "Revert "Move a bunch of slice typed metadata to new system (#28107 )" (#28208 )"
This reverts commit 7717587063
.
* fix test
* Automated change: Fix sanity tests
* Automated change: Fix sanity tests
* slice helper
* x
* noinline
* try and scale sizes better
* Automated change: Fix sanity tests
* fixes
* fix
* fix
* fixes
* fix build
* fix overflow
* progress
* Automated change: Fix sanity tests
* fix
* initial work
* progress
* fix
* fix
* Automated change: Fix sanity tests
* progress
* fix
* fix
* fix
* Automated change: Fix sanity tests
* fix
* compressor for path/authority
* Automated change: Fix sanity tests
* Automated change: Fix sanity tests
* legalize
* legalize
* status-enc
* fmt
* fix
* fix
* fix
* fix
* fix/opt
* fix
* fix
* fix
* fix
* Automated change: Fix sanity tests
* fix
* comment
* fmt
* remove arg
* Automated change: Fix sanity tests
* remove name
* Automated change: Fix sanity tests
* add specialized encoders for compression metadata
* review feedback
* fix
* missoing files
* Small improvement in memory usage and performance
* Automated change: Fix sanity tests
* Automated change: Fix sanity tests
* Fix caching
* Automated change: Fix sanity tests
* fix crash in alts
* default everything
* Automated change: Fix sanity tests
* review feedback
* fixes
* fixes
* fixes
* Automated change: Fix sanity tests
* speedup
* fix
* fix
* fixes
* fixes
* fixes
* Automated change: Fix sanity tests
* fix
* remove debug code
Co-authored-by: ctiller <ctiller@users.noreply.github.com>
3 years ago
Craig Tiller
1a2b459daa
Update timeout encoding algorithm ( #28346 )
...
* update timeout encoding algorithm
* Automated change: Fix sanity tests
* fix
* review feedback
Co-authored-by: ctiller <ctiller@users.noreply.github.com>
3 years ago
Jan Tattermusch
240557a55c
run_tests family scripts: autodetect TTY when running docker ( #28124 )
...
* autodetect terminal when running docker, add helptext for --travis run_tests arg
* address a TODO
* remove --travis from task_runner.py
3 years ago
Jan Tattermusch
82abb46ed3
improve tty output of run_tests.py and other scripts ( #28308 )
3 years ago
Richard Belleville
d4229332ce
[App Net] Reland unique scope ( #28178 )
...
* Revert "Revert "[App Net] Switch Router to Mesh and Add unique string to Scope (#28145 )" (#28176 )"
This reverts commit cc968b2158
.
* Allow scope to be None
3 years ago
Hannah Shi
0f34b44a45
podfile cleanup and add core test to script to run ( #28177 )
3 years ago
Jan Tattermusch
858eff5ab9
Introduce C# single-platform nuget build (and distribtests) ( #27180 )
...
* C# linux distribtests
* add distribtests C# linux job cfg
* support running a subset of C# artifact/distribtests on jobs
3 years ago
Lidi Zheng
7cfd399dd6
Reduce the workload of presubmit artifact builds and distribtests ( #28228 )
...
* Reduce the workload of presubmit artifact builds and distribtests
* Create and redirect Kokoro config
* Remove duplicated scripts and use env var config
* Clean-up Kokoro cfg
* [DO-NOT-SUBMIT] Add ad-hoc TASK_RUNNER_EXTRA_FILTERS
* Revert "[DO-NOT-SUBMIT] Add ad-hoc TASK_RUNNER_EXTRA_FILTERS"
This reverts commit 9436ac54ac
.
3 years ago
Jan Tattermusch
3a024ea40c
Avoid extremely slow kokoro job finalization by moving workspace to a non-synced directory on kokoro workers. ( #28259 )
...
* support "move and respawn" for kokoro jobs
* delete_nonartifacts.sh no longer needed
* bazel distribtest dont publish any artifacts
* try the altsrc respawn for selected jobs
* use altsrc for all windows CI jobs
* use altsrc for all macos CI jobs
* only move files under src/github
* fix uploading artifacts on windows
3 years ago