Jan Tattermusch
a215992f0e
speedup C# basictests: only build C# once for coreclr and mono tests ( #28587 )
...
* only build C# once for coreclr and mono tests
* one more attempt
* only build C# once for coreclr and mono
3 years ago
Jan Tattermusch
7924a5fde7
add task_runner.py --inner_jobs support for C++ distribtests ( #28594 )
...
* add support for task_runner.py --inner_jobs for C++ distribtests
* fine tune linux c++ distribtests parallelism
* yapf code
3 years ago
Craig Tiller
b33e0d40af
Reland slice changes ( #28601 )
...
* Revert "Revert "Eliminate slice interning (#28363 )" (#28598 )"
This reverts commit 03bf699600
.
* fix?
3 years ago
Jan Tattermusch
03bf699600
Revert "Eliminate slice interning ( #28363 )" ( #28598 )
...
This reverts commit 6703186b7a
.
3 years ago
Craig Tiller
6703186b7a
Eliminate slice interning ( #28363 )
...
Eliminate slice interning, and structures in slices to support it.
Reduces grpc_slice_refcount from 40 bytes (+ a required 8 bytes elsewhere) to 16 bytes.
Removes a pointer dereference for every slice ref/unref.
Co-authored-by: ctiller <ctiller@users.noreply.github.com>
3 years ago
Lidi Zheng
7069770ee0
Merge the 3 repeating Python binary compilations (Attempt 2) ( #28543 )
...
* Revert "Revert "Merge the 3 repeating Python binary compilations (#28500 )" (#28539 )"
This reverts commit 0554cbee9c
.
* Update hardcoded Python path
* Repect existing images and only use new path for newer releases
* fix interop_matrix testcases
Co-authored-by: Jan Tattermusch <jtattermusch@google.com>
3 years ago
Yousuk Seung
c02fe64bea
Support custom xDS channel creds ( #28486 )
...
This patch introduces a factory to allow supporting custom xDS channel
creds. Three types currently supported (fake, insecure, google_default)
are registered by default for backward-compatibility.
3 years ago
Esun Kim
e0a3a513a9
Buildify upb targets for validate & udpa ( #28531 )
...
* Buildify upb targets for validate & udpa
* Fix sanity test
3 years ago
Sergii Tkachenko
fd3dbcb371
xds-k8s: Fix ModuleNotFoundError: No module named 'packaging' ( #28556 )
...
`packaging` was explicitly used in xds_url_map_testcase.py,
but wasn't added to the requirements.txt.
It (unintentionally) worked before because `packaging` is
a transitive dependency of `google-api-python-client@1.12.8`
via `google-api-core@1.31.5`.
With `google-api-python-client` upgraded to `1.12.10`, it's not
the case anymore.
3 years ago
Jan Tattermusch
32b087e674
Ruby artifact speedup ( #28542 )
...
* fix ruby native extension build parallelism defaults
* allow overriding ruby artifact build parallelism with GRPC_RUBY_BUILD_PROCS
* honor --inner_jobs for ruby artifact build
* always start building ruby artifacts first
* fine tune grpc_distribtests_ruby.sh
* address review feedback
* strip newline from nproc output
3 years ago
Jan Tattermusch
d61b564ac0
Update third_party/boringssl-with-bazel ( #28510 )
...
* Update third_party/boringssl-with-bazel
* regenerate projects
* regenerate boringssl prefix headers
* Increase boringssl podspec version
* regenerate projects (2nd time)
3 years ago
Jan Tattermusch
42c08b9b56
Update third_party/protobuf to v3.19.2 ( #28511 )
...
* Update third_party/protobuf
* run tools/distrib/python/make_grpcio_tools.py
* regenerate protos for csharp, ruby, php
* update build_handwritten.yaml
* regenerate projects
3 years ago
Jan Tattermusch
0554cbee9c
Revert "Merge the 3 repeating Python binary compilations ( #28500 )" ( #28539 )
...
This reverts commit 2d4f3c5600
.
3 years ago
Craig Tiller
e29bdfe4e8
Add a test for includes without paths ( #28532 )
...
* Add a test for includes without paths
* fix path
* fix
* Automated change: Fix sanity tests
Co-authored-by: ctiller <ctiller@users.noreply.github.com>
3 years ago
Jan Tattermusch
98999225be
Speedup linux portability build_only tests ( #28461 )
...
* try speeding up linux portability test
* remove gcc8.3 portability test
* c-ares is the default resolver on linux
* dont set parallel run_tests jobs too high
* original parallelism might lead to better results
3 years ago
Lidi Zheng
2d4f3c5600
Merge the 3 repeating Python binary compilations ( #28500 )
...
* Merge the 3 repeating Python binary compilations
* Restore grpcio_metadata.py
* run_tests.py is running on <3.6
* Restore the Windows gevent version pin
3 years ago
Craig Tiller
d2d2d0650a
Allow MetadataMap to be a status in TrySeq ( #28490 )
...
* Enable metadata to be a 'status' for TrySeq
Begins to allow us to return trailing metadata and get the right
behaviors.
* comment
3 years ago
apolcyn
95b313de82
Remove ruby 2.4 support ( #28522 )
...
* changes to remove ruby 2.4 support
* some fixes
* remove opensuse since eol
* fixes
* remove unused x86 dockerfile
* stop building for ruby 2.4
* update build scripts
* fix scripts
* fix sanity
Co-authored-by: Jan Tattermusch <jtattermusch@google.com>
3 years ago
Jan Tattermusch
f23e1d9e85
task_runner.py improvements (foundations for future speedup) ( #28480 )
...
* add --dry_run support for task_runner.py
* dont sort task_runner targets before running
* fixup dry run
* support task_runner.py --inner_jobs
* pass inner_jobs to build_jobspec for task_runner.py
* support inner_jobs for C# artifacts
* support inner_jobs for protoc artifacts
* inner jobs support for src/csharp/experimental/build_native_ext_for_android.sh
* address review feedback
3 years ago
Menghan Li
dde00b6b91
xds/interop: add gke TD resource cleanup to daily cleanup script ( #28370 )
3 years ago
Craig Tiller
4b881c5947
Remove grpc_mdelem ( #28267 )
...
* Automated change: Fix sanity tests
* content-type
* Automated change: Fix sanity tests
* clang-format
* fix
* Move colon prefixed metadata
* Automated change: Fix sanity tests
* Automated change: Fix sanity tests
* try to fix windows failure
* try and scale sizes better
* ambiguity fix?
* wip metadatavalueasslice
* Fix status code for resource exhaustion
* Revert "Revert "Move a bunch of slice typed metadata to new system (#28107 )" (#28208 )"
This reverts commit 7717587063
.
* fix test
* Automated change: Fix sanity tests
* Automated change: Fix sanity tests
* slice helper
* x
* noinline
* try and scale sizes better
* Automated change: Fix sanity tests
* fixes
* fix
* fix
* fixes
* fix build
* fix overflow
* progress
* Automated change: Fix sanity tests
* fix
* initial work
* progress
* fix
* fix
* Automated change: Fix sanity tests
* progress
* fix
* fix
* fix
* Automated change: Fix sanity tests
* fix
* compressor for path/authority
* Automated change: Fix sanity tests
* Automated change: Fix sanity tests
* legalize
* legalize
* status-enc
* fmt
* fix
* fix
* fix
* fix
* fix/opt
* fix
* fix
* fix
* fix
* Automated change: Fix sanity tests
* fix
* comment
* fmt
* remove arg
* Automated change: Fix sanity tests
* remove name
* Automated change: Fix sanity tests
* sketch
* Automated change: Fix sanity tests
* progress
* add specialized encoders for compression metadata
* progress
* review feedback
* fix
* missoing files
* remove crud
* xxxxx
* more
* Small improvement in memory usage and performance
* Automated change: Fix sanity tests
* Automated change: Fix sanity tests
* Fix caching
* Automated change: Fix sanity tests
* omg
* fix crash in alts
* default everything
* Automated change: Fix sanity tests
* review feedback
* fixes
* fixes
* fixes
* Automated change: Fix sanity tests
* speedup
* fix
* fix
* clang-format
* fixes
* progress
* fixes
* fixes
* Automated change: Fix sanity tests
* fix
* fix
* progress
* update timeout encoding algorithm
* Automated change: Fix sanity tests
* fix
* fix
* review feedback
* progress
* progress
* progress
* progress
* builds
* Automated change: Fix sanity tests
* remove debug code
* fix ub
* unname things
* coax compilers
* reduce failures
* fix
* fix
* fix
* fix
* cleanup
* compile fix
* preserve concatenation rule
* spew
* fix
* fix
* postfix operator++ for msvc
* fix
* fix
* remove unused code
* lower cost of hpack table construction
* fix refcounting
* review feedback
* fixes
* fixes
* support multivalued traits
* Automated change: Fix sanity tests
* fix
* clearer clear
* appeasing 4.9
Co-authored-by: ctiller <ctiller@users.noreply.github.com>
3 years ago
krestofur
7759632a2d
Add CRL checking to gRPC Core ( #28418 )
3 years ago
Yash Tibrewal
ab6d7b4f02
Reland rbac filter ( #28442 )
...
* Revert "Revert "xDS: Add support for RBAC HTTP filter (#28309 )" (#28441 )"
This reverts commit 7aae5c66df
.
* Fix internal clang errors
* Ipv6 addresses are 128 bit
3 years ago
Craig Tiller
27662173e7
Clip long summaries ( #28401 )
3 years ago
Craig Tiller
7aae5c66df
Revert "xDS: Add support for RBAC HTTP filter ( #28309 )" ( #28441 )
...
This reverts commit 6ea8214879
.
3 years ago
apolcyn
3c368a5b2c
Don't gem install rake-compiler on macos setup scripts ( #28415 )
...
* Don't gem install rake-compiler on macos setup scripts
3 years ago
Yash Tibrewal
6ea8214879
xDS: Add support for RBAC HTTP filter ( #28309 )
...
* xDS: ADD RBAC HTTP filter support
* sanity, upb regenerate files
* Revert PerChannelArg changes
* Reviewer comments
* Reviewer comments
* Reviewer comments
* Remove unnecessary header
* Fix sanity
* Add RBAC service config parsing tests
* Don't make a copy of the metadata batch
* Revert expr_proto changes
* Some more tests
* Reviewer comments
* Reviewer comments
* No metadata changes needed
* Fix leak of DynamicXdsServerConfigSelectorProvider
* Fix deadlock issues
* Fix test compilation
3 years ago
Vignesh Babu
24778bf8ea
Revert "Enable CRL checking in gRPC core ( #26287 )" ( #28416 )
...
This reverts commit 7d8c9ae890
.
3 years ago
krestofur
7d8c9ae890
Enable CRL checking in gRPC core ( #26287 )
...
* enable crl checking in gRPC C core
3 years ago
Lidi Zheng
83e7cb24fe
Fix the setuptools distutils overriding issue ( #28393 )
...
* Fix the distutil install issue
* Try to move setuptools install forward
* Try pin the distribution tools
* Enforce local distutil
* Fix script order of definition
* Add comment
* Try to fix the setuptool monkey patch
* Clean-up imports for commands.py
* Pin 59.6.0 instead of 59.7.0 (incomplete release)
3 years ago
apolcyn
1a8d2b6760
API to cancel grpc_resolve_address ( #27883 )
...
Add an API to cancel grpc_resolve_address
3 years ago
Craig Tiller
264c321d83
Move compression related metadata to the new system ( #28223 )
...
* Eliminate most of grpc_message metadata handling
* Eliminate most of host metadata handling
* Remove more callouts without fixing code
* fiiixes
* typo
* Automated change: Fix sanity tests
* try-shrink
* Automated change: Fix sanity tests
* size tweaks
* less tricks
* deunique
* commonize
* commonize
* Automated change: Fix sanity tests
* size tuning, fixes
* Automated change: Fix sanity tests
* fix
* size tuning, fixes
* remove constexpr
* fix
* reuse code
* fix
* tweak code
* more tweaks
* tell no lies
* fixes
* fixes
* Automated change: Fix sanity tests
* fix
* fix
* fix
* fix
* fix?
* fix binder
* fix
* fix
* fixes
* Automated change: Fix sanity tests
* fix
* initial refactoring
* optimize status encoding
* Automated change: Fix sanity tests
* Automated change: Fix sanity tests
* content-type
* Automated change: Fix sanity tests
* clang-format
* fix
* Move colon prefixed metadata
* Automated change: Fix sanity tests
* Automated change: Fix sanity tests
* try to fix windows failure
* try and scale sizes better
* ambiguity fix?
* wip metadatavalueasslice
* Fix status code for resource exhaustion
* Revert "Revert "Move a bunch of slice typed metadata to new system (#28107 )" (#28208 )"
This reverts commit 7717587063
.
* fix test
* Automated change: Fix sanity tests
* Automated change: Fix sanity tests
* slice helper
* x
* noinline
* try and scale sizes better
* Automated change: Fix sanity tests
* fixes
* fix
* fix
* fixes
* fix build
* fix overflow
* progress
* Automated change: Fix sanity tests
* fix
* initial work
* progress
* fix
* fix
* Automated change: Fix sanity tests
* progress
* fix
* fix
* fix
* Automated change: Fix sanity tests
* fix
* compressor for path/authority
* Automated change: Fix sanity tests
* Automated change: Fix sanity tests
* legalize
* legalize
* status-enc
* fmt
* fix
* fix
* fix
* fix
* fix/opt
* fix
* fix
* fix
* fix
* Automated change: Fix sanity tests
* fix
* comment
* fmt
* remove arg
* Automated change: Fix sanity tests
* remove name
* Automated change: Fix sanity tests
* add specialized encoders for compression metadata
* review feedback
* fix
* missoing files
* Small improvement in memory usage and performance
* Automated change: Fix sanity tests
* Automated change: Fix sanity tests
* Fix caching
* Automated change: Fix sanity tests
* fix crash in alts
* default everything
* Automated change: Fix sanity tests
* review feedback
* fixes
* fixes
* fixes
* Automated change: Fix sanity tests
* speedup
* fix
* fix
* fixes
* fixes
* fixes
* Automated change: Fix sanity tests
* fix
* remove debug code
Co-authored-by: ctiller <ctiller@users.noreply.github.com>
3 years ago
Craig Tiller
1a2b459daa
Update timeout encoding algorithm ( #28346 )
...
* update timeout encoding algorithm
* Automated change: Fix sanity tests
* fix
* review feedback
Co-authored-by: ctiller <ctiller@users.noreply.github.com>
3 years ago
Jan Tattermusch
240557a55c
run_tests family scripts: autodetect TTY when running docker ( #28124 )
...
* autodetect terminal when running docker, add helptext for --travis run_tests arg
* address a TODO
* remove --travis from task_runner.py
3 years ago
Jan Tattermusch
82abb46ed3
improve tty output of run_tests.py and other scripts ( #28308 )
3 years ago
Richard Belleville
d4229332ce
[App Net] Reland unique scope ( #28178 )
...
* Revert "Revert "[App Net] Switch Router to Mesh and Add unique string to Scope (#28145 )" (#28176 )"
This reverts commit cc968b2158
.
* Allow scope to be None
3 years ago
Hannah Shi
0f34b44a45
podfile cleanup and add core test to script to run ( #28177 )
3 years ago
Jan Tattermusch
858eff5ab9
Introduce C# single-platform nuget build (and distribtests) ( #27180 )
...
* C# linux distribtests
* add distribtests C# linux job cfg
* support running a subset of C# artifact/distribtests on jobs
3 years ago
Lidi Zheng
7cfd399dd6
Reduce the workload of presubmit artifact builds and distribtests ( #28228 )
...
* Reduce the workload of presubmit artifact builds and distribtests
* Create and redirect Kokoro config
* Remove duplicated scripts and use env var config
* Clean-up Kokoro cfg
* [DO-NOT-SUBMIT] Add ad-hoc TASK_RUNNER_EXTRA_FILTERS
* Revert "[DO-NOT-SUBMIT] Add ad-hoc TASK_RUNNER_EXTRA_FILTERS"
This reverts commit 9436ac54ac
.
3 years ago
Jan Tattermusch
3a024ea40c
Avoid extremely slow kokoro job finalization by moving workspace to a non-synced directory on kokoro workers. ( #28259 )
...
* support "move and respawn" for kokoro jobs
* delete_nonartifacts.sh no longer needed
* bazel distribtest dont publish any artifacts
* try the altsrc respawn for selected jobs
* use altsrc for all windows CI jobs
* use altsrc for all macos CI jobs
* only move files under src/github
* fix uploading artifacts on windows
3 years ago
Craig Tiller
e21505858f
Move some integer based metadata to the new system ( #28198 )
...
* Eliminate most of grpc_message metadata handling
* Eliminate most of host metadata handling
* Remove more callouts without fixing code
* fiiixes
* typo
* Automated change: Fix sanity tests
* try-shrink
* Automated change: Fix sanity tests
* size tweaks
* less tricks
* deunique
* commonize
* commonize
* Automated change: Fix sanity tests
* size tuning, fixes
* Automated change: Fix sanity tests
* fix
* size tuning, fixes
* remove constexpr
* fix
* reuse code
* fix
* tweak code
* more tweaks
* tell no lies
* fixes
* fixes
* Automated change: Fix sanity tests
* fix
* fix
* fix
* fix
* fix?
* fix binder
* fix
* fix
* fixes
* Automated change: Fix sanity tests
* fix
* initial refactoring
* optimize status encoding
* Automated change: Fix sanity tests
* Automated change: Fix sanity tests
* fix
* try to fix windows failure
* try and scale sizes better
* ambiguity fix?
* wip metadatavalueasslice
* Fix status code for resource exhaustion
* Revert "Revert "Move a bunch of slice typed metadata to new system (#28107 )" (#28208 )"
This reverts commit 7717587063
.
* fix test
* Automated change: Fix sanity tests
* slice helper
* x
* noinline
* try and scale sizes better
* Automated change: Fix sanity tests
* fixes
* fix
* fix
* fix build
* fix overflow
* fix
* fix
* fix
* fix
* review feedback
Co-authored-by: ctiller <ctiller@users.noreply.github.com>
3 years ago
Jan Tattermusch
205d7569ea
Big dockerimage cleanup ( #28010 )
...
* use python3 for running run_tests.py
* update dockerimage templates
* update dockerfiles
* fix bazel build in the bazel docker image
* adjust run_tests.py to renamed php docker image
* add previously forgotten new templates
* add missing images
* php dockerfile remove whitespaces
* restore accidentally deleted binder_transport_apk image
* add back cxx_buster_x64 image
* add back php zts stretch image
* add back binder_transport_apk image
* fix bazel builds by temporarily adding back python2-dev
* check_redundant_namespace_qualifiers.py to python3
* fix clang-tidy
* make run_tests_matrix.py use python3
* fixup cxx_debian9 templates
* regenerate
* stop running dummy grpc-node tests for protobuf-at-head and boringssl-at-head jobs
* remove cxx_buster image (replaced by cxx_debian9)
* add back python_alpine_x64 image
* run_tests_in_workspace using python3
* unbreak python macos basictests by partially reverting run_tests_matrix to python2
* fix cxx_gcc_X docker images
3 years ago
Jan Tattermusch
ae65bb8f7f
windows: speedup build of C# extension and protoc artifacts ( #28225 )
3 years ago
Esun Kim
63d48ee8d8
Use more parallelism to windows portability tests ( #28179 )
...
* Use more parallelism to windows portability tests
* Added /MP
* Changed it to gRPC_BUILD_MSVC_MP_COUNT
3 years ago
Esun Kim
5088014987
Boringssl update to 4fb1589 ( #28194 )
...
* update submodule boringssl-with-bazel with origin/main-with-bazel
* update boringssl dependency to main-with-bazel commit SHA
* regenerate files
* generate boringssl prefix headers
* Increment podspec version
3 years ago
Esun Kim
8e0a361cce
Update cxx docker images ( #28162 )
3 years ago
Craig Tiller
888a10d8a6
Reland arena based promises ( #28174 )
...
* Revert "Revert "Arena allocated promise (#28023 )" (#28171 )"
This reverts commit 9b07a81b1a
.
* fix
* Automated change: Fix sanity tests
Co-authored-by: ctiller <ctiller@users.noreply.github.com>
3 years ago
Richard Belleville
cc968b2158
Revert "[App Net] Switch Router to Mesh and Add unique string to Scope ( #28145 )" ( #28176 )
...
This reverts commit 7ac79c2e6a
.
3 years ago
Craig Tiller
9b07a81b1a
Revert "Arena allocated promise ( #28023 )" ( #28171 )
...
This reverts commit 77b4ade1a7
.
3 years ago
Richard Belleville
7ac79c2e6a
[App Net] Switch Router to Mesh and Add unique string to Scope ( #28145 )
...
* Add unique suffix to scope
* Actually add suffix
* Switch from Router to Mesh
* Yapf
* Review
* Fix bad reference
* Break circular dependency
* Add a dash
3 years ago