Jan Tattermusch
e324bf5eee
Speed up windows C/C++ builds by using cmake Ninja generator ( #28833 )
...
* support building C/C++ with ninja
* make cmake_ninja_vs2015 build the default for C/C++
* fix vcvarsall location for vs2017
3 years ago
Paulo Castello da Costa
e89152cacd
Unfreeze benchmarks reference to test-infra repo. ( #28801 )
...
Follow-up to #28797 .
3 years ago
Paulo Castello da Costa
c2da6f099f
Fix benchmark jobs. ( #28790 )
3 years ago
Esun Kim
36bfb56fc2
Added iproute2 to grpc_flaky_network_in_docker.sh ( #28785 )
3 years ago
Paulo Castello da Costa
6069b3bcd6
Freeze benchmarks reference to test-infra repo. ( #28781 )
...
Freezing reference to account for incompatible change in grpc/test-infra#267 .
Will unfreeze once loadtest templates are updated.
3 years ago
Esun Kim
342cb4457c
Added a temporary trap to prevent Abseil-Status breakages. ( #28766 )
...
* Added a new trap to prevent build errors with use_abseil_status enabled
* Fix build errors.
3 years ago
yifeizhuang
62c1b4f013
fix api_listener parsing logic ( #28745 )
...
* Revert "Revert "Add api listener test for k8s (#27534 )" (#28719 )"
This reverts commit c35b93f28d
.
Fix parsing logic of the RDS response from CSDS to support different response formats. Use common parsing logics from url_map in this test case for parsing.
3 years ago
Jan Tattermusch
1289cdae2e
Upgrade PHP docker images to debian11 ( #28701 )
...
* upgrade PHP docker images to debian11
* regenerate dockerfiles
* adjust testrunners to php debian11 images
3 years ago
Lidi Zheng
c35b93f28d
Revert "Add api listener test for k8s ( #27534 )" ( #28719 )
...
This reverts commit b4b6862352
.
3 years ago
Jan Tattermusch
b0cdd3cba2
Cleanup (followup for ccache addition) ( #28702 )
...
* nit in python interop dockerfile
* address TODO in prepare_ccache_symlinks_rc
* enable ccache for C# and ruby distribtest jobs
* use debian11 instead of bullseye consistently
3 years ago
Esun Kim
adb8611da4
Using tsan_macos config for cfstream_tsan test ( #28690 )
3 years ago
Esun Kim
94adc74145
Fix dyld errors on macos ( #28684 )
3 years ago
Jan Tattermusch
1cf6b085f2
Enable ccache in more builds ( #28665 )
...
* upgrade ruby docker images to debian 11
* upgrade C# docker images to debian11
* update sanity dockerimage to debian11
* upgrade cxx interop to debian11
* add ccache to python interop images
* enable use of ccache for interop tests
* adjust run_tests.py to new docker images
* add ccache to rake-compiler-dock docker images
* improve prepare_ccache_symlinks_rc
* enable use of ccache in rake-compiler-dock docker containers
* add ccache support for python_manylinux2014_aarch64
* add ccache support for python_linux_armv7
* deduplicate python3.9 install
* ccache for crosscompiled darwin gems is broken
* fix bash -l resetting of PATH in grpc_artifact_python_linux_armv7
3 years ago
Jan Tattermusch
f23f1bb51f
Use ccache for selected C++ and python builds (with redis server as cache) ( #28661 )
...
* add cmake support for ccache
* cleanup: use --env-file for docker run invocations
* make python build compatible with using ccache
* enable building using ccache in selected kokoro jobs
* print ccache stats and the end of run_tests.py
3 years ago
Menghan Li
e523825c75
xds/cleanup: update build in cleanup kokoro script ( #28654 )
3 years ago
yifeizhuang
b4b6862352
Add api listener test for k8s ( #27534 )
...
This ports the api listener test case to k8s.
3 years ago
Jan Tattermusch
fda6158600
Build ruby artifacts in parallel ( #28243 )
...
* build ruby artifacts in parallel
* fine tune grpc_distribtests_ruby.sh parallelism
* fine tune linux/grpc_build_artifacts.sh parallelism
* cleanup in bundle_install_wrapper
* address review comments
3 years ago
Jan Tattermusch
a215992f0e
speedup C# basictests: only build C# once for coreclr and mono tests ( #28587 )
...
* only build C# once for coreclr and mono tests
* one more attempt
* only build C# once for coreclr and mono
3 years ago
Jan Tattermusch
fd1f89a28b
speedup grpc_csharp_distribtests ( #28560 )
3 years ago
Easwar Swaminathan
8694170579
tools: set psm-security-python timeout to 3h ( #28574 )
3 years ago
Jan Tattermusch
7924a5fde7
add task_runner.py --inner_jobs support for C++ distribtests ( #28594 )
...
* add support for task_runner.py --inner_jobs for C++ distribtests
* fine tune linux c++ distribtests parallelism
* yapf code
3 years ago
Lidi Zheng
8015ae1648
Remove the explicit IO platform setting ( #28569 )
3 years ago
Jan Tattermusch
32b087e674
Ruby artifact speedup ( #28542 )
...
* fix ruby native extension build parallelism defaults
* allow overriding ruby artifact build parallelism with GRPC_RUBY_BUILD_PROCS
* honor --inner_jobs for ruby artifact build
* always start building ruby artifacts first
* fine tune grpc_distribtests_ruby.sh
* address review feedback
* strip newline from nproc output
3 years ago
apolcyn
95b313de82
Remove ruby 2.4 support ( #28522 )
...
* changes to remove ruby 2.4 support
* some fixes
* remove opensuse since eol
* fixes
* remove unused x86 dockerfile
* stop building for ruby 2.4
* update build scripts
* fix scripts
* fix sanity
Co-authored-by: Jan Tattermusch <jtattermusch@google.com>
3 years ago
Menghan Li
dde00b6b91
xds/interop: add gke TD resource cleanup to daily cleanup script ( #28370 )
3 years ago
Jan Tattermusch
c0564aa21f
Speedup grpc_portability_build_only windows kokoro job ( #28460 )
...
* only run windows C++ portability build only tests on win
* remove .cfg files for no longer used kokoro windows jobs
3 years ago
Jan Tattermusch
7dfdf3d679
Delete no-longer-used kokoro jobs .cfg files. ( #28465 )
...
* remove .cfg files for non-existent kokoro jobs
* more cleanup
3 years ago
Jan Tattermusch
c796d5786b
Reintroduce #28396 (Cleanup of windows CI .bat scripts) ( #28457 )
...
* Revert "Revert "Cleanup of windows CI .bat scripts (#28396 )""
This reverts commit 530187f865
.
* fixup
3 years ago
Craig Tiller
a7dcceb365
Revert "Cleanup of windows CI .bat scripts ( #28396 )" ( #28446 )
...
This reverts commit 44e7be448d
.
3 years ago
Jan Tattermusch
44e7be448d
Cleanup of windows CI .bat scripts ( #28396 )
...
* cleanup of windows CI .bat scripts
* fixup
* fixup
* fixup
3 years ago
apolcyn
3c368a5b2c
Don't gem install rake-compiler on macos setup scripts ( #28415 )
...
* Don't gem install rake-compiler on macos setup scripts
3 years ago
Lidi Zheng
465e3f4586
Use xds-test-server-5 as the GCE interop server ( #28399 )
3 years ago
Jan Tattermusch
769369ad3f
fix invocation of respawn scripts on windows ( #28366 )
3 years ago
Jan Tattermusch
8afb68238b
Fix windows RBE results uploading to bigquery ( #28365 )
3 years ago
apolcyn
f109a4bce4
Fix ruby macos artifact build ( #28362 )
...
* don't install bundler 1.17.3 in macos setup scripts
3 years ago
Lidi Zheng
f8a5022a26
Add the daily xDS interop GCP resource cleanup script ( #28315 )
...
* Add the daily xDS interop GCP resource cleanup script
* Add keep config feature && speed-up checking phase
* DO-NOT-SUBMIT: borrow Python test to ad-hoc run the new kokoro job
* Pin Python 3.6
* Kokoro is using pyenv to manage Python versions
* Install "dataclassses" package for 3.6.1
* Remove the latest 'test=' subprocess argument
* Revert "DO-NOT-SUBMIT: borrow Python test to ad-hoc run the new kokoro job"
This reverts commit 86d69dcb92
.
* Clean the keep config
3 years ago
Paulo Castello da Costa
5056fe81bd
Delete configuration of deleted kokoro job. ( #28299 )
...
https://github.com/grpc/grpc/pull/27869 renamed the job but duplicated the configuration.
This PR deletes the original configuration in favor of the renamed one.
3 years ago
Jan Tattermusch
858eff5ab9
Introduce C# single-platform nuget build (and distribtests) ( #27180 )
...
* C# linux distribtests
* add distribtests C# linux job cfg
* support running a subset of C# artifact/distribtests on jobs
3 years ago
Lidi Zheng
7cfd399dd6
Reduce the workload of presubmit artifact builds and distribtests ( #28228 )
...
* Reduce the workload of presubmit artifact builds and distribtests
* Create and redirect Kokoro config
* Remove duplicated scripts and use env var config
* Clean-up Kokoro cfg
* [DO-NOT-SUBMIT] Add ad-hoc TASK_RUNNER_EXTRA_FILTERS
* Revert "[DO-NOT-SUBMIT] Add ad-hoc TASK_RUNNER_EXTRA_FILTERS"
This reverts commit 9436ac54ac
.
3 years ago
Jan Tattermusch
3a024ea40c
Avoid extremely slow kokoro job finalization by moving workspace to a non-synced directory on kokoro workers. ( #28259 )
...
* support "move and respawn" for kokoro jobs
* delete_nonartifacts.sh no longer needed
* bazel distribtest dont publish any artifacts
* try the altsrc respawn for selected jobs
* use altsrc for all windows CI jobs
* use altsrc for all macos CI jobs
* only move files under src/github
* fix uploading artifacts on windows
3 years ago
Jan Tattermusch
7ecdaf8dcc
print commit SHA for other langs when running interop tests ( #28241 )
3 years ago
Richard Belleville
3892b3b359
Explicitly use python3 virtualenv in Ruby and PHP xDS interop setup scripts ( #28255 )
3 years ago
Jan Tattermusch
95cbcd8cea
increase parallelism in selected artifact and distribtest jobs ( #28227 )
3 years ago
Craig Tiller
2eadef9a82
Remove bm_metadata ( #28219 )
3 years ago
Esun Kim
63d48ee8d8
Use more parallelism to windows portability tests ( #28179 )
...
* Use more parallelism to windows portability tests
* Added /MP
* Changed it to gRPC_BUILD_MSVC_MP_COUNT
3 years ago
sanjaypujare
33a4d6920d
internal_ci: rename grpc_xds_k8s_python to psm-security-python as part of tech-debt cleanup and name clarity ( #28136 )
3 years ago
Paulo Castello da Costa
84525ae029
Reduce OSS benchmarks polling time to 5s. ( #28131 )
...
This change reduces total run time from ~86min to ~74min.
3 years ago
Jan Tattermusch
79b58431ed
Update csharp SDK to LTS versions ( #27966 )
...
* update C# SDK
* regenerate dockerfiles
* install .NET6 and .NET Core 3.1
* regenerate dockerfiles
* change netcoreapp2.1 targets to netcoreapp3.1
* update installed SDKs in aarch64 C# job
* update run_tests scripts to use netcoreapp3.1 for C#
3 years ago
Hannah Shi
fcb5200298
setup-ios-bazel-test-to-run-c-core-ee-ut ( #28029 )
3 years ago
sanjaypujare
c211b823d4
internal_ci: rename grpc_xds_k8s to psm-security as part of tech-debt cleanup and name clarity ( #28034 )
3 years ago