b516dbfa21
Increase artifact build timeouts for problem targets ( #25695 )
...
Going back 2 weeks, nightly packages have failed to build due to
artifact build timeouts. This change increases timeouts for:
Python Linux Extra: 5hrs -> 7hrs
Python Manylinux: 1hr -> 2hrs
CSharp iOS: 45min -> 1hr
CSharp MacOS x64: 30m -> 45m
This is a stopgap measure to get nightly packages deployed more regularly;
March has seen 3 nightlies published in 11 days.
I've cherry picked some of the artifact build timeout errors below.
2021.03.10
grpc/core/master/linux/grpc_build_artifacts_extra_release
2021-03-10 05:03:40,560 TIMEOUT: build_artifact.python_linux_extra_armv7_3.6 [pid=7384, time=18000.4sec]
2021-03-10 05:03:40,646 TIMEOUT: build_artifact.python_linux_extra_armv7_2.7 [pid=7375, time=18000.5sec]
2021-03-10 05:03:40,728 TIMEOUT: build_artifact.python_linux_extra_armv7_3.5 [pid=7378, time=18000.6sec]
2021.03.08
grpc/core/master/linux/grpc_build_artifacts_extra_release
2021-03-08 05:03:18,542 TIMEOUT: build_artifact.python_linux_extra_armv7_3.6 [pid=6853, time=18000.5sec]
2021-03-08 05:03:18,639 TIMEOUT: build_artifact.python_linux_extra_armv7_2.7 [pid=6844, time=18000.6sec]
2021-03-08 05:03:18,741 TIMEOUT: build_artifact.python_linux_extra_armv7_3.5 [pid=6847, time=18000.7sec]
2021.03.07
grpc/core/master/macos/grpc_build_artifacts:
2021-03-07 00:58:02,492 TIMEOUT: build_artifact.csharp_ext_macos_x64 [pid=58673, time=1805.5sec]
2021-03-07 01:13:03,065 TIMEOUT: build_artifact.csharp_ext_macos_ios [pid=58672, time=2706.1sec]
Bumping iOS again from https://github.com/grpc/grpc/pull/25049
grpc/core/master/linux/grpc_build_artifacts_extra_release
2021-03-07 05:03:36,061 TIMEOUT: build_artifact.python_linux_extra_armv7_3.6 [pid=8867, time=18002.9sec]
2021.03.06
grpc/core/master/linux/grpc_build_artifacts_extra_release
2021-03-06 05:03:12,474 TIMEOUT: build_artifact.python_linux_extra_armv7_3.5 [pid=8307, time=18000.6sec]
2021.03.05
grpc/core/master/linux/grpc_build_artifacts_extra_release
2021-03-05 05:03:48,611 TIMEOUT: build_artifact.python_linux_extra_armv7_3.6 [pid=7075, time=18008.6sec]
2021.02.27
grpc/core/master/linux/grpc_build_artifacts
2021-02-27 01:09:57,943 TIMEOUT: build_artifact.python_manylinux2010_x64_cp27-cp27mu [pid=21983, time=3608.9sec]
2021.02.23
grpc/core/master/windows/grpc_build_artifacts
```
2021-02-23 01:48:23,729 SUCCESS: All targets built successfully.
T:\src\github\grpc>set RUNTESTS_EXITCODE=0
T:\src\github\grpc>bash tools/internal_ci/helper_scripts/delete_nonartifacts.sh
++ dirname tools/internal_ci/helper_scripts/delete_nonartifacts.sh
+ cd tools/internal_ci/helper_scripts/../../..
+ find . -type f -not -iname '*sponge_log.*' -not -path './reports/*' -not -path './artifacts/*' -not -path './tools/internal_ci/*' -exec rm -f '{}' +
ERROR: Aborting VM command due to timeout of 10800 seconds
```
4 years ago
c57a4be05d
Disable fault injection env var in xds interop tests ( #25676 )
4 years ago
5e13018330
Update third_party/benchmark to v1.5.2 ( #25184 )
...
This fix the following error when compiling:
error: #error C++11 or greater detected by the library. BENCHMARK_HAS_CXX11 is defined.
12 | #error C++11 or greater detected by the library. BENCHMARK_HAS_CXX11 is defined.
| ^~~~~
Signed-off-by: Clément Péron <peron.clem@gmail.com>
4 years ago
6276b66490
run_xds_tests: add fault_injection tests ( #25641 )
4 years ago
5139a012e7
Migrate the bm_diff benchmarks to python3 ( #25619 )
...
* Migrate the bm_diff benchmarks to python3
Includes a requirements.txt pinned at ~2017 versions, when this script
was first written.
* Replace p2 with p3 scipy/numpy dependencies.
* py2->3 for benchmark setup scripts
* upgrade pip to resolve python3 cryptography/setuptools-rust problem
* re-add jobset import (accidentally removed)
* re-add six's urllib import. This file is still used in py2 tests
* force py3 in run_if_c_cpp_modified.sh
* Fix another instance of subprocess.check_output binary mode
* Use the requirements.txt for CI perf environment setup
* Try to upgrade PyJWT. (v2.0.0 was problematic, #25053 )
v2.x makes encode return strs from jwt.encode in both py2 and py3.
Previously, py3 would return bytes, and py2 a str.
* upgate cryptography lib version requirements for jwt.
* Wrap pip requirements specifier in quotes '>=x,<y'
* Decode subprocess output once instead of for every line
* Revert "Decode subprocess output once instead of for every line"
This reverts commit 28d14026431622ac7afd3535a8d7118e5be96628.
py2 doesn't support the `text` argument to subprocess.check_output.
* Address reviewer requests
* Pin a valid scipy version
* Remove scipy and tabulate dependencies from macos tests
4 years ago
1437dc9816
Fix pypa link ( #25647 )
...
* Fix pypa link
* And 3.5 as well
4 years ago
bd86187f19
SDK authorization policy translator. ( #25361 )
...
* SDK authorization policy translator.
4 years ago
65ea33e427
xds-k8s Fix NameError name 'cls' is not defined ( #25615 )
4 years ago
1dce57f35f
Assorted python wheel build improvements ( #25602 )
...
* cleanup unnecessary deps from grpc_artifact_python_manylinux2014_aarch64
* cleanup in grpc_artifact_python dockerfiles
* enable boringssl assembly optimizations when crosscompiling aarch64 linux wheels
* pin manylinux2010 images to keep python27 build
* avoid pip install --upgrade cython when not necessary
4 years ago
cb8114d689
Delete no longer needed artifact_linux dockerfiles ( #25542 )
...
* delete no longer needed artifact_linux dockerfiles
* fix build_package_python.sh
4 years ago
44e5409a4e
Option to disable local_certificate check from PSM security tests ( #25595 )
...
* Remove local_certificate check from PSM security tests
* Reviewer comments
* Update tools/run_tests/xds_k8s_test_driver/framework/xds_k8s_testcase.py
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
* YAPF code
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
4 years ago
ee375222a0
Double WAIT_FOR_BACKEND_SEC ( #25603 )
4 years ago
39cc797025
[xDS Proto] Modernize buildgen scripts ( #25512 )
...
* [xDS Proto] Modernize buildgen scripts
* This PR only covers some buildgen scripts that will be used by xDS
proto
* This PR also improves the debuggability of some scripts
* Merge with master
* Adopt reviewer's advices
4 years ago
160cb1b215
Changed RPI build test to general ARM build test ( #25580 )
...
* Change rpi build test to arm test
* Having a separate docker and targetting aarch64
4 years ago
fcd43e9030
Crosscompile python aarch64 wheels with dockcross ( #25418 )
...
* build aarch64 python wheels via crosscompilation
* yapf format code
* fix shellcheck complaints
* fix python37 aarch64 wheel build
* build python wheels on linux aarch64 with static libstdc++
* yapf format code
4 years ago
565520443b
[xDS Proto] Update Bazel dependencies ( #25511 )
...
* [xDS Proto] Update Bazel dependencies
* Include transitive deps required by xDS proto libraries
* The Golang deps come from protoc-gen-validate project
* Adding a new submodule: opencensus-proto
* Add the new submodule to .bazelignore
* Update WORKSPACE file to initialize googleapis
* Remove WORKSPACE override
* Adopt reviewer's advice
4 years ago
ad461a3c7c
xds-k8s: Update local-dev.cfg.example ( #25552 )
4 years ago
2fd9f5ead9
Update third_party/protobuf to v3.15.2 ( #25565 )
...
* Update protobuf to v3.15.2
* revert boringssl podspec changes
Co-authored-by: Jan Tattermusch <jtattermusch@google.com>
4 years ago
26f85ca2d9
Update boringssl ( #25564 )
...
* update submodule boringssl-with-bazel with origin/master-with-bazel
* update boringssl dependency to master-with-bazel commit SHA
* regenerate files
* Updated sha256
* generate boringssl prefix headers
* Increment podspec version
* Second regeneration
* add boringssl SHA in check_submodules.sh
4 years ago
900e47b1a9
xds-k8s: set GRPC_XDS_EXPERIMENTAL_NEW_SERVER_API ( #25529 )
4 years ago
5426770c73
xds-k8s driver: remove "Client subchannel must have no sockets" check ( #25460 )
4 years ago
af76d0321a
Restore callback microbenchmarks but make them manual for now ( #25491 )
4 years ago
8be2ac94a8
Bump up minimum supported clang to 4.0
4 years ago
df3e225466
run_xds_tests: use frozenset for const instead of set
4 years ago
526a5690f5
add timeout to xds test runs; prevent running V3/alpha tests
...
use alpha API for patching URL maps
4 years ago
e98cd15c2e
fixup! xds-k8s driver: switch Backend Health Check from TCP to GRPC
4 years ago
ee14f7d203
Upgrade xDS protos
4 years ago
41df38bff8
Add script to check for illegal terms
4 years ago
21871dcb88
xds-k8s driver: switch Backend Health Check from TCP to GRPC
4 years ago
9526a55776
Remove disrespectful term
4 years ago
13a4888183
Remove disrespectful terms
4 years ago
7a5288d2a0
Replace disrespectful words
4 years ago
12d05dba96
update boringssl dependency to master-with-bazel commit SHA
4 years ago
8d5977b142
update boringssl dependency to master-with-bazel commit SHA
4 years ago
a8b5e15ad5
Update sanity check scripts
4 years ago
0cf94e3fdd
Add time-util
4 years ago
dcbfcdbf80
formatting
4 years ago
c73932b261
add timeout tests
4 years ago
a2aa83abe7
xds-k8s driver: increase timeouts for k8s cleanup operations
4 years ago
6a294c38be
xds-k8s driver: Change Endpint Config Selector type to GRPC_SERVER
4 years ago
b62c984eab
Pin pip to 19.3.1 to fix the build failure on master
4 years ago
bde2b79cbd
xds-k8s driver: wait server channelz - adjust RPC timeouts
4 years ago
a734650728
Modify build_python.sh because get-pip.py has moved.
4 years ago
b125fd3bf5
xds testing: add case insensitive path matching
4 years ago
be3369ceae
add regex header matching
4 years ago
e0789a796b
xds-k8s driver: do not override wait for deployment timeout_sec
4 years ago
a584bc4f02
Support ServerContext for callback API
4 years ago
2258cee7b2
xds-k8s exclude fix: dirs end with a slash
4 years ago
83501b822d
xds-k8s driver: exclude from tests suites
4 years ago
e7616e56bd
xds-k8s driver: increase wait time for deployment available replicas
4 years ago
AJ Heller
Menghan Li
Clément Péron
Doug Fawley
Richard Belleville
Ashitha Santhosh
Sergii Tkachenko
Jan Tattermusch
Yash Tibrewal
Lidi Zheng
Esun Kim
Karthik Ravi Shankar
Vijay Pai
Mark D. Roth
Donna Dionne
ZhouyihaiDing