Jan Tattermusch
9fc27fb06d
add a job for end to end benchmarks V2 ( #25732 )
4 years ago
AJ Heller
b516dbfa21
Increase artifact build timeouts for problem targets ( #25695 )
...
Going back 2 weeks, nightly packages have failed to build due to
artifact build timeouts. This change increases timeouts for:
Python Linux Extra: 5hrs -> 7hrs
Python Manylinux: 1hr -> 2hrs
CSharp iOS: 45min -> 1hr
CSharp MacOS x64: 30m -> 45m
This is a stopgap measure to get nightly packages deployed more regularly;
March has seen 3 nightlies published in 11 days.
I've cherry picked some of the artifact build timeout errors below.
2021.03.10
grpc/core/master/linux/grpc_build_artifacts_extra_release
2021-03-10 05:03:40,560 TIMEOUT: build_artifact.python_linux_extra_armv7_3.6 [pid=7384, time=18000.4sec]
2021-03-10 05:03:40,646 TIMEOUT: build_artifact.python_linux_extra_armv7_2.7 [pid=7375, time=18000.5sec]
2021-03-10 05:03:40,728 TIMEOUT: build_artifact.python_linux_extra_armv7_3.5 [pid=7378, time=18000.6sec]
2021.03.08
grpc/core/master/linux/grpc_build_artifacts_extra_release
2021-03-08 05:03:18,542 TIMEOUT: build_artifact.python_linux_extra_armv7_3.6 [pid=6853, time=18000.5sec]
2021-03-08 05:03:18,639 TIMEOUT: build_artifact.python_linux_extra_armv7_2.7 [pid=6844, time=18000.6sec]
2021-03-08 05:03:18,741 TIMEOUT: build_artifact.python_linux_extra_armv7_3.5 [pid=6847, time=18000.7sec]
2021.03.07
grpc/core/master/macos/grpc_build_artifacts:
2021-03-07 00:58:02,492 TIMEOUT: build_artifact.csharp_ext_macos_x64 [pid=58673, time=1805.5sec]
2021-03-07 01:13:03,065 TIMEOUT: build_artifact.csharp_ext_macos_ios [pid=58672, time=2706.1sec]
Bumping iOS again from https://github.com/grpc/grpc/pull/25049
grpc/core/master/linux/grpc_build_artifacts_extra_release
2021-03-07 05:03:36,061 TIMEOUT: build_artifact.python_linux_extra_armv7_3.6 [pid=8867, time=18002.9sec]
2021.03.06
grpc/core/master/linux/grpc_build_artifacts_extra_release
2021-03-06 05:03:12,474 TIMEOUT: build_artifact.python_linux_extra_armv7_3.5 [pid=8307, time=18000.6sec]
2021.03.05
grpc/core/master/linux/grpc_build_artifacts_extra_release
2021-03-05 05:03:48,611 TIMEOUT: build_artifact.python_linux_extra_armv7_3.6 [pid=7075, time=18008.6sec]
2021.02.27
grpc/core/master/linux/grpc_build_artifacts
2021-02-27 01:09:57,943 TIMEOUT: build_artifact.python_manylinux2010_x64_cp27-cp27mu [pid=21983, time=3608.9sec]
2021.02.23
grpc/core/master/windows/grpc_build_artifacts
```
2021-02-23 01:48:23,729 SUCCESS: All targets built successfully.
T:\src\github\grpc>set RUNTESTS_EXITCODE=0
T:\src\github\grpc>bash tools/internal_ci/helper_scripts/delete_nonartifacts.sh
++ dirname tools/internal_ci/helper_scripts/delete_nonartifacts.sh
+ cd tools/internal_ci/helper_scripts/../../..
+ find . -type f -not -iname '*sponge_log.*' -not -path './reports/*' -not -path './artifacts/*' -not -path './tools/internal_ci/*' -exec rm -f '{}' +
ERROR: Aborting VM command due to timeout of 10800 seconds
```
4 years ago
Richard Belleville
35c60cd9ed
Enable Python Timeout xDS Interop Test ( #25525 )
...
* Add timeout to Python xDS tests
* Bump server
* Pin first order dependencies
* Revert "Pin first order dependencies"
This reverts commit 97fae67b04
.
4 years ago
AJ Heller
5139a012e7
Migrate the bm_diff benchmarks to python3 ( #25619 )
...
* Migrate the bm_diff benchmarks to python3
Includes a requirements.txt pinned at ~2017 versions, when this script
was first written.
* Replace p2 with p3 scipy/numpy dependencies.
* py2->3 for benchmark setup scripts
* upgrade pip to resolve python3 cryptography/setuptools-rust problem
* re-add jobset import (accidentally removed)
* re-add six's urllib import. This file is still used in py2 tests
* force py3 in run_if_c_cpp_modified.sh
* Fix another instance of subprocess.check_output binary mode
* Use the requirements.txt for CI perf environment setup
* Try to upgrade PyJWT. (v2.0.0 was problematic, #25053 )
v2.x makes encode return strs from jwt.encode in both py2 and py3.
Previously, py3 would return bytes, and py2 a str.
* upgate cryptography lib version requirements for jwt.
* Wrap pip requirements specifier in quotes '>=x,<y'
* Decode subprocess output once instead of for every line
* Revert "Decode subprocess output once instead of for every line"
This reverts commit 28d14026431622ac7afd3535a8d7118e5be96628.
py2 doesn't support the `text` argument to subprocess.check_output.
* Address reviewer requests
* Pin a valid scipy version
* Remove scipy and tabulate dependencies from macos tests
4 years ago
Stanley Cheung
8f2f3d555a
Enable timeout xds test for Ruby ( #25623 )
4 years ago
Richard Belleville
919ee28fc3
Try to use Python 3
4 years ago
Doug Fawley
526a5690f5
add timeout to xds test runs; prevent running V3/alpha tests
...
use alpha API for patching URL maps
4 years ago
Yash Tibrewal
9526a55776
Remove disrespectful term
4 years ago
Yash Tibrewal
7a5288d2a0
Replace disrespectful words
4 years ago
Lidi Zheng
b62c984eab
Pin pip to 19.3.1 to fix the build failure on master
4 years ago
Eric Gribkoff
1822a11c84
increase c# and c++ xds timeouts
4 years ago
Eric Gribkoff
b34a46b641
give python job longer, now that we have more test cases
4 years ago
Penn (Dapeng) Zhang
f4b87879e1
add executable permission to grpc_xds_ruby_test_in_docker.sh
4 years ago
Penn (Dapeng) Zhang
bc600d57c9
Add xds v3 kokoro tests
4 years ago
AJ Heller
85aa1c5f83
Fix the publish packages script v2 (macos x86 deprecation)
4 years ago
AJ Heller
289eaab1fb
Fix broken nightly build and publish due to MacOS x86 protoc deprecation
...
The grpc_publish_packages.sh build has been broken since 2020-12-03 due
to commit 010d9f302
, after which protoc artifacts for MacOS x86 were no
longer being built. See #24870 . The internal errors for
`grpc/core/nightly/grpc_publish_packages` are failing on `chmod +x
<nothing>`.
As pointed out in #25210 , https://packages.grpc.io/ has not been updated
since 2020-12-02.
4 years ago
Richard Belleville
728f2a2f2a
Update to server-3
4 years ago
Penn (Dapeng) Zhang
22444604a4
revert grpc_xds_bazel_test_in_docker.sh
4 years ago
Richard Belleville
278b0a8af4
Update to server-3
4 years ago
Richard Belleville
333fb32667
Merge pull request #25142 from gnossen/cb_interop_python
...
Python Circuit Breaking Interop Test Client Additions
4 years ago
Richard Belleville
5105b1472c
Add to CI
4 years ago
Esun Kim
e49d74b0d8
Added use_strict_warning
4 years ago
Penn (Dapeng) Zhang
b2b01baf78
Run xds v3 tests in kokoro integration
4 years ago
Stanley Cheung
cc645ca5b5
Fix iOS binary size build
4 years ago
Stanley Cheung
d04f80a156
review comment fixes
4 years ago
Stanley Cheung
e4ebd44cd6
Ruby: add support to circuit_breaking xds interop test case
4 years ago
Jan Tattermusch
bf21b2b3a0
update bazel version in other places too
4 years ago
Stanley Cheung
4eee6f3177
Fix Ruby xDS tests
4 years ago
Donna Dionne
4f8ed98f3e
Xds cluster resolver
...
Implemented new xds cluster resolver config
Separated policy and discovery mechanism
4 years ago
Jan Tattermusch
e5b2edd188
fix grpc_android.sh
4 years ago
Lidi Zheng
25b3662c6e
Update pyOpenSSL with cryptography
4 years ago
Lidi Zheng
fd05dcef50
Upgrade pyOpenSSL explicitly
4 years ago
Lidi Zheng
2c302b9089
Try force install Python 3.7
4 years ago
Alexander Polcyn
70f3a25125
Delete unused grpclb-in-dns interop test suite
4 years ago
Esun Kim
8bbe583703
Fix pecl problem
4 years ago
Esun Kim
7b768dfa8d
Added PREPARE_BUILD_INSTALL_DEPS_PHP to distribtests
4 years ago
Esun Kim
3a01cfd126
Conditional python installation
4 years ago
Esun Kim
ead79e794d
Update prepare_build_macos_rc
4 years ago
Esun Kim
7018288758
Check sha256
4 years ago
Esun Kim
76afc77ff6
Update PHP & Ruby Mac BUILD
4 years ago
Jan Tattermusch
f75942015a
unbreak ruby install by pinning brew gnupg
4 years ago
Jan Tattermusch
31a63237fd
unbreak ruby install by pinning brew gnupg
4 years ago
Donna Dionne
dd4839cad0
Add circuit_breaking test to cpp interop tests.
4 years ago
Lidi Zheng
16157cebe9
Hopefully fixed 27 build on winserver2016
...
* Download the working msys64 and use it to compile 27
* Remove the cygwin detection override logic
* Only install Python interpreters in jobs running on winserver2016
* Fix the batch script substring check
* Increase the timeout for related jobs
* TIL that there is an allow list for Kokoro env vars
4 years ago
Lidi Zheng
511af22c78
Hopefully fixed 27 build on winserver2016
...
* Download the working msys64 and use it to compile 27
* Remove the cygwin detection override logic
* Only install Python interpreters in jobs running on winserver2016
* Fix the batch script substring check
* Increase the timeout for related jobs
* TIL that there is an allow list for Kokoro env vars
4 years ago
Eric Gribkoff
20a5bd7168
Revert "to revert: run on kokoro"
...
This reverts commit 3f1165fbfb
.
4 years ago
Eric Gribkoff
3f1165fbfb
to revert: run on kokoro
4 years ago
Esun Kim
0859a3e43a
Add a workaround for CERTIFICATE_VERIFY_FAILED
4 years ago
Jan Tattermusch
a8f7b2d005
stop using GrpcTesting-d0eeee2db331.json for RBE authentication on linux
4 years ago
Jan Tattermusch
e58f0129d2
Stop relying on rbe-windows-credentials.json
4 years ago