b516dbfa21
Increase artifact build timeouts for problem targets ( #25695 )
...
Going back 2 weeks, nightly packages have failed to build due to
artifact build timeouts. This change increases timeouts for:
Python Linux Extra: 5hrs -> 7hrs
Python Manylinux: 1hr -> 2hrs
CSharp iOS: 45min -> 1hr
CSharp MacOS x64: 30m -> 45m
This is a stopgap measure to get nightly packages deployed more regularly;
March has seen 3 nightlies published in 11 days.
I've cherry picked some of the artifact build timeout errors below.
2021.03.10
grpc/core/master/linux/grpc_build_artifacts_extra_release
2021-03-10 05:03:40,560 TIMEOUT: build_artifact.python_linux_extra_armv7_3.6 [pid=7384, time=18000.4sec]
2021-03-10 05:03:40,646 TIMEOUT: build_artifact.python_linux_extra_armv7_2.7 [pid=7375, time=18000.5sec]
2021-03-10 05:03:40,728 TIMEOUT: build_artifact.python_linux_extra_armv7_3.5 [pid=7378, time=18000.6sec]
2021.03.08
grpc/core/master/linux/grpc_build_artifacts_extra_release
2021-03-08 05:03:18,542 TIMEOUT: build_artifact.python_linux_extra_armv7_3.6 [pid=6853, time=18000.5sec]
2021-03-08 05:03:18,639 TIMEOUT: build_artifact.python_linux_extra_armv7_2.7 [pid=6844, time=18000.6sec]
2021-03-08 05:03:18,741 TIMEOUT: build_artifact.python_linux_extra_armv7_3.5 [pid=6847, time=18000.7sec]
2021.03.07
grpc/core/master/macos/grpc_build_artifacts:
2021-03-07 00:58:02,492 TIMEOUT: build_artifact.csharp_ext_macos_x64 [pid=58673, time=1805.5sec]
2021-03-07 01:13:03,065 TIMEOUT: build_artifact.csharp_ext_macos_ios [pid=58672, time=2706.1sec]
Bumping iOS again from https://github.com/grpc/grpc/pull/25049
grpc/core/master/linux/grpc_build_artifacts_extra_release
2021-03-07 05:03:36,061 TIMEOUT: build_artifact.python_linux_extra_armv7_3.6 [pid=8867, time=18002.9sec]
2021.03.06
grpc/core/master/linux/grpc_build_artifacts_extra_release
2021-03-06 05:03:12,474 TIMEOUT: build_artifact.python_linux_extra_armv7_3.5 [pid=8307, time=18000.6sec]
2021.03.05
grpc/core/master/linux/grpc_build_artifacts_extra_release
2021-03-05 05:03:48,611 TIMEOUT: build_artifact.python_linux_extra_armv7_3.6 [pid=7075, time=18008.6sec]
2021.02.27
grpc/core/master/linux/grpc_build_artifacts
2021-02-27 01:09:57,943 TIMEOUT: build_artifact.python_manylinux2010_x64_cp27-cp27mu [pid=21983, time=3608.9sec]
2021.02.23
grpc/core/master/windows/grpc_build_artifacts
```
2021-02-23 01:48:23,729 SUCCESS: All targets built successfully.
T:\src\github\grpc>set RUNTESTS_EXITCODE=0
T:\src\github\grpc>bash tools/internal_ci/helper_scripts/delete_nonartifacts.sh
++ dirname tools/internal_ci/helper_scripts/delete_nonartifacts.sh
+ cd tools/internal_ci/helper_scripts/../../..
+ find . -type f -not -iname '*sponge_log.*' -not -path './reports/*' -not -path './artifacts/*' -not -path './tools/internal_ci/*' -exec rm -f '{}' +
ERROR: Aborting VM command due to timeout of 10800 seconds
```
4 years ago
d3e97d953b
Adding xxhash as a subtree ( #25645 )
4 years ago
c57a4be05d
Disable fault injection env var in xds interop tests ( #25676 )
4 years ago
5e13018330
Update third_party/benchmark to v1.5.2 ( #25184 )
...
This fix the following error when compiling:
error: #error C++11 or greater detected by the library. BENCHMARK_HAS_CXX11 is defined.
12 | #error C++11 or greater detected by the library. BENCHMARK_HAS_CXX11 is defined.
| ^~~~~
Signed-off-by: Clément Péron <peron.clem@gmail.com>
4 years ago
ec31fa8455
Standardize all environment variable boolean configuration in python's setup.py ( #25444 )
...
* standardize bool flags for grpcio and grpcio.tools
Co-authored-by: Jan Tattermusch <jtattermusch@google.com>
4 years ago
35c60cd9ed
Enable Python Timeout xDS Interop Test ( #25525 )
...
* Add timeout to Python xDS tests
* Bump server
* Pin first order dependencies
* Revert "Pin first order dependencies"
This reverts commit 97fae67b04
4 years ago
3b067c9f3f
Implement xDS client-side fault injection filter ( #24354 )
...
* Refactored with dynamic filters
* Error-tolerance tuned
* Fix leak of grpc_error and data race of canceller
* Adopt the latest xDS HTTP filter framework
* Fix fault injection tests' conflict with router filter
* Test alternative setup (override, no-override) without copy
* Refactor file strcutures of fault injection filter
* Rewrite the Json parsing/assembling logic again
* Added logic for aborting streaming RPC && resolve comments
4 years ago
6276b66490
run_xds_tests: add fault_injection tests ( #25641 )
4 years ago
5139a012e7
Migrate the bm_diff benchmarks to python3 ( #25619 )
...
* Migrate the bm_diff benchmarks to python3
Includes a requirements.txt pinned at ~2017 versions, when this script
was first written.
* Replace p2 with p3 scipy/numpy dependencies.
* py2->3 for benchmark setup scripts
* upgrade pip to resolve python3 cryptography/setuptools-rust problem
* re-add jobset import (accidentally removed)
* re-add six's urllib import. This file is still used in py2 tests
* force py3 in run_if_c_cpp_modified.sh
* Fix another instance of subprocess.check_output binary mode
* Use the requirements.txt for CI perf environment setup
* Try to upgrade PyJWT. (v2.0.0 was problematic, #25053 )
v2.x makes encode return strs from jwt.encode in both py2 and py3.
Previously, py3 would return bytes, and py2 a str.
* upgate cryptography lib version requirements for jwt.
* Wrap pip requirements specifier in quotes '>=x,<y'
* Decode subprocess output once instead of for every line
* Revert "Decode subprocess output once instead of for every line"
This reverts commit 28d14026431622ac7afd3535a8d7118e5be96628.
py2 doesn't support the `text` argument to subprocess.check_output.
* Address reviewer requests
* Pin a valid scipy version
* Remove scipy and tabulate dependencies from macos tests
4 years ago
5c95dd5c2c
Update dart to 2.12 release ( #25657 )
4 years ago
1437dc9816
Fix pypa link ( #25647 )
...
* Fix pypa link
* And 3.5 as well
4 years ago
262024be79
Add v1.36.0 release of grpc-go to interop matrix ( #25553 )
4 years ago
e7d9cccf9a
Fix build abseil/boringssl/protobuf at head ( #25638 )
...
* Update PyYAML install steps
* F-string is 3.6+
* Regenerate project
4 years ago
8f2f3d555a
Enable timeout xds test for Ruby ( #25623 )
4 years ago
bd86187f19
SDK authorization policy translator. ( #25361 )
...
* SDK authorization policy translator.
4 years ago
34c8a1f87a
Revert "Adding xxhash as a subtree" ( #25630 )
...
This reverts commit 3880393fea
4 years ago
40bc4624c2
Adding xxhash as a subtree ( #25601 )
...
* Squashed 'third_party/xxhash/' content from commit aea11081f3
git-subtree-dir: third_party/xxhash
git-subtree-split: aea11081f349893ec26f86ada22c66e828885083
* Adding xxhash as a subtree
4 years ago
444e6e6d64
Added include/grpcpp/impl/codegen/method_handler_impl.h to grpc++_codegen_base ( #25618 )
4 years ago
377fe6095a
Upgrade clang-tidy and clang-format to 11 ( #25590 )
...
* Upgrade clang-tidy and clang-format to 11
* Reformat code
* Fix abseil-string-find-str-contains
* Fix modernize-make-unique
4 years ago
65ea33e427
xds-k8s Fix NameError name 'cls' is not defined ( #25615 )
4 years ago
a2697e4592
simplify build.yaml: get rid of the "secure" field ( #25547 )
...
* get rid of useless "secure" field from build.yaml
* remove nonsensical "liblibssl.a" dependency from makefile
* regenerate projects
4 years ago
1dce57f35f
Assorted python wheel build improvements ( #25602 )
...
* cleanup unnecessary deps from grpc_artifact_python_manylinux2014_aarch64
* cleanup in grpc_artifact_python dockerfiles
* enable boringssl assembly optimizations when crosscompiling aarch64 linux wheels
* pin manylinux2010 images to keep python27 build
* avoid pip install --upgrade cython when not necessary
4 years ago
cb8114d689
Delete no longer needed artifact_linux dockerfiles ( #25542 )
...
* delete no longer needed artifact_linux dockerfiles
* fix build_package_python.sh
4 years ago
d098697659
PHP: php server commit 3/n, add ServerContext and MethodDescriptor ( #25399 )
...
* add ServerContext and MethodDescriptor
* re-run generate_projects.sh
4 years ago
44e5409a4e
Option to disable local_certificate check from PSM security tests ( #25595 )
...
* Remove local_certificate check from PSM security tests
* Reviewer comments
* Update tools/run_tests/xds_k8s_test_driver/framework/xds_k8s_testcase.py
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
* YAPF code
Co-authored-by: Sergii Tkachenko <hi@sergii.org>
4 years ago
061fcbb214
PHP: php server commit 2/n, add Server Call ( #25397 )
...
* php server commit 2, server call
* re-run generate_projects.sh
* temp solution to avoid using autoload
* remove type-hint of
4 years ago
ee375222a0
Double WAIT_FOR_BACKEND_SEC ( #25603 )
4 years ago
f862a2259f
Add abseil thread annotations to grpcpp/sync ( #25560 )
...
* Add abseil annotation to grpcpp/sync
* Bump alpine linux to 3.11 from 3.9
4 years ago
4e9206f48c
Make returning a local reference a compilation error ( #25568 )
...
* Make returning a local reference a compile error
* Bazel doesn't like return-local-addr
4 years ago
39cc797025
[xDS Proto] Modernize buildgen scripts ( #25512 )
...
* [xDS Proto] Modernize buildgen scripts
* This PR only covers some buildgen scripts that will be used by xDS
proto
* This PR also improves the debuggability of some scripts
* Merge with master
* Adopt reviewer's advices
4 years ago
160cb1b215
Changed RPI build test to general ARM build test ( #25580 )
...
* Change rpi build test to arm test
* Having a separate docker and targetting aarch64
4 years ago
fcd43e9030
Crosscompile python aarch64 wheels with dockcross ( #25418 )
...
* build aarch64 python wheels via crosscompilation
* yapf format code
* fix shellcheck complaints
* fix python37 aarch64 wheel build
* build python wheels on linux aarch64 with static libstdc++
* yapf format code
4 years ago
565520443b
[xDS Proto] Update Bazel dependencies ( #25511 )
...
* [xDS Proto] Update Bazel dependencies
* Include transitive deps required by xDS proto libraries
* The Golang deps come from protoc-gen-validate project
* Adding a new submodule: opencensus-proto
* Add the new submodule to .bazelignore
* Update WORKSPACE file to initialize googleapis
* Remove WORKSPACE override
* Adopt reviewer's advice
4 years ago
ad461a3c7c
xds-k8s: Update local-dev.cfg.example ( #25552 )
4 years ago
2fd9f5ead9
Update third_party/protobuf to v3.15.2 ( #25565 )
...
* Update protobuf to v3.15.2
* revert boringssl podspec changes
Co-authored-by: Jan Tattermusch <jtattermusch@google.com>
4 years ago
d515270e86
Fix the generated_projects.sh again ( #25572 )
...
* Double quote for shell string comparison
4 years ago
8bf040ff17
Add gRPC Java 1.36.0 to interop matrix ( #25566 )
4 years ago
26f85ca2d9
Update boringssl ( #25564 )
...
* update submodule boringssl-with-bazel with origin/master-with-bazel
* update boringssl dependency to master-with-bazel commit SHA
* regenerate files
* Updated sha256
* generate boringssl prefix headers
* Increment podspec version
* Second regeneration
* add boringssl SHA in check_submodules.sh
4 years ago
49601b0334
Second attempt: xDS HTTP filter support for gRPC client ( #25558 )
...
* Revert "Revert "xDS HTTP filter support for gRPC client" (#25555 )"
This reverts commit 785a128a83
4 years ago
4a90992d03
Update PyYAML in generate_project.sh if needed ( #25563 )
4 years ago
785a128a83
Revert "xDS HTTP filter support for gRPC client" ( #25555 )
...
This reverts commit b2164837a8
4 years ago
53d32b748f
Cleanup: Remove no-longer-needed expand_filegroups.py ( #25532 )
...
* get rid of expand_filegroups.py
* regenerate projects
4 years ago
3b6ea094dd
get rid of dll_only in build.yaml ( #25524 )
4 years ago
900e47b1a9
xds-k8s: set GRPC_XDS_EXPERIMENTAL_NEW_SERVER_API ( #25529 )
4 years ago
5426770c73
xds-k8s driver: remove "Client subchannel must have no sockets" check ( #25460 )
4 years ago
0c66144692
Simplify build.yaml's "deps_linkage" logic ( #25521 )
...
* regenerate to fix sanity
* makefile template always assumes deps_linkage=static
* stop setting no-longer-used deps_linkage field in build_autogenerated.yaml
* regenerate projects
4 years ago
a6c5d6c43e
[xDS Proto] Pin PyPI dependencies in Dockerfiles ( #25510 )
4 years ago
a807466e4c
Enable backport of unmerged PRs ( #25502 )
...
* Enable backport of unmerged PRs
* Fix backport of merged PR
* Wordsmith
* Convert help text to heredoc
* Formatting
4 years ago
af76d0321a
Restore callback microbenchmarks but make them manual for now ( #25491 )
4 years ago
88cb81baf7
Add copyright notice
4 years ago
AJ Heller
donnadionne
Menghan Li
Clément Péron
emkornfield
Richard Belleville
Lidi Zheng
Doug Fawley
Ivan Inozemtsev
Stanley Cheung
Ashitha Santhosh
Esun Kim
Sergii Tkachenko
Jan Tattermusch
Hannah Shi
Yash Tibrewal
Karthik Ravi Shankar
Eric Anderson
Mark D. Roth
Vijay Pai