Craig Tiller
a7dcceb365
Revert "Cleanup of windows CI .bat scripts ( #28396 )" ( #28446 )
...
This reverts commit 44e7be448d
.
3 years ago
Jan Tattermusch
44e7be448d
Cleanup of windows CI .bat scripts ( #28396 )
...
* cleanup of windows CI .bat scripts
* fixup
* fixup
* fixup
3 years ago
Jan Tattermusch
769369ad3f
fix invocation of respawn scripts on windows ( #28366 )
3 years ago
Jan Tattermusch
8afb68238b
Fix windows RBE results uploading to bigquery ( #28365 )
3 years ago
Lidi Zheng
7cfd399dd6
Reduce the workload of presubmit artifact builds and distribtests ( #28228 )
...
* Reduce the workload of presubmit artifact builds and distribtests
* Create and redirect Kokoro config
* Remove duplicated scripts and use env var config
* Clean-up Kokoro cfg
* [DO-NOT-SUBMIT] Add ad-hoc TASK_RUNNER_EXTRA_FILTERS
* Revert "[DO-NOT-SUBMIT] Add ad-hoc TASK_RUNNER_EXTRA_FILTERS"
This reverts commit 9436ac54ac
.
3 years ago
Jan Tattermusch
3a024ea40c
Avoid extremely slow kokoro job finalization by moving workspace to a non-synced directory on kokoro workers. ( #28259 )
...
* support "move and respawn" for kokoro jobs
* delete_nonartifacts.sh no longer needed
* bazel distribtest dont publish any artifacts
* try the altsrc respawn for selected jobs
* use altsrc for all windows CI jobs
* use altsrc for all macos CI jobs
* only move files under src/github
* fix uploading artifacts on windows
3 years ago
Esun Kim
63d48ee8d8
Use more parallelism to windows portability tests ( #28179 )
...
* Use more parallelism to windows portability tests
* Added /MP
* Changed it to gRPC_BUILD_MSVC_MP_COUNT
3 years ago
Richard Belleville
8f50d574fb
Add note about starting port server out of band ( #28012 )
3 years ago
Richard Belleville
05b695c95a
Start port server separately ( #28005 )
3 years ago
Richard Belleville
59693b7e72
Migrate Infrastructure Scripts to Python 3 ( #27135 )
...
* Run 2to3 on tools directory
* Delete github_stats_tracking
* Re-run 2to3
* Remove unused script
* Remove unused script
* Remove unused line count utility
* Yapf. Isort
* Remove accidentally included file
* Migrate tools/distrib directory to python 3
* Remove unnecessary shebang
* Restore line_count directory
* Immediately convert subprocess.check_output output to string
* Take care of Python 2 shebangs
* Invoke scripts using a Python 3 interpreter
* Yapf. Isort
* Try installing Python 3 first
* See if we have any Python 3 versions installed
* Add Python 3.7 to Windows path
* Try adding a symlink
* Try to symlink differently
* Install six for Python 3
* Run run_interop_tests with python 3
* Try installing six in python3.7 explicitly
* Revert "Try installing six in python3.7 explicitly"
This reverts commit 2cf60d72f3
.
* And debug some more
* Fix issue with jobset.py
* Add debug for CI failure
* Revert microbenchmark changes
3 years ago
Lidi Zheng
99af2bdf3f
Extend the Windows Python test timeout to 3hr ( #27843 )
3 years ago
Jan Tattermusch
9b2b9976c6
increase windows C# basictests job timeout ( #27483 )
3 years ago
Jan Tattermusch
0042c2b86f
Upgrade bazel to 4.2.1 (LTS), upgrade bazel toolchain to 4.1.0 ( #27410 )
...
* update bazel to 4.2.1
* add bazel 4.2.1 to update_mirror.sh
* regenerate dockerfiles
* upgrade bazel toolchains to 4.1.0
* use create_rbe_exec_properties_dict instead of the deprecated create_exec_properties_dict
* RBE ubsan doesnt require the crosstool_top hack anymore
* update rules_apple and build_bazel_apple_support
3 years ago
Jan Tattermusch
c4aa6af0a0
Increase timeout for windows portability test (on master) ( #27210 )
...
* remove no longer use kokoro job config
* increase timeout of windows grpc_portability job
3 years ago
Esun Kim
f6bcb40b7f
Use T drive for windows bazel RBE build ( #26895 )
3 years ago
AJ Heller
b516dbfa21
Increase artifact build timeouts for problem targets ( #25695 )
...
Going back 2 weeks, nightly packages have failed to build due to
artifact build timeouts. This change increases timeouts for:
Python Linux Extra: 5hrs -> 7hrs
Python Manylinux: 1hr -> 2hrs
CSharp iOS: 45min -> 1hr
CSharp MacOS x64: 30m -> 45m
This is a stopgap measure to get nightly packages deployed more regularly;
March has seen 3 nightlies published in 11 days.
I've cherry picked some of the artifact build timeout errors below.
2021.03.10
grpc/core/master/linux/grpc_build_artifacts_extra_release
2021-03-10 05:03:40,560 TIMEOUT: build_artifact.python_linux_extra_armv7_3.6 [pid=7384, time=18000.4sec]
2021-03-10 05:03:40,646 TIMEOUT: build_artifact.python_linux_extra_armv7_2.7 [pid=7375, time=18000.5sec]
2021-03-10 05:03:40,728 TIMEOUT: build_artifact.python_linux_extra_armv7_3.5 [pid=7378, time=18000.6sec]
2021.03.08
grpc/core/master/linux/grpc_build_artifacts_extra_release
2021-03-08 05:03:18,542 TIMEOUT: build_artifact.python_linux_extra_armv7_3.6 [pid=6853, time=18000.5sec]
2021-03-08 05:03:18,639 TIMEOUT: build_artifact.python_linux_extra_armv7_2.7 [pid=6844, time=18000.6sec]
2021-03-08 05:03:18,741 TIMEOUT: build_artifact.python_linux_extra_armv7_3.5 [pid=6847, time=18000.7sec]
2021.03.07
grpc/core/master/macos/grpc_build_artifacts:
2021-03-07 00:58:02,492 TIMEOUT: build_artifact.csharp_ext_macos_x64 [pid=58673, time=1805.5sec]
2021-03-07 01:13:03,065 TIMEOUT: build_artifact.csharp_ext_macos_ios [pid=58672, time=2706.1sec]
Bumping iOS again from https://github.com/grpc/grpc/pull/25049
grpc/core/master/linux/grpc_build_artifacts_extra_release
2021-03-07 05:03:36,061 TIMEOUT: build_artifact.python_linux_extra_armv7_3.6 [pid=8867, time=18002.9sec]
2021.03.06
grpc/core/master/linux/grpc_build_artifacts_extra_release
2021-03-06 05:03:12,474 TIMEOUT: build_artifact.python_linux_extra_armv7_3.5 [pid=8307, time=18000.6sec]
2021.03.05
grpc/core/master/linux/grpc_build_artifacts_extra_release
2021-03-05 05:03:48,611 TIMEOUT: build_artifact.python_linux_extra_armv7_3.6 [pid=7075, time=18008.6sec]
2021.02.27
grpc/core/master/linux/grpc_build_artifacts
2021-02-27 01:09:57,943 TIMEOUT: build_artifact.python_manylinux2010_x64_cp27-cp27mu [pid=21983, time=3608.9sec]
2021.02.23
grpc/core/master/windows/grpc_build_artifacts
```
2021-02-23 01:48:23,729 SUCCESS: All targets built successfully.
T:\src\github\grpc>set RUNTESTS_EXITCODE=0
T:\src\github\grpc>bash tools/internal_ci/helper_scripts/delete_nonartifacts.sh
++ dirname tools/internal_ci/helper_scripts/delete_nonartifacts.sh
+ cd tools/internal_ci/helper_scripts/../../..
+ find . -type f -not -iname '*sponge_log.*' -not -path './reports/*' -not -path './artifacts/*' -not -path './tools/internal_ci/*' -exec rm -f '{}' +
ERROR: Aborting VM command due to timeout of 10800 seconds
```
4 years ago
Jan Tattermusch
bf21b2b3a0
update bazel version in other places too
4 years ago
Lidi Zheng
16157cebe9
Hopefully fixed 27 build on winserver2016
...
* Download the working msys64 and use it to compile 27
* Remove the cygwin detection override logic
* Only install Python interpreters in jobs running on winserver2016
* Fix the batch script substring check
* Increase the timeout for related jobs
* TIL that there is an allow list for Kokoro env vars
4 years ago
Lidi Zheng
511af22c78
Hopefully fixed 27 build on winserver2016
...
* Download the working msys64 and use it to compile 27
* Remove the cygwin detection override logic
* Only install Python interpreters in jobs running on winserver2016
* Fix the batch script substring check
* Increase the timeout for related jobs
* TIL that there is an allow list for Kokoro env vars
4 years ago
Jan Tattermusch
e58f0129d2
Stop relying on rbe-windows-credentials.json
4 years ago
Lidi Zheng
85d0d548c4
Increase the timeout of Python basic tests on Windows
4 years ago
Jan Tattermusch
858797ae77
disable grpc_build_packages.bat
4 years ago
Lidi Zheng
a0a69de4df
Improve Win CI script with fail fast
4 years ago
Jan Tattermusch
424d33415c
upgrade bazel to 2.2.0
4 years ago
Lidi Zheng
db4ce94ebb
Revert "Revert "Release Python3.8 wheels for Windows""
5 years ago
Jan Tattermusch
42039d09b7
Revert "Release Python3.8 wheels for Windows"
5 years ago
Lidi Zheng
ed054d03a1
Fix the hack, hope the test still passes
5 years ago
Lidi Zheng
6b92b4af05
Attempt to drop support for Python 3.4
5 years ago
Jan Tattermusch
e5e3f70a1a
Revert "Revert "Upgrade to bazel 1.0.0""
5 years ago
Lidi Zheng
0765cf940b
Refactor the way AsyncIO is tested under run_tests.py
5 years ago
Lidi Zheng
b231e7f88f
Add three more Kokoro job for Linux, macOS and Windows
5 years ago
Jan Tattermusch
79cfdb525c
increase timeout of bazel RBE jobs
...
if the kokoro job times out and the bazel command is not done, it ends up in
weird test results ("Unevaluated targets") that are hard to interpret.
Setting the timeout for kokoro jobs high enough to create extra reserve
should help.
5 years ago
Nicolas Noble
04d7e0d11f
Revert "Upgrade to bazel 1.0.0"
5 years ago
Jan Tattermusch
27f1a94aa5
upgrade to bazel 1.0.0
5 years ago
Jan Tattermusch
d10fb3ba99
fix win RBE opt build
5 years ago
Jan Tattermusch
17fc384b1e
add job config for Windows RBE opt config, upload test results
5 years ago
Jan Tattermusch
2262e2b8e8
add extra kokoro build info to Win RBE runs
5 years ago
Jan Tattermusch
837cb04f76
win RBE: dont cache on master, use dbg config
5 years ago
Jan Tattermusch
8d81a934ca
run both C and C++ tests on win RBE
5 years ago
Jan Tattermusch
f35678e3b4
run at least core tests
5 years ago
Jan Tattermusch
16f4103269
try running only one test
5 years ago
Jan Tattermusch
6f6fe451be
run tests on win RBE
5 years ago
Jan Tattermusch
0b65b421d3
try fixing the C# win artifact
5 years ago
Jan Tattermusch
4521dea985
try bazel 0.29.1 for windows
5 years ago
Jan Tattermusch
c5662bba80
use bazel 0.29.0 on windows
5 years ago
Jan Tattermusch
98d2d32b9e
upgrade to bazel 0.29.1
5 years ago
Jan Tattermusch
5cd37064cb
try fix win RBE build
5 years ago
Jan Tattermusch
e88553ed17
upgrade windows RBE to bazel 0.29
5 years ago
Jan Tattermusch
4e8ecb9fe6
Revert "Upgrade to Bazel 0.29 (including Windows RBE)"
5 years ago
Jan Tattermusch
08dc331019
try fix win RBE build
5 years ago