The C based gRPC (C++, Python, Ruby, Objective-C, PHP, C#) https://grpc.io/
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

137 lines
5.0 KiB

Migrating urlMap related test cases to K8s framework (#26367) * Build url-map test case class & migrate two test cases - Migrated header matching - Migrated path matching * Polish some details * Give sanity test the trailing line return it wants * Address comments & add timeout cases * Add fault injection and CSDS test cases * Squashed commit of the following: commit 0bf96a0e3eae59d76a456b7deed2c6c1314f4228 Author: Lidi Zheng <lidiz@google.com> Date: Tue Jun 8 12:35:19 2021 -0700 Bazel commit 81b4bf926b656295f1db78ab4c2ff934ab5602af Author: Lidi Zheng <lidiz@google.com> Date: Mon Jun 7 00:04:28 2021 -0700 Enable Bazel commit 245026ed696357308141944aa8c4c9f5b2013a4b Author: Lidi Zheng <lidiz@google.com> Date: Fri Jun 4 10:37:48 2021 -0700 Reuse commit 564d39d28b2201803bfdb379f78e8298623c4029 Author: Lidi Zheng <lidiz@google.com> Date: Fri Jun 4 01:44:56 2021 -0700 Keep` commit 83c437d72a76b71948314f7d5389aadca39b3d07 Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 18:50:47 2021 -0700 1800s timeout commit 1e790a53cd01a1e54bf7df6793381812a9c58c01 Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 18:45:41 2021 -0700 Go commit 68a99640a100ecf2989f0808bd69a8e17f7156bd Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 17:26:29 2021 -0700 No commit d4f6fa5d4a1208c9dfac76e58ca15daa64231c2e Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 17:20:46 2021 -0700 L commit 5ccd048f185c1f5a8d5fdd4359f3157d8d64ea2a Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 16:30:55 2021 -0700 Go commit 411887c7181a593ba3c98fe09bf9f74d52a6ad9c Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 15:51:34 2021 -0700 Test commit 8d005e5203e608c18ffe89fb2f60f81b1ba4ffa8 Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 15:11:44 2021 -0700 Go commit 7c189cb59077ecfb981ca99a8458cf44f3c10526 Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 15:11:03 2021 -0700 Go commit 8fa65a68ca9d5b71c47c8bdf5367ed3189e49cba Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 13:08:11 2021 -0700 Go * Port changes from dev branch and polish * Remove unused code * Fix Bazel build * Finally find out the secret about rpc-behavior * Prepare for merging * Fix bash script and use a more serious name * Enable port forwarding * Resolve comments * Reuse existing code && stylish changes * Update for interface changes * Refactor to remove load_tests and explicit global variables * Improve readability * Disable AlwaysDelay for now * Fix issues with resource creation * Fix unexpected behavior of TestLoader.discover * Add load_tests to timeout_test * Improve documentation * I really shouldn't run tests in parallel at this point * Resolve reviewers' comments && revert DO-NOT-MERGE changes * Two small cleanups * Fix GCP resource creation path * Polish some test logic * Correct the non-failfast logic * Put the accidentally deleted copyright line back * Separate the Kokoro job from security tests * Deflake configure and get_stats && remove DO-NOT-MERGE changes
3 years ago
#!/usr/bin/env bash
# Copyright 2021 gRPC authors.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
set -ex -o igncr || set -ex
# Constants
readonly GITHUB_REPOSITORY_NAME="grpc"
# GKE Cluster
readonly GKE_CLUSTER_NAME="interop-test-psm-basic"
readonly GKE_CLUSTER_ZONE="us-central1-c"
Migrating urlMap related test cases to K8s framework (#26367) * Build url-map test case class & migrate two test cases - Migrated header matching - Migrated path matching * Polish some details * Give sanity test the trailing line return it wants * Address comments & add timeout cases * Add fault injection and CSDS test cases * Squashed commit of the following: commit 0bf96a0e3eae59d76a456b7deed2c6c1314f4228 Author: Lidi Zheng <lidiz@google.com> Date: Tue Jun 8 12:35:19 2021 -0700 Bazel commit 81b4bf926b656295f1db78ab4c2ff934ab5602af Author: Lidi Zheng <lidiz@google.com> Date: Mon Jun 7 00:04:28 2021 -0700 Enable Bazel commit 245026ed696357308141944aa8c4c9f5b2013a4b Author: Lidi Zheng <lidiz@google.com> Date: Fri Jun 4 10:37:48 2021 -0700 Reuse commit 564d39d28b2201803bfdb379f78e8298623c4029 Author: Lidi Zheng <lidiz@google.com> Date: Fri Jun 4 01:44:56 2021 -0700 Keep` commit 83c437d72a76b71948314f7d5389aadca39b3d07 Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 18:50:47 2021 -0700 1800s timeout commit 1e790a53cd01a1e54bf7df6793381812a9c58c01 Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 18:45:41 2021 -0700 Go commit 68a99640a100ecf2989f0808bd69a8e17f7156bd Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 17:26:29 2021 -0700 No commit d4f6fa5d4a1208c9dfac76e58ca15daa64231c2e Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 17:20:46 2021 -0700 L commit 5ccd048f185c1f5a8d5fdd4359f3157d8d64ea2a Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 16:30:55 2021 -0700 Go commit 411887c7181a593ba3c98fe09bf9f74d52a6ad9c Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 15:51:34 2021 -0700 Test commit 8d005e5203e608c18ffe89fb2f60f81b1ba4ffa8 Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 15:11:44 2021 -0700 Go commit 7c189cb59077ecfb981ca99a8458cf44f3c10526 Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 15:11:03 2021 -0700 Go commit 8fa65a68ca9d5b71c47c8bdf5367ed3189e49cba Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 13:08:11 2021 -0700 Go * Port changes from dev branch and polish * Remove unused code * Fix Bazel build * Finally find out the secret about rpc-behavior * Prepare for merging * Fix bash script and use a more serious name * Enable port forwarding * Resolve comments * Reuse existing code && stylish changes * Update for interface changes * Refactor to remove load_tests and explicit global variables * Improve readability * Disable AlwaysDelay for now * Fix issues with resource creation * Fix unexpected behavior of TestLoader.discover * Add load_tests to timeout_test * Improve documentation * I really shouldn't run tests in parallel at this point * Resolve reviewers' comments && revert DO-NOT-MERGE changes * Two small cleanups * Fix GCP resource creation path * Polish some test logic * Correct the non-failfast logic * Put the accidentally deleted copyright line back * Separate the Kokoro job from security tests * Deflake configure and get_stats && remove DO-NOT-MERGE changes
3 years ago
## xDS test client Docker images
readonly CLIENT_IMAGE_NAME="gcr.io/grpc-testing/xds-interop/cpp-client"
readonly FORCE_IMAGE_BUILD="${FORCE_IMAGE_BUILD:-0}"
readonly BUILD_APP_PATH="interop-testing/build/install/grpc-interop-testing"
#######################################
# Builds test app Docker images and pushes them to GCR
# Globals:
# BUILD_APP_PATH
# CLIENT_IMAGE_NAME: Test client Docker image name
# GIT_COMMIT: SHA-1 of git commit being built
# Arguments:
# None
# Outputs:
# Writes the output of `gcloud builds submit` to stdout, stderr
#######################################
build_test_app_docker_images() {
echo "Building C++ xDS interop test app Docker images"
docker build -f "${SRC_DIR}/tools/dockerfile/interoptest/grpc_interop_cxx_xds/Dockerfile.xds_client" -t "${CLIENT_IMAGE_NAME}:${GIT_COMMIT}" "${SRC_DIR}"
gcloud -q auth configure-docker
docker push "${CLIENT_IMAGE_NAME}:${GIT_COMMIT}"
}
#######################################
# Builds test app and its docker images unless they already exist
# Globals:
# CLIENT_IMAGE_NAME: Test client Docker image name
# GIT_COMMIT: SHA-1 of git commit being built
# FORCE_IMAGE_BUILD
# Arguments:
# None
# Outputs:
# Writes the output to stdout, stderr
#######################################
build_docker_images_if_needed() {
# Check if images already exist
client_tags="$(gcloud_gcr_list_image_tags "${CLIENT_IMAGE_NAME}" "${GIT_COMMIT}")"
printf "Client image: %s:%s\n" "${CLIENT_IMAGE_NAME}" "${GIT_COMMIT}"
echo "${client_tags:-Client image not found}"
# Build if any of the images are missing, or FORCE_IMAGE_BUILD=1
if [[ "${FORCE_IMAGE_BUILD}" == "1" || -z "${client_tags}" ]]; then
build_test_app_docker_images
else
echo "Skipping C++ test app build"
fi
}
#######################################
# Executes the test case
# Globals:
# TEST_DRIVER_FLAGFILE: Relative path to test driver flagfile
# KUBE_CONTEXT: The name of kubectl context with GKE cluster access
# TEST_XML_OUTPUT_DIR: Output directory for the test xUnit XML report
# CLIENT_IMAGE_NAME: Test client Docker image name
# GIT_COMMIT: SHA-1 of git commit being built
# Arguments:
# Test case name
# Outputs:
# Writes the output of test execution to stdout, stderr
# Test xUnit report to ${TEST_XML_OUTPUT_DIR}/${test_name}/sponge_log.xml
#######################################
run_test() {
# Test driver usage:
# https://github.com/grpc/grpc/tree/master/tools/run_tests/xds_k8s_test_driver#basic-usage
local test_name="${1:?Usage: run_test test_name}"
set -x
python -m "tests.${test_name}" \
--flagfile="${TEST_DRIVER_FLAGFILE}" \
--kube_context="${KUBE_CONTEXT}" \
--client_image="${CLIENT_IMAGE_NAME}:${GIT_COMMIT}" \
--xml_output_file="${TEST_XML_OUTPUT_DIR}/${test_name}/sponge_log.xml" \
--flagfile="config/url-map.cfg"
Migrating urlMap related test cases to K8s framework (#26367) * Build url-map test case class & migrate two test cases - Migrated header matching - Migrated path matching * Polish some details * Give sanity test the trailing line return it wants * Address comments & add timeout cases * Add fault injection and CSDS test cases * Squashed commit of the following: commit 0bf96a0e3eae59d76a456b7deed2c6c1314f4228 Author: Lidi Zheng <lidiz@google.com> Date: Tue Jun 8 12:35:19 2021 -0700 Bazel commit 81b4bf926b656295f1db78ab4c2ff934ab5602af Author: Lidi Zheng <lidiz@google.com> Date: Mon Jun 7 00:04:28 2021 -0700 Enable Bazel commit 245026ed696357308141944aa8c4c9f5b2013a4b Author: Lidi Zheng <lidiz@google.com> Date: Fri Jun 4 10:37:48 2021 -0700 Reuse commit 564d39d28b2201803bfdb379f78e8298623c4029 Author: Lidi Zheng <lidiz@google.com> Date: Fri Jun 4 01:44:56 2021 -0700 Keep` commit 83c437d72a76b71948314f7d5389aadca39b3d07 Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 18:50:47 2021 -0700 1800s timeout commit 1e790a53cd01a1e54bf7df6793381812a9c58c01 Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 18:45:41 2021 -0700 Go commit 68a99640a100ecf2989f0808bd69a8e17f7156bd Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 17:26:29 2021 -0700 No commit d4f6fa5d4a1208c9dfac76e58ca15daa64231c2e Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 17:20:46 2021 -0700 L commit 5ccd048f185c1f5a8d5fdd4359f3157d8d64ea2a Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 16:30:55 2021 -0700 Go commit 411887c7181a593ba3c98fe09bf9f74d52a6ad9c Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 15:51:34 2021 -0700 Test commit 8d005e5203e608c18ffe89fb2f60f81b1ba4ffa8 Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 15:11:44 2021 -0700 Go commit 7c189cb59077ecfb981ca99a8458cf44f3c10526 Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 15:11:03 2021 -0700 Go commit 8fa65a68ca9d5b71c47c8bdf5367ed3189e49cba Author: Lidi Zheng <lidiz@google.com> Date: Thu Jun 3 13:08:11 2021 -0700 Go * Port changes from dev branch and polish * Remove unused code * Fix Bazel build * Finally find out the secret about rpc-behavior * Prepare for merging * Fix bash script and use a more serious name * Enable port forwarding * Resolve comments * Reuse existing code && stylish changes * Update for interface changes * Refactor to remove load_tests and explicit global variables * Improve readability * Disable AlwaysDelay for now * Fix issues with resource creation * Fix unexpected behavior of TestLoader.discover * Add load_tests to timeout_test * Improve documentation * I really shouldn't run tests in parallel at this point * Resolve reviewers' comments && revert DO-NOT-MERGE changes * Two small cleanups * Fix GCP resource creation path * Polish some test logic * Correct the non-failfast logic * Put the accidentally deleted copyright line back * Separate the Kokoro job from security tests * Deflake configure and get_stats && remove DO-NOT-MERGE changes
3 years ago
set +x
}
#######################################
# Main function: provision software necessary to execute tests, and run them
# Globals:
# KOKORO_ARTIFACTS_DIR
# GITHUB_REPOSITORY_NAME
# SRC_DIR: Populated with absolute path to the source repo
# TEST_DRIVER_REPO_DIR: Populated with the path to the repo containing
# the test driver
# TEST_DRIVER_FULL_DIR: Populated with the path to the test driver source code
# TEST_DRIVER_FLAGFILE: Populated with relative path to test driver flagfile
# TEST_XML_OUTPUT_DIR: Populated with the path to test xUnit XML report
# GIT_ORIGIN_URL: Populated with the origin URL of git repo used for the build
# GIT_COMMIT: Populated with the SHA-1 of git commit being built
# GIT_COMMIT_SHORT: Populated with the short SHA-1 of git commit being built
# KUBE_CONTEXT: Populated with name of kubectl context with GKE cluster access
# Arguments:
# None
# Outputs:
# Writes the output of test execution to stdout, stderr
#######################################
main() {
local script_dir
script_dir="$(dirname "$0")"
# shellcheck source=tools/internal_ci/linux/grpc_xds_k8s_install_test_driver.sh
source "${script_dir}/grpc_xds_k8s_install_test_driver.sh"
set -x
if [[ -n "${KOKORO_ARTIFACTS_DIR}" ]]; then
kokoro_setup_test_driver "${GITHUB_REPOSITORY_NAME}"
else
local_setup_test_driver "${script_dir}"
fi
build_docker_images_if_needed
# Run tests
cd "${TEST_DRIVER_FULL_DIR}"
run_test url_map
}
main "$@"