Chiebot-Mirror/grpc - grpc - Gitea: Git with a cup of tea

Author	SHA1	Message	Date
AJ Heller	3fb738b9b1	[EventEngine] Implement work-stealing in the EventEngine ThreadPool (#32869 ) This PR implements a work-stealing thread pool for use inside EventEngine implementations. Because of historical risks here, I've guarded the new implementation behind an experiment flag: `GRPC_EXPERIMENTS=work_stealing`. Current default behavior is the original thread pool implementation. Benchmarks look very promising: ``` bazel test \ --test_timeout=300 \ --config=opt -c opt \ --test_output=streamed \ --test_arg='--benchmark_format=csv' \ --test_arg='--benchmark_min_time=0.15' \ --test_arg='--benchmark_filter=_FanOut' \ --test_arg='--benchmark_repetitions=15' \ --test_arg='--benchmark_report_aggregates_only=true' \ test/cpp/microbenchmarks:bm_thread_pool ``` 2023-05-04: `bm_thread_pool` benchmark results on my local machine (64 core ThreadRipper PRO 3995WX, 256GB memory), comparing this PR to master: ![image](https://user-images.githubusercontent.com/295906/236315252-35ed237e-7626-486c-acfa-71a36f783d22.png) 2023-05-04: `bm_thread_pool` benchmark results in the Linux RBE environment (unsure of machine configuration, likely small), comparing this PR to master. ![image](https://user-images.githubusercontent.com/295906/236317164-2c5acbeb-fdac-4737-9b2d-4df9c41cb825.png) --------- Co-authored-by: drfloob <drfloob@users.noreply.github.com>	2 years ago
Craig Tiller	67f364e23e	[cleanup] Eliminate usage of GRPC_ASSERT(false...); (#31757 ) * crash function * progress * fix * fix * Automated change: Fix sanity tests * fix * fix * fix * fixes * Automated change: Fix sanity tests * fix * Automated change: Fix sanity tests * fix * fix * use cpp attr * Automated change: Fix sanity tests * fix * fix * fix * fix * fix * fix * add exclusion * fix * typo * fix * fmt * Update tcp_socket_utils.cc * Automated change: Fix sanity tests * fix * revert php changes * Automated change: Fix sanity tests Co-authored-by: ctiller <ctiller@users.noreply.github.com>	2 years ago
AJ Heller	8b4c4fc47d	ThreadPool benchmarks (#31419 ) * ThreadPool benchmarks These are nearly identical to the EventEngine benchmarks at the moment. We can consider removing the redundant tests from the EventEngine code and focusing on EventEngine-specific things (e.g., timer cancellation) * rm unused header * rm leak * fix: moved dependencies	2 years ago
Vignesh Babu	e8c30b487f	Invoking Poller::Work in posix event engine constructor (#31128 ) * adding Poller::Work to event engine constructor * iwyu * iwyu * cleanup * regenerate projects * fix * comments * add experiments flag * fix * newline * newline * iwyu * remove some ifdefs * fix tsan issue in bm_event_engine_run * Add a quiesce to threadpool * fix * Automated change: Fix sanity tests * disable posix_event_engine_test on windows Co-authored-by: Craig Tiller <ctiller@google.com> Co-authored-by: ctiller <ctiller@users.noreply.github.com>	2 years ago
Craig Tiller	afa3a6c890	[event_engine] Fix for the EE/iomgr shutdown ordering problem (#31265 ) * Remove ResetDefaultEventEngine Now that it is a weak_ptr, there's no need to explicitly reset it. When the tracked shared_ptr is deleted, the weak_ptr will fail to lock, and a new default EventEngine will be created. * forget existing engine with FactoryReset * init/shutdown in event engine for now * fix * fix * fix windows deadlock * Automated change: Fix sanity tests * fix * better windows fix Co-authored-by: AJ Heller <hork@google.com> Co-authored-by: ctiller <ctiller@users.noreply.github.com>	2 years ago
AJ Heller	2ee2c91c92	Reland x2: Make GetDefaultEventEngine return a shared_ptr (#30619 ) * Reland x2: Make GetDefaultEventEngine return a shared_ptr * remove thread leak from NativeDNSResolver This is not going to work for resolvers that support cancellation. * give resolvers bounded lifetimes Some resolver own EventEngines. EventEngines cannot run off the end of the process since they have unjoined threads (problematic in a small set of environments). This gives resolvers bounded lifetimes, and allows replacement of resolvers without ASAN issues of deleting resolvers in active use (occurs in tests). * fix * fix windows * fix surface init test * fix * sanitize * use after move * the test must wait for the callback to be destroyed * windows fix: delete the resolver on iomgr shutdown, not before * Make TimerManager threads non-joinable On gRPC shutdown, any unjoined TimerManager threads will cause TSAN to detect thread leaks. This fix resolves issues I saw in end2end test shutdown in another PR, where a single timer manager thread was always alive after the test ended. The long-term solution is to integrate the new ThreadPool here, but this unblocks me for now. * backport fix * fix * shared_ptr<EventEngine> in EventEngine benchmarks	2 years ago
AJ Heller	a874b8f6ca	EventEngine::Run microbenchmarks (#30769 ) * [WIP] EventEngine::Run microbenchmarks * Add fanout impl and fix tracking of time spent doing work in threads * tune down benchmarks; fix fanout counting logic. * tune down closure fanout tests * format * odr * reviewer feedback * unify some fanout logic; add a large-AnyInvocable test lambdas that take an allocation are about 10x slower * reviewer feedback * fix invalid vector access * rm DNS * format * copy params for each lambda callback This fixes segfaults when we cannot ensure all callbacks are complete before exiting the test. * s/promise/Notification/g bm_exec_ctx * ODR and leak * fix division by zero * fix	2 years ago