Chiebot-Mirror/protobuf - protobuf - Gitea: Git with a cup of tea

Author	SHA1	Message	Date
Joshua Haberman	57a79de7cc	Ensure that extensions respect deterministic serialization. Previously we were not sorting extensions at encode time, even in deterministic mode. PiperOrigin-RevId: 508217926	2 years ago
Joshua Haberman	6e1cbdfe09	Added fuzzer for descriptor parsing/serialization, and fixed several bugs. The initial motivation for this change was to fix a bug found by fuzzing. The old fuzz test (built on `cc_fuzz_target()`) detected an infinite loop if a bytes field default has an unterminated `\x` escape. To fix this bug while expanding fuzz coverage, I created a fuzz test that verifies that we can do a lossless round trip from descriptor -> DefPool -> descriptor. We use C++ as the source of truth for whether a descriptor is valid or not, and what the canonical serialization back to protobuf form should be. I wrote the new fuzz test using go/FuzzTest, which makes it easier and more readable to use an arbitrary `FileDescriptorSet` as input, while adding test cases for regressions. The fuzz test highlighted a handful of errors that I subsequently fixed and added regression tests for: 1. The aforementioned unterminated `\x` bug. 2. We were not propagating the `edition` field. 3. We were missing the CheckIdent() check in a few places. 4. We were rejecting files with empty name, whereas C++ allows this. 5. There were a few bugs with escaping string defaults. Since FuzzTest is Clang-only, I split the `FUZZ_TEST()` invocation from the regression tests, since the latter are portable and should be run on all platforms. Only `FUZZ_TEST()` itself is in a google3/Clang-only file. PiperOrigin-RevId: 506997362	2 years ago
Protobuf Team Bot	067dfeacfd	Implement UPB OneOf MiniTable apis. PiperOrigin-RevId: 506691706	2 years ago
Eric Salo	68e3662a9c	fix fuzzer test w/nested maps update upb_MiniTable_SetSubMessage() to return false on failure fix ClangTidy warnings in upb/message/test.cc PiperOrigin-RevId: 505191802	2 years ago
Eric Salo	b29761fece	add return codes to upb_MiniTable_SetSubMessage/Enum() Currently these functions are hardwired to always return true, but the upstream code now checks for failures (which will be implemented soon). PiperOrigin-RevId: 504943663	2 years ago
Joshua Haberman	a5e337f88c	Allow dynamic tree shaking for groups, and disallow groups for map entry sub-messages. The initial motivation for this CL was to fix a bug found by fuzzing. But the fuzz bug pointed out a few edge cases that this CL corrects: 1. The core bug is that we were allowing a map entry sub-message to be linked to a group field. This is not allowed in protobuf schemas, but we did not check for this edge case in `upb_MiniTable_SetSubMessage()`, so we were de facto allowing it. This triggered some bad behavior in the parser whereby we pushed a limit without checking its validity first. 2. To defend against this, I added asserts in `upb_MiniTable_SetSubMessage()` to verify the type of the field we are linking, to ensure that a group field is not linked to a map entry sub-message. But this should probably be changed to return an error instead of relying on asserts for this. 3. I changed the fuzz util code that builds the MiniTable so that it will never violate this new invariant. The fuzz util code now can run into situations where a group field has no valid non-map-entry sub-message to select. In those cases it will simply not register any sub-message for that field. 4. Previously group did not support leaving sub-messages unregistered. Previously I added this feature for sub-messages but not for groups. There is no reason why dynamic tree shaking should not work for group fields, so I extended the feature to support groups also. PiperOrigin-RevId: 504913630	2 years ago
Protobuf Team Bot	9e9d43b462	Add support for promoting unlinked map fields from unknown to upb_Map. PiperOrigin-RevId: 494820200	2 years ago
Eric Salo	b98c7c7b50	move non-conformance tests and protos into upb/test/ create upb/test/BUILD PiperOrigin-RevId: 492534429	2 years ago