Repository for OpenCV's extra modules
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

529 lines
25 KiB

GSOC 2015: dnn module Author: Vitaliy Lyudvichenko Mentor: Anatoly Baksheev Squashed commits are: commit 2f6d743 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Sun May 31 00:05:31 2015 +0300 Added dnn module with draft interface. commit cfb9cfa Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Jun 3 17:54:13 2015 +0300 Added libprotobuf to CMake. Added some Caffe files. commit a6963b4 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Jun 3 22:28:12 2015 +0300 Updated CMakeLists.txt to support protobuf Messages auto generation. commit 6e23d93 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Sat Jun 6 19:08:12 2015 +0300 Added simple .prototxt Caffe importer. commit 77321e3 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Mon Jun 8 16:59:27 2015 +0300 Added binary .caffemodel import support. Some changes in API. Caffe source files was cleared from unnecessary code. commit 24a9eff Merge: 77321e3 844c30e Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Mon Jun 8 17:01:54 2015 +0300 Merge branch 'master' of https://github.com/Itseez/opencv_contrib commit 62feeec Author: Anatoly Baksheev <no@email> Date: Mon Jun 8 19:41:11 2015 +0300 fixed compilation witn C++11 compiler commit 42b36fb Author: Anatoly Baksheev <no@email> Date: Mon Jun 8 19:48:32 2015 +0300 more compilation commit 10c3a13 Author: Anatoly Baksheev <no@email> Date: Mon Jun 8 20:00:37 2015 +0300 umbrealla header commit eb95846 Author: Anatoly Baksheev <no@email> Date: Mon Jun 8 20:26:47 2015 +0300 some warnings disabled commit 1fd9304 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Tue Jun 9 13:58:35 2015 +0300 Dnn API changes (removed NetConfiguration, added LayerRegister, improved Blob). commit cae0bd4 Merge: 1fd9304 eb95846 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Tue Jun 9 14:25:35 2015 +0300 Merge branch 'master' of github.com:ludv1x/opencv_contrib Conflicts: modules/dnn/include/opencv2/dnn.hpp commit ee837c1 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Tue Jun 9 21:36:18 2015 +0300 Updated CMakeLists.txt commit 194271d Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Sun Jun 14 22:20:01 2015 +0300 Implemented allocation of DAG and it's forward pass. Added wrappers for basic layers. commit ed1c569 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Tue Jun 16 19:31:15 2015 +0300 [Bomb commit] Implemented 4 main layers. Changes in API. Added worked classification example from GTSRB into tests. commit 51df95d Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Tue Jun 16 19:31:38 2015 +0300 Added GSTRB test data. commit 2638433 Merge: 51df95d 2a199bc Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Tue Jun 16 22:55:35 2015 +0300 Merge branch 'master' of https://github.com/Itseez/opencv_contrib commit eba62d5 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Jun 18 16:58:57 2015 +0300 Layers implementations divided onto separated files. commit 383715d Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Jun 18 23:55:16 2015 +0300 libprotobuf is optional dependency now commit 2c501f3 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Fri Jun 19 00:01:53 2015 +0300 Replace CMake WARNING onto STATUS commit 29966ee Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Fri Jun 19 16:50:25 2015 +0300 added HAVE_PROTOBUF macro commit 48ab440 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Sat Jun 20 01:59:56 2015 +0300 Changed default parameter commit 09ffc43 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Sat Jun 20 11:58:56 2015 +0300 Fixed CMake and CPP build errors commit eef4d1d Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Mon Jun 22 23:49:54 2015 +0300 Added LRN and SoftMax layers, some fixes commit 22272e8 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Tue Jun 23 14:27:30 2015 +0300 Many fixes. commit 9cddccf Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Tue Jun 23 14:29:42 2015 +0300 Added AlexNet sample. Removed big .caffemodel files from repo. commit 66fa1e1 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Tue Jun 23 17:33:48 2015 +0300 Random changes in matlab/* module was reverted commit d80c272 Author: Anatoly Baksheev <no@email> Date: Wed Jun 24 11:48:44 2015 +0300 fixed stand alone link errors commit 0cd5459 Author: Anatoly Baksheev <no@email> Date: Wed Jun 24 12:25:19 2015 +0300 added incdes to project so that it could be visible in some IDEs (ex. qtcreator) commit 13edaaa Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Jun 24 18:25:34 2015 +0300 Added group param to convolution_layer.cpp commit 49b5e5e Merge: 13edaaa 0cd5459 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Jun 24 18:25:50 2015 +0300 Merge branch 'master' of github.com:ludv1x/opencv_contrib commit 99b8dac Merge: 49b5e5e 8a05bdb Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Jun 24 18:26:10 2015 +0300 Merge branch 'master' of https://github.com/Itseez/opencv_contrib commit 0f7907d Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Jun 24 19:28:55 2015 +0300 updated example commit 2717765 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Jun 24 20:02:31 2015 +0300 Fixed some warnings commit d117983 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Jun 24 22:18:05 2015 +0300 Deleted trailing whitespaces commit cfdf060 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Jun 25 12:16:11 2015 +0300 Fixed more warnings. Updated glog_emulator.hpp: commit 761b037 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Fri Jun 26 17:57:55 2015 +0300 Fixed critical bug in dnn::Dict. Fixed LRN layer implementation. Added layers test. commit 6fd67d4 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Jul 1 12:12:49 2015 +0300 Updated test. Added and successfuly passed AlexNet reproducibility test. Small fixes. commit 9838234 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Jul 2 12:25:30 2015 +0300 Some layer fixes. Added concat layer and avg. pooling to sucesfully run GoogLeNet. Added concat layer, implemented average pooling to run GoogLeNet. Fixed transpose error in FullyConnected layer (hotfix in softmax layer). Added GoogleNet test and updated AlexNet test (both nets now work fine). commit 6f8a73b Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Jul 2 12:31:48 2015 +0300 Replaced CMake if() condition for standalone build. commit 0ebe30a Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Sat Jul 4 22:41:55 2015 +0300 Blob class was significantly refactored commit d02bced Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Sun Jul 5 22:52:34 2015 +0300 More refactoring over Blob. More refactoring over Blob. Fix warnings and eliminated zlib dependency in cnpy.h commit 85ad43d Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Mon Jul 6 14:51:10 2015 +0300 Generalized Blob constructor and added vector of images support. AlexNet and GoogLeNet tests updated. commit 75e09fd Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Jul 8 19:05:36 2015 +0300 Implement ambiguous blobs naming scheme like: "layerName[.OutputName]". Old Caffe-like blob naming scheme was deleted. commit b9e85ed Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Jul 8 19:15:51 2015 +0300 fixed sign type mismatch warnings in cnpy commit 9783bba Merge: b9e85ed 6f8a73b Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Jul 9 18:26:08 2015 +0300 Merge branch 'master' into work commit de4d800 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Sun Jul 12 23:19:07 2015 +0300 Added .caffemodel files downloader for tests on post-build step. commit ec74678 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Jul 16 20:24:12 2015 +0300 Added element-wise layers. Fixed downloader and ConcatLayer. commit 0362da9 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Fri Jul 17 17:24:59 2015 +0300 Added array support for Dict. commit 3aa37d2 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Sat Jul 18 01:12:08 2015 +0300 Array of parmaters support into caffe_importer.cpp commit 172419e Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Sun Jul 19 21:31:22 2015 +0300 Added Reshape layer and altered importer to correctly handle its params. commit 71cfae4 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Mon Jul 20 23:29:42 2015 +0300 Added Split and Slice layer. commit 527fa65 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Tue Jul 21 16:10:29 2015 +0300 Rewrited concat_layer.cpp in OpenCV-style. Fixed slice layer, added test for slice, split and reshape layers. commit 9b1e28e Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Jul 23 00:09:15 2015 +0300 Refactored ConvolutionLayer, added Deconvolution. commit ff45c22 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Jul 23 21:19:25 2015 +0300 Fixed gcc build errors. commit 6548839 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Sat Jul 25 12:24:54 2015 +0300 Added testdata images. Fixed Dict copy constructor. commit db4ff21 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Sat Jul 25 22:26:29 2015 +0300 Updated classification example commit 4da1046 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Tue Jul 28 16:00:07 2015 +0300 Implemented draft Torch importer commit 7d795af Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Jul 30 15:43:47 2015 +0300 Fixed Torch parser commit 5e5cc96 Merge: 6f8a73b f9d4288 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Mon Aug 3 20:18:01 2015 +0300 Merge branch 'master' of https://github.com/Itseez/opencv_contrib commit dd15521 Merge: 5e5cc96 db4ff21 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Mon Aug 3 20:18:28 2015 +0300 Merge branch 'master' of github.com:ludv1x/opencv_contrib commit c1f4410 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Mon Aug 3 20:20:00 2015 +0300 cnpy warns fix commit 2905c03 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Tue Aug 4 19:16:34 2015 +0300 Multiple layers support added into Torch importer. Also DictValue was refactored. commit 8df8936 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Aug 5 13:14:52 2015 +0300 Added Torch blob reader and torch convolution test. commit 1c220cf Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Aug 6 13:29:45 2015 +0300 Added simple tests for Torch importer, fixed some importing issues. commit 436d929 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Aug 6 14:37:56 2015 +0300 Resolve reference counting problem in Torch importer. commit b2f4ba3 Merge: c1f4410 172fdb3 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Fri Aug 7 13:27:45 2015 +0300 Merge branch 'master' of https://github.com/Itseez/opencv_contrib commit 5b08053 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Mon Aug 10 12:53:44 2015 +0300 Added ability to remove singleton dimensions in Reshape layer. Updated torch importer commit d0875b1 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Tue Aug 11 01:49:27 2015 +0300 Fixed average pooling error commit f8119ea Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Tue Aug 11 22:12:48 2015 +0300 Fixed Deconvolution layer. Added more wide layers test coverage. commit df5eec6 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Aug 12 16:54:44 2015 +0300 Added MVN layer. Renamed layer test data. commit f28effb Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Aug 12 19:49:54 2015 +0300 Cleaned caffe dependencies commit b3dcc39 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Aug 12 20:04:23 2015 +0300 Moved caffe.proto commit 7d2e745 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Aug 13 00:53:50 2015 +0300 Minor test changes commit c65d032 Merge: 7d2e745 b2f4ba3 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Aug 13 01:25:00 2015 +0300 Merge branch 'master' of https://github.com/ludv1x/opencv_contrib commit 160d864 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Aug 13 11:45:40 2015 +0300 Fixed small warn and example error commit 06f949a Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Aug 13 17:52:46 2015 +0300 Added initModule() procedure to explicitly init builtin layers commit 23d3ede Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Mon Aug 17 15:10:04 2015 +0300 Added OpenCL im2col commit 7acfda2 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Tue Aug 18 01:40:41 2015 +0300 Fixed im2col_ocl bug caused non-zero UMat offset commit 9d932af Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Tue Aug 18 01:55:05 2015 +0300 Add new method to Net commit 0903d79 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Aug 19 01:28:44 2015 +0300 Added libprotobuf 2.5 as thridparty library commit 4929177 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Aug 19 01:32:51 2015 +0300 Add compiled caffe protobuf files commit fc9795b Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Aug 19 18:57:12 2015 +0300 libprotobuf is a separate 3rdparty lib now commit 93a372f Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Aug 19 19:53:52 2015 +0300 Try fix msvc error and cmake error on android commit 44e52a0 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Aug 20 01:34:05 2015 +0300 Try fix msvc warnings commit 519167e Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Aug 20 18:51:44 2015 +0300 Refactored cmake and disabled AlexNet test commit e644b5a Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Aug 20 21:52:41 2015 +0300 Changed Blob::ptr and Blob::offset methods commit f07c564 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Aug 20 22:53:02 2015 +0300 Add test data for layers commit fb66acb Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Fri Aug 21 01:59:17 2015 +0300 API refactoring renamed learnedParams blobs field added new fields: name and type for Layer commit f8715f3 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Sat Aug 22 18:31:53 2015 +0300 Added licence headers commit 945094b Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Sun Aug 23 03:06:24 2015 +0300 Update doc, small changes in Blob methods commit c681508 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Mon Aug 24 01:45:32 2015 +0300 Add more docs commit bd242d1 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Mon Aug 24 20:44:34 2015 +0300 Add docs for remaning functions commit eced23c Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Mon Aug 24 20:44:56 2015 +0300 Updated dnn example commit 57a2194 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Tue Aug 25 15:18:21 2015 +0300 Add tutorial_dnn_build commit efde664 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Tue Aug 25 17:09:00 2015 +0300 Move binary testdata from opencv_contrib to opencv_extra commit e52a7ee Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Tue Aug 25 19:01:05 2015 +0300 Add bvlc_googlenet.prototxt to samples commit 3154fc0 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Aug 26 01:43:53 2015 +0300 Add googlenet tutorial commit 467cd96 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Aug 26 13:32:27 2015 +0300 Updated dnn build tutorial commit 83e39a9 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Wed Aug 26 19:56:36 2015 +0300 Fix typos commit 0a64a9d Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Aug 27 02:30:20 2015 +0300 Changed Caffe googlenet tutorial commit d2b6011 Author: Vitaliy Lyudvichenko <ludv1x@yandex.ru> Date: Thu Aug 27 14:01:40 2015 +0300 Fix documentation warning commit 248577a Author: Anatoly Baksheev <no@email> Date: Thu Sep 3 18:33:26 2015 +0300 fixed signed/unsigned cast warning
10 years ago
2013-02-27 version 2.5.0:
General
* New notion "import public" that allows a proto file to forward the content
it imports to its importers. For example,
// foo.proto
import public "bar.proto";
import "baz.proto";
// qux.proto
import "foo.proto";
// Stuff defined in bar.proto may be used in this file, but stuff from
// baz.proto may NOT be used without importing it explicitly.
This is useful for moving proto files. To move a proto file, just leave
a single "import public" in the old proto file.
* New enum option "allow_alias" that specifies whether different symbols can
be assigned the same numeric value. Default value is "true". Setting it to
false causes the compiler to reject enum definitions where multiple symbols
have the same numeric value.
C++
* New generated method set_allocated_foo(Type* foo) for message and string
fields. This method allows you to set the field to a pre-allocated object
and the containing message takes the ownership of that object.
* Added SetAllocatedExtension() and ReleaseExtension() to extensions API.
* Custom options are now formatted correctly when descriptors are printed in
text format.
* Various speed optimizations.
Java
* Comments in proto files are now collected and put into generated code as
comments for corresponding classes and data members.
* Added Parser to parse directly into messages without a Builder. For
example,
Foo foo = Foo.PARSER.ParseFrom(input);
Using Parser is ~25% faster than using Builder to parse messages.
* Added getters/setters to access the underlying ByteString of a string field
directly.
* ByteString now supports more operations: substring(), prepend(), and
append(). The implementation of ByteString uses a binary tree structure
to support these operations efficiently.
* New method findInitializationErrors() that lists all missing required
fields.
* Various code size and speed optimizations.
Python
* Added support for dynamic message creation. DescriptorDatabase,
DescriptorPool, and MessageFactory work like their C++ couterparts to
simplify Descriptor construction from *DescriptorProtos, and MessageFactory
provides a message instance from a Descriptor.
* Added pickle support for protobuf messages.
* Unknown fields are now preserved after parsing.
* Fixed bug where custom options were not correctly populated. Custom
options can be accessed now.
* Added EnumTypeWrapper that provides better accessibility to enum types.
* Added ParseMessage(descriptor, bytes) to generate a new Message instance
from a descriptor and a byte string.
2011-05-01 version 2.4.1:
C++
* Fixed the frendship problem for old compilers to make the library now gcc 3
compatible again.
* Fixed vcprojects/extract_includes.bat to extract compiler/plugin.h.
Java
* Removed usages of JDK 1.6 only features to make the library now JDK 1.5
compatible again.
* Fixed a bug about negative enum values.
* serialVersionUID is now defined in generated messages for java serializing.
* Fixed protoc to use java.lang.Object, which makes "Object" now a valid
message name again.
Python
* Experimental C++ implementation now requires C++ protobuf library installed.
See the README.txt in the python directory for details.
2011-02-02 version 2.4.0:
General
* The RPC (cc|java|py)_generic_services default value is now false instead of
true.
* Custom options can have aggregate types. For example,
message MyOption {
optional string comment = 1;
optional string author = 2;
}
extend google.protobuf.FieldOptions {
optional MyOption myoption = 12345;
}
This option can now be set as follows:
message SomeType {
optional int32 field = 1 [(myoption) = { comment:'x' author:'y' }];
}
C++
* Various speed and code size optimizations.
* Added a release_foo() method on string and message fields.
* Fixed gzip_output_stream sub-stream handling.
Java
* Builders now maintain sub-builders for sub-messages. Use getFooBuilder() to
get the builder for the sub-message "foo". This allows you to repeatedly
modify deeply-nested sub-messages without rebuilding them.
* Builder.build() no longer invalidates the Builder for generated messages
(You may continue to modify it and then build another message).
* Code generator will generate efficient equals() and hashCode()
implementations if new option java_generate_equals_and_hash is enabled.
(Otherwise, reflection-based implementations are used.)
* Generated messages now implement Serializable.
* Fields with [deprecated=true] will be marked with @Deprecated in Java.
* Added lazy conversion of UTF-8 encoded strings to String objects to improve
performance.
* Various optimizations.
* Enum value can be accessed directly, instead of calling getNumber() on the
enum member.
* For each enum value, an integer constant is also generated with the suffix
_VALUE.
Python
* Added an experimental C++ implementation for Python messages via a Python
extension. Implementation type is controlled by an environment variable
PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION (valid values: "cpp" and "python")
The default value is currently "python" but will be changed to "cpp" in
future release.
* Improved performance on message instantiation significantly.
Most of the work on message instantiation is done just once per message
class, instead of once per message instance.
* Improved performance on text message parsing.
* Allow add() to forward keyword arguments to the concrete class.
E.g. instead of
item = repeated_field.add()
item.foo = bar
item.baz = quux
You can do:
repeated_field.add(foo=bar, baz=quux)
* Added a sort() interface to the BaseContainer.
* Added an extend() method to repeated composite fields.
* Added UTF8 debug string support.
2010-01-08 version 2.3.0:
General
* Parsers for repeated numeric fields now always accept both packed and
unpacked input. The [packed=true] option only affects serializers.
Therefore, it is possible to switch a field to packed format without
breaking backwards-compatibility -- as long as all parties are using
protobuf 2.3.0 or above, at least.
* The generic RPC service code generated by the C++, Java, and Python
generators can be disabled via file options:
option cc_generic_services = false;
option java_generic_services = false;
option py_generic_services = false;
This allows plugins to generate alternative code, possibly specific to some
particular RPC implementation.
protoc
* Now supports a plugin system for code generators. Plugins can generate
code for new languages or inject additional code into the output of other
code generators. Plugins are just binaries which accept a protocol buffer
on stdin and write a protocol buffer to stdout, so they may be written in
any language. See src/google/protobuf/compiler/plugin.proto.
**WARNING**: Plugins are experimental. The interface may change in a
future version.
* If the output location ends in .zip or .jar, protoc will write its output
to a zip/jar archive instead of a directory. For example:
protoc --java_out=myproto_srcs.jar --python_out=myproto.zip myproto.proto
Currently the archive contents are not compressed, though this could change
in the future.
* inf, -inf, and nan can now be used as default values for float and double
fields.
C++
* Various speed and code size optimizations.
* DynamicMessageFactory is now fully thread-safe.
* Message::Utf8DebugString() method is like DebugString() but avoids escaping
UTF-8 bytes.
* Compiled-in message types can now contain dynamic extensions, through use
of CodedInputStream::SetExtensionRegistry().
* Now compiles shared libraries (DLLs) by default on Cygwin and MinGW, to
match other platforms. Use --disable-shared to avoid this.
Java
* parseDelimitedFrom() and mergeDelimitedFrom() now detect EOF and return
false/null instead of throwing an exception.
* Fixed some initialization ordering bugs.
* Fixes for OpenJDK 7.
Python
* 10-25 times faster than 2.2.0, still pure-Python.
* Calling a mutating method on a sub-message always instantiates the message
in its parent even if the mutating method doesn't actually mutate anything
(e.g. parsing from an empty string).
* Expanded descriptors a bit.
2009-08-11 version 2.2.0:
C++
* Lite mode: The "optimize_for = LITE_RUNTIME" option causes the compiler
to generate code which only depends libprotobuf-lite, which is much smaller
than libprotobuf but lacks descriptors, reflection, and some other features.
* Fixed bug where Message.Swap(Message) was only implemented for
optimize_for_speed. Swap now properly implemented in both modes
(Issue 91).
* Added RemoveLast and SwapElements(index1, index2) to Reflection
interface for repeated elements.
* Added Swap(Message) to Reflection interface.
* Floating-point literals in generated code that are intended to be
single-precision now explicitly have 'f' suffix to avoid pedantic warnings
produced by some compilers.
* The [deprecated=true] option now causes the C++ code generator to generate
a GCC-style deprecation annotation (no-op on other compilers).
* google::protobuf::GetEnumDescriptor<SomeGeneratedEnumType>() returns the
EnumDescriptor for that type -- useful for templates which cannot call
SomeGeneratedEnumType_descriptor().
* Various optimizations and obscure bug fixes.
Java
* Lite mode: The "optimize_for = LITE_RUNTIME" option causes the compiler
to generate code which only depends libprotobuf-lite, which is much smaller
than libprotobuf but lacks descriptors, reflection, and some other features.
* Lots of style cleanups.
Python
* Fixed endianness bug with floats and doubles.
* Text format parsing support.
* Fix bug with parsing packed repeated fields in embedded messages.
* Ability to initialize fields by passing keyword args to constructor.
* Support iterators in extend and __setslice__ for containers.
2009-05-13 version 2.1.0:
General
* Repeated fields of primitive types (types other that string, group, and
nested messages) may now use the option [packed = true] to get a more
efficient encoding. In the new encoding, the entire list is written
as a single byte blob using the "length-delimited" wire type. Within
this blob, the individual values are encoded the same way they would
be normally except without a tag before each value (thus, they are
tightly "packed").
* For each field, the generated code contains an integer constant assigned
to the field number. For example, the .proto file:
message Foo { optional int bar_baz = 123; }
would generate the following constants, all with the integer value 123:
C++: Foo::kBarBazFieldNumber
Java: Foo.BAR_BAZ_FIELD_NUMBER
Python: Foo.BAR_BAZ_FIELD_NUMBER
Constants are also generated for extensions, with the same naming scheme.
These constants may be used as switch cases.
* Updated bundled Google Test to version 1.3.0. Google Test is now bundled
in its verbatim form as a nested autoconf package, so you can drop in any
other version of Google Test if needed.
* optimize_for = SPEED is now the default, by popular demand. Use
optimize_for = CODE_SIZE if code size is more important in your app.
* It is now an error to define a default value for a repeated field.
Previously, this was silently ignored (it had no effect on the generated
code).
* Fields can now be marked deprecated like:
optional int32 foo = 1 [deprecated = true];
Currently this does not have any actual effect, but in the future the code
generators may generate deprecation annotations in each language.
* Cross-compiling should now be possible using the --with-protoc option to
configure. See README.txt for more info.
protoc
* --error_format=msvs option causes errors to be printed in Visual Studio
format, which should allow them to be clicked on in the build log to go
directly to the error location.
* The type name resolver will no longer resolve type names to fields. For
example, this now works:
message Foo {}
message Bar {
optional int32 Foo = 1;
optional Foo baz = 2;
}
Previously, the type of "baz" would resolve to "Bar.Foo", and you'd get
an error because Bar.Foo is a field, not a type. Now the type of "baz"
resolves to the message type Foo. This change is unlikely to make a
difference to anyone who follows the Protocol Buffers style guide.
C++
* Several optimizations, including but not limited to:
- Serialization, especially to flat arrays, is 10%-50% faster, possibly
more for small objects.
- Several descriptor operations which previously required locking no longer
do.
- Descriptors are now constructed lazily on first use, rather than at
process startup time. This should save memory in programs which do not
use descriptors or reflection.
- UnknownFieldSet completely redesigned to be more efficient (especially in
terms of memory usage).
- Various optimizations to reduce code size (though the serialization speed
optimizations increased code size).
* Message interface has method ParseFromBoundedZeroCopyStream() which parses
a limited number of bytes from an input stream rather than parsing until
EOF.
* GzipInputStream and GzipOutputStream support reading/writing gzip- or
zlib-compressed streams if zlib is available.
(google/protobuf/io/gzip_stream.h)
* DescriptorPool::FindAllExtensions() and corresponding
DescriptorDatabase::FindAllExtensions() can be used to enumerate all
extensions of a given type.
* For each enum type Foo, protoc will generate functions:
const string& Foo_Name(Foo value);
bool Foo_Parse(const string& name, Foo* result);
The former returns the name of the enum constant corresponding to the given
value while the latter finds the value corresponding to a name.
* RepeatedField and RepeatedPtrField now have back-insertion iterators.
* String fields now have setters that take a char* and a size, in addition
to the existing ones that took char* or const string&.
* DescriptorPool::AllowUnknownDependencies() may be used to tell
DescriptorPool to create placeholder descriptors for unknown entities
referenced in a FileDescriptorProto. This can allow you to parse a .proto
file without having access to other .proto files that it imports, for
example.
* Updated gtest to latest version. The gtest package is now included as a
nested autoconf package, so it should be able to drop new versions into the
"gtest" subdirectory without modification.
Java
* Fixed bug where Message.mergeFrom(Message) failed to merge extensions.
* Message interface has new method toBuilder() which is equivalent to
newBuilderForType().mergeFrom(this).
* All enums now implement the ProtocolMessageEnum interface.
* Setting a field to null now throws NullPointerException.
* Fixed tendency for TextFormat's parsing to overflow the stack when
parsing large string values. The underlying problem is with Java's
regex implementation (which unfortunately uses recursive backtracking
rather than building an NFA). Worked around by making use of possesive
quantifiers.
* Generated service classes now also generate pure interfaces. For a service
Foo, Foo.Interface is a pure interface containing all of the service's
defined methods. Foo.newReflectiveService() can be called to wrap an
instance of this interface in a class that implements the generic
RpcService interface, which provides reflection support that is usually
needed by RPC server implementations.
* RPC interfaces now support blocking operation in addition to non-blocking.
The protocol compiler generates separate blocking and non-blocking stubs
which operate against separate blocking and non-blocking RPC interfaces.
RPC implementations will have to implement the new interfaces in order to
support blocking mode.
* New I/O methods parseDelimitedFrom(), mergeDelimitedFrom(), and
writeDelimitedTo() read and write "delemited" messages from/to a stream,
meaning that the message size precedes the data. This way, you can write
multiple messages to a stream without having to worry about delimiting
them yourself.
* Throw a more descriptive exception when build() is double-called.
* Add a method to query whether CodedInputStream is at the end of the input
stream.
* Add a method to reset a CodedInputStream's size counter; useful when
reading many messages with the same stream.
* equals() and hashCode() now account for unknown fields.
Python
* Added slicing support for repeated scalar fields. Added slice retrieval and
removal of repeated composite fields.
* Updated RPC interfaces to allow for blocking operation. A client may
now pass None for a callback when making an RPC, in which case the
call will block until the response is received, and the response
object will be returned directly to the caller. This interface change
cannot be used in practice until RPC implementations are updated to
implement it.
* Changes to input_stream.py should make protobuf compatible with appengine.
2008-11-25 version 2.0.3:
protoc
* Enum values may now have custom options, using syntax similar to field
options.
* Fixed bug where .proto files which use custom options but don't actually
define them (i.e. they import another .proto file defining the options)
had to explicitly import descriptor.proto.
* Adjacent string literals in .proto files will now be concatenated, like in
C.
* If an input file is a Windows absolute path (e.g. "C:\foo\bar.proto") and
the import path only contains "." (or contains "." but does not contain
the file), protoc incorrectly thought that the file was under ".", because
it thought that the path was relative (since it didn't start with a slash).
This has been fixed.
C++
* Generated message classes now have a Swap() method which efficiently swaps
the contents of two objects.
* All message classes now have a SpaceUsed() method which returns an estimate
of the number of bytes of allocated memory currently owned by the object.
This is particularly useful when you are reusing a single message object
to improve performance but want to make sure it doesn't bloat up too large.
* New method Message::SerializeAsString() returns a string containing the
serialized data. May be more convenient than calling
SerializeToString(string*).
* In debug mode, log error messages when string-type fields are found to
contain bytes that are not valid UTF-8.
* Fixed bug where a message with multiple extension ranges couldn't parse
extensions.
* Fixed bug where MergeFrom(const Message&) didn't do anything if invoked on
a message that contained no fields (but possibly contained extensions).
* Fixed ShortDebugString() to not be O(n^2). Durr.
* Fixed crash in TextFormat parsing if the first token in the input caused a
tokenization error.
* Fixed obscure bugs in zero_copy_stream_impl.cc.
* Added support for HP C++ on Tru64.
* Only build tests on "make check", not "make".
* Fixed alignment issue that caused crashes when using DynamicMessage on
64-bit Sparc machines.
* Simplify template usage to work with MSVC 2003.
* Work around GCC 4.3.x x86_64 compiler bug that caused crashes on startup.
(This affected Fedora 9 in particular.)
* Now works on "Solaris 10 using recent Sun Studio".
Java
* New overload of mergeFrom() which parses a slice of a byte array instead
of the whole thing.
* New method ByteString.asReadOnlyByteBuffer() does what it sounds like.
* Improved performance of isInitialized() when optimizing for code size.
Python
* Corrected ListFields() signature in Message base class to match what
subclasses actually implement.
* Some minor refactoring.
* Don't pass self as first argument to superclass constructor (no longer
allowed in Python 2.6).
2008-09-29 version 2.0.2:
General
* License changed from Apache 2.0 to New BSD.
* It is now possible to define custom "options", which are basically
annotations which may be placed on definitions in a .proto file.
For example, you might define a field option called "foo" like so:
import "google/protobuf/descriptor.proto"
extend google.protobuf.FieldOptions {
optional string foo = 12345;
}
Then you annotate a field using the "foo" option:
message MyMessage {
optional int32 some_field = 1 [(foo) = "bar"]
}
The value of this option is then visible via the message's
Descriptor:
const FieldDescriptor* field =
MyMessage::descriptor()->FindFieldByName("some_field");
assert(field->options().GetExtension(foo) == "bar");
This feature has been implemented and tested in C++ and Java.
Other languages may or may not need to do extra work to support
custom options, depending on how they construct descriptors.
C++
* Fixed some GCC warnings that only occur when using -pedantic.
* Improved static initialization code, making ordering more
predictable among other things.
* TextFormat will no longer accept messages which contain multiple
instances of a singular field. Previously, the latter instance
would overwrite the former.
* Now works on systems that don't have hash_map.
Java
* Print @Override annotation in generated code where appropriate.
Python
* Strings now use the "unicode" type rather than the "str" type.
String fields may still be assigned ASCII "str" values; they will
automatically be converted.
* Adding a property to an object representing a repeated field now
raises an exception. For example:
# No longer works (and never should have).
message.some_repeated_field.foo = 1
Windows
* We now build static libraries rather than DLLs by default on MSVC.
See vsprojects/readme.txt for more information.
2008-08-15 version 2.0.1:
protoc
* New flags --encode and --decode can be used to convert between protobuf text
format and binary format from the command-line.
* New flag --descriptor_set_out can be used to write FileDescriptorProtos for
all parsed files directly into a single output file. This is particularly
useful if you wish to parse .proto files from programs written in languages
other than C++: just run protoc as a background process and have it output
a FileDescriptorList, then parse that natively.
* Improved error message when an enum value's name conflicts with another
symbol defined in the enum type's scope, e.g. if two enum types declared
in the same scope have values with the same name. This is disallowed for
compatibility with C++, but this wasn't clear from the error.
* Fixed absolute output paths on Windows.
* Allow trailing slashes in --proto_path mappings.
C++
* Reflection objects are now per-class rather than per-instance. To make this
possible, the Reflection interface had to be changed such that all methods
take the Message instance as a parameter. This change improves performance
significantly in memory-bandwidth-limited use cases, since it makes the
message objects smaller. Note that source-incompatible interface changes
like this will not be made again after the library leaves beta.
* Heuristically detect sub-messages when printing unknown fields.
* Fix static initialization ordering bug that caused crashes at startup when
compiling on Mac with static linking.
* Fixed TokenizerTest when compiling with -DNDEBUG on Linux.
* Fixed incorrect definition of kint32min.
* Fix bytes type setter to work with byte sequences with embedded NULLs.
* Other irrelevant tweaks.
Java
* Fixed UnknownFieldSet's parsing of varints larger than 32 bits.
* Fixed TextFormat's parsing of "inf" and "nan".
* Fixed TextFormat's parsing of comments.
* Added info to Java POM that will be required when we upload the
package to a Maven repo.
Python
* MergeFrom(message) and CopyFrom(message) are now implemented.
* SerializeToString() raises an exception if the message is missing required
fields.
* Code organization improvements.
* Fixed doc comments for RpcController and RpcChannel, which had somehow been
swapped.
* Fixed text_format_test on Windows where floating-point exponents sometimes
contain extra zeros.
* Fix Python service CallMethod() implementation.
Other
* Improved readmes.
* VIM syntax highlighting improvements.
2008-07-07 version 2.0.0:
* First public release.