Open Source Computer Vision Library https://opencv.org/

You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Tag: Branch: Tree: 0521a3a384

2.4

3.4

4.x

5.x

master

next

2.2

2.3.0

2.3.1

2.4.0

2.4.1

2.4.10

2.4.10.1

2.4.10.2

2.4.10.3

2.4.10.4

2.4.11

2.4.12

2.4.12.1

2.4.12.2

2.4.12.3

2.4.13

2.4.13.1

2.4.13.2

2.4.13.3

2.4.13.4

2.4.13.5

2.4.13.6

2.4.13.7

2.4.2

2.4.3

2.4.3-rc

2.4.3.1

2.4.3.2

2.4.4

2.4.4-beta

2.4.5

2.4.6

2.4.6.1

2.4.6.2

2.4.6.2-rc1

2.4.6.2r2

2.4.6.2r3

2.4.7

2.4.7-rc1

2.4.7.1

2.4.7.2

2.4.8

2.4.8.1

2.4.8.2

2.4.8.3

2.4.9

2.4.9.1

3.0-ocl-tech-preview

3.0-ocl-tp2

3.0.0

3.0.0-alpha

3.0.0-beta

3.0.0-rc1

3.1.0

3.2.0

3.2.0-rc

3.3.0

3.3.0-cvsdk

3.3.0-rc

3.3.1

3.3.1-cvsdk

3.4.0

3.4.0-rc

3.4.1

3.4.1-cvsdk

3.4.10

3.4.11

3.4.12

3.4.13

3.4.14

3.4.15

3.4.16

3.4.17

3.4.18

3.4.19

3.4.2

3.4.2-openvino

3.4.20

3.4.3

3.4.3-openvino

3.4.4

3.4.5

3.4.6

3.4.7

3.4.8

3.4.9

4.0.0

4.0.0-alpha

4.0.0-beta

4.0.0-openvino

4.0.0-rc

4.0.1

4.0.1-openvino

4.1.0

4.1.0-openvino

4.1.1

4.1.1-openvino

4.1.2

4.1.2-openvino

4.10.0

4.10.0-kleidicv

4.11.0

4.2.0

4.2.0-openvino

4.3.0

4.3.0-openvino

4.3.0-openvino-2020.3.0

4.4.0

4.4.0-openvino

4.5.0

4.5.0-openvino

4.5.1

4.5.1-openvino

4.5.2

4.5.2-openvino

4.5.3

4.5.3-openvino

4.5.3-openvino-2021.4.1

4.5.3-openvino-2021.4.2

4.5.4

4.5.5

4.5.5-openvino-2022.1.0

4.6.0

4.7.0

4.8.0

4.8.1

4.9.0

5.0.0-alpha

Branches Tags

${ item.name }

Create tag ${ searchTerm }

Create branch ${ searchTerm }

from '0521a3a384'

${ noResults }

opencv/modules/dnn/include/opencv2/dnn

History

Yuantao Feng 0521a3a384 Merge pull request #24476 from fengyuentau:attention_layer ... dnn: add attention layer #24476 Resolves #24609 Merge with: https://github.com/opencv/opencv_extra/pull/1128. Attention operator spec from onnxruntime: https://github.com/microsoft/onnxruntime/blob/v1.16.1/docs/ContribOperators.md#com.microsoft.Attention. TODO: - [x] benchmark (before this PR vs. with this PR vs. ORT). - [x] Layer fusion: Take care Slice with end=INT64_MAX. - [x] Layer fusion: match more potential attention (VIT) patterns. - [x] Single-head attention is supported. - [x] Test AttentionSubgraph fusion. - [x] Add acc tests for VIT_B_32 and VitTrack - [x] Add perf tests for VIT_B_32 and VitTrack ## Benchmarks Platform: Macbook Air M1. ### Attention Subgraph Input scale: [1, 197, 768]. | | mean (ms) | median (ms) | min (ms) | | ---------------------- | --------- | ----------- | -------- | | w/ Attention (this PR) | 3.75 | 3.68 | 3.22 | | w/o Attention | 9.06 | 9.01 | 8.24 | | ORT (python) | 4.32 | 2.63 | 2.50 | ### ViTs All data in millisecond (ms). | ViTs | With Attention | Without Attention | ORT | | -------- | -------------- | ----------------- | ------ | | vit_b_16 | 302.77 | 365.35 | 109.70 | | vit_b_32 | 89.92 | 116.22 | 30.36 | | vit_l_16 | 1593.32 | 1730.74 | 419.92 | | vit_l_32 | 468.11 | 577.41 | 134.12 | | VitTrack | 3.80 | 3.87 | 2.25 | ### Pull Request Readiness Checklist See details at https://github.com/opencv/opencv/wiki/How_to_contribute#making-a-good-pull-request - [x] I agree to contribute to the project under Apache 2 License. - [x] To the best of my knowledge, the proposed patch is not based on a code under GPL or another license that is incompatible with OpenCV - [x] The PR is proposed to the proper branch - [x] There is a reference to the original bug report and related work - [x] There is accuracy test, performance test and test data in opencv_extra repository, if applicable Patch to opencv_extra has the same branch name. - [x] The feature is well documented and sample code can be built with the project CMake		1 year ago
..
utils	Merge remote-tracking branch 'upstream/3.4' into merge-3.4	3 years ago
all_layers.hpp	Merge pull request #24476 from fengyuentau:attention_layer	1 year ago
dict.hpp	dnn: fix API - explicit ctors, const methods	3 years ago
dnn.hpp	Merge pull request #24539 from LaurentBerger:blobrecttoimage	1 year ago
dnn.inl.hpp	build warnings	4 years ago
layer.details.hpp	dnn: update "guard" inline namespace	7 years ago
layer.hpp	fix model diagnostic tool	3 years ago
layer_reg.private.hpp	Merge pull request #20494 from rogday:onnx_diagnostic_fix	4 years ago
shape_utils.hpp	Merge remote-tracking branch 'upstream/3.4' into merge-3.4	3 years ago
version.hpp	pre: OpenCV 4.8.0 (version++)	2 years ago