The 32-bit integer accumulator in MSE computation can overflow for 8-bit frame data. (e.g., for 1080p white frame compared to a black frame can give sum of 255*255*1080*1920 > 2^32). Signed-off-by: Neil Birkbeck <neil.birkbeck@gmail.com> Signed-off-by: Michael Niedermayer <michaelni@gmx.at>pull/36/head
parent
15672e832f
commit
a11c16a0b0
1 changed files with 1 additions and 1 deletions
Loading…
Reference in new issue