softfloat: assert when the argument of av_sqrt_sf is negative

The correct result can't be expressed in SoftFloat.
Currently it returns a random value from an out of bounds read.

Reviewed-by: Michael Niedermayer <michael@niedermayer.cc>
Signed-off-by: Andreas Cadhalpun <Andreas.Cadhalpun@googlemail.com>
pull/160/head
Andreas Cadhalpun 9 years ago
parent 6a11c7f160
commit f3866a14c3
  1. 2
      libavutil/softfloat.h

@ -174,6 +174,8 @@ static av_always_inline SoftFloat av_sqrt_sf(SoftFloat val)
if (val.mant == 0)
val.exp = MIN_EXP;
else if (val.mant < 0)
av_assert0(0);
else
{
tabIndex = (val.mant - 0x20000000) >> 20;

Loading…
Cancel
Save