summaryrefslogtreecommitdiffstats
path: root/lib/msun
diff options
context:
space:
mode:
authorbde <bde@FreeBSD.org>2004-06-01 19:03:31 +0000
committerbde <bde@FreeBSD.org>2004-06-01 19:03:31 +0000
commit719aa077cb43ef51a1a90748f36a8f0e11e155c6 (patch)
treed047d2f81364d19ccc22c5e5d8ab9a59b0362f34 /lib/msun
parent30540e618cd9b228b1e60dce4b6ef48781e59b2b (diff)
downloadFreeBSD-src-719aa077cb43ef51a1a90748f36a8f0e11e155c6.zip
FreeBSD-src-719aa077cb43ef51a1a90748f36a8f0e11e155c6.tar.gz
Fixed another precision bug in powf(). This one is in the computation
[t=p_l+p_h High]. We multiply t by lg2_h, and want the result to be exact. For the bogus float case of the high-low decomposition trick, we normally discard the lowest 12 bits of the fraction for the high part, keeping 12 bits of precision. That was used for t here, but it doesnt't work because for some reason we only discard the lowest 9 bits in the fraction for lg2_h. Discard another 3 bits of the fraction for t to compensate. This bug gave wrong results like: powf(0.9999999, -2.9999995) = 1.0000002 (should be 1.0000001) hex values: 3F7FFFFF C03FFFFE 3F800002 3F800001 As explained in the log for the previous commit, the bug is normally masked by doing float calculations in extra precision on i386's, but is easily detected by ucbtest on systems that don't have accidental extra precision. This completes fixing all the bugs in powf() that were routinely found by ucbtest.
Diffstat (limited to 'lib/msun')
-rw-r--r--lib/msun/src/e_powf.c2
1 files changed, 1 insertions, 1 deletions
diff --git a/lib/msun/src/e_powf.c b/lib/msun/src/e_powf.c
index a9dc533..75fd801 100644
--- a/lib/msun/src/e_powf.c
+++ b/lib/msun/src/e_powf.c
@@ -229,7 +229,7 @@ __ieee754_powf(float x, float y)
}
t = p_l+p_h;
GET_FLOAT_WORD(is,t);
- SET_FLOAT_WORD(t,is&0xfffff000);
+ SET_FLOAT_WORD(t,is&0xffff8000);
u = t*lg2_h;
v = (p_l-(t-p_h))*lg2+t*lg2_l;
z = u+v;
OpenPOWER on IntegriCloud