You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Add tests to demonstrate the difference between mean and welfordMean. We can use alternate small and large numbers with a high dynamic range for testing the loss of precision. A Double has 52 significand bits and 10 exponent bits. We can design a test based on that knowledge. See https://en.wikipedia.org/wiki/Floating-point_arithmetic .
It would be nice to have sum operations that works on a wider range possibly by sacrificing some computational complexity e.g. multiple buckets for different precision levels.
The text was updated successfully, but these errors were encountered:
Add tests to demonstrate the difference between
mean
andwelfordMean
. We can use alternate small and large numbers with a high dynamic range for testing the loss of precision. ADouble
has 52 significand bits and 10 exponent bits. We can design a test based on that knowledge. See https://en.wikipedia.org/wiki/Floating-point_arithmetic .It would be nice to have
sum
operations that works on a wider range possibly by sacrificing some computational complexity e.g. multiple buckets for different precision levels.The text was updated successfully, but these errors were encountered: