Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Fixes AcademySoftwareFoundation#252, incorrect math computing half di…
…gits Based on float / double math for base 10 digits, with 1 bit of rounding error, the equation should be floor( mantissa_digits - 1 ) * log10(2) ), which in the case of half becomes floor( 10 * log10(2) ) or 3 Signed-off-by: Kimball Thurston <kdt3rd@gmail.com>
- Loading branch information