Why does the Windows calculator generate tiny errors when calculating the square root of a perfect square? – The Old New Thing
Posted by jpluimers on 2016/12/07
In the continued “floating point code is hard for most software developers” series:
[WayBack] Why does the Windows calculator generate tiny errors when calculating the square root of a perfect square? – The Old New Thing
Because it doesn’t know that it’s a perfect square.
–jeroen
Leave a Comment