Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> due to using floats

No they weren't using floats. The article you've linked to says this really clearly.

> This calculation was performed using a 24 bit fixed point register



http://www.cs.unc.edu/~smp/COMP205/LECTURES/ERROR/lec23/node...

They meant fixed precision not fixed point math.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: