Conversation

Notices

1. JordiGH (jordigh@mathstodon.xyz)'s status on Monday, 28-May-2018 11:04:56 EDT JordiGH

   Whoa, I'm used to numerical error, a fact of life. But I wasn't aware that Excel used a different kind of float than IEEE 754 floats. How is that code even written internally?

   https://en.wikipedia.org/wiki/Numeric_precision_in_Microsoft_Excel

   1. clacke (clacke@social.heldscal.la)'s status on Monday, 28-May-2018 11:14:09 EDT clacke

      in reply to
      @jordigh Painstakingly. :-)
      
      I wasn't aware of it either. Extra fun added when VBA most likely has IEE 754 floats rather than "[modified IEEE 754 of 1985]" floats.