User Tools

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revisionBoth sides next revision
code:numberformats [2017/12/09 17:34] – [BYTE] Igor Yefmovcode:numberformats [2017/12/09 18:18] – [UFIX 8.8] Igor Yefmov
Line 21: Line 21:
   * ''0.0'' = ''0x00'', ''0x00''   * ''0.0'' = ''0x00'', ''0x00''
   * ''1.0'' = ''0x01'', ''0x00''   * ''1.0'' = ''0x01'', ''0x00''
-  * ''1.5'' = ''0x01'', ''0xF0''+  * ''1.5'' = ''0x01'', ''0x80''
   * ''127.3'' = ''0x7F'', ''0x4D'' - notice how the actual precise decimal number ''127 + 77/256'' is not **exactly** ''127.3'' but is an approximation with a precise decimal value of ''127.30078125''   * ''127.3'' = ''0x7F'', ''0x4D'' - notice how the actual precise decimal number ''127 + 77/256'' is not **exactly** ''127.3'' but is an approximation with a precise decimal value of ''127.30078125''
   * ''-1'' - unrepresentable   * ''-1'' - unrepresentable
   * ''256'' = ''0xFF'', ''0xFF'' - once again, the actual decimal number is "very close" and is in fact ''255.99609375''   * ''256'' = ''0xFF'', ''0xFF'' - once again, the actual decimal number is "very close" and is in fact ''255.99609375''

This website uses cookies. By using the website, you agree with storing cookies on your computer. Also, you acknowledge that you have read and understand our Privacy Policy. If you do not agree, please leave the website.

More information