Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > comp.soft-sys.math.mathematica > #16325

Re: gives 919.8359999999999?`

From Bob Hanlon <hanlonr357@gmail.com>
Newsgroups comp.soft-sys.math.mathematica
Subject Re: gives 919.8359999999999?`
Date 2013-12-06 07:10 +0000
Message-ID <l7rt9s$o54$1@smc.vnet.net> (permalink)
References <20131205080510.023806A20@smc.vnet.net>
Organization Time-Warner Telecom

Show all headers | View raw


This is expected when operating with machine precision and the decimal
numbers do not have exact binary representations.

916.536+3.3//FullForm

919.8359999999999`

916.536+3.3//Rationalize//N//FullForm

919.836`

916.536+3.3//Rationalize[#,0]&//N//FullForm

919.836`


Bob Hanlon



On Thu, Dec 5, 2013 at 3:05 AM, Guillermo Sanchez <
guillermo.sanchez@hotmail.com> wrote:

> FullForm[916.536 + 3.3] gives 919.8359999999999 instead of 919.836?
>
> Guillermo
>
>

Back to comp.soft-sys.math.mathematica | Previous | Next | Find similar | Unroll thread


Thread

Re: gives 919.8359999999999?` Bob Hanlon <hanlonr357@gmail.com> - 2013-12-06 07:10 +0000

csiph-web