Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > comp.soft-sys.math.mathematica > #16325
| From | Bob Hanlon <hanlonr357@gmail.com> |
|---|---|
| Newsgroups | comp.soft-sys.math.mathematica |
| Subject | Re: gives 919.8359999999999?` |
| Date | 2013-12-06 07:10 +0000 |
| Message-ID | <l7rt9s$o54$1@smc.vnet.net> (permalink) |
| References | <20131205080510.023806A20@smc.vnet.net> |
| Organization | Time-Warner Telecom |
This is expected when operating with machine precision and the decimal numbers do not have exact binary representations. 916.536+3.3//FullForm 919.8359999999999` 916.536+3.3//Rationalize//N//FullForm 919.836` 916.536+3.3//Rationalize[#,0]&//N//FullForm 919.836` Bob Hanlon On Thu, Dec 5, 2013 at 3:05 AM, Guillermo Sanchez < guillermo.sanchez@hotmail.com> wrote: > FullForm[916.536 + 3.3] gives 919.8359999999999 instead of 919.836? > > Guillermo > >
Back to comp.soft-sys.math.mathematica | Previous | Next | Find similar | Unroll thread
Re: gives 919.8359999999999?` Bob Hanlon <hanlonr357@gmail.com> - 2013-12-06 07:10 +0000
csiph-web