Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.lang.python > #70766

Re: Bug in Decimal??

Path csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!eu.feeder.erje.net!news.swapon.de!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From Gregory Ewing <greg.ewing@canterbury.ac.nz>
Newsgroups comp.lang.python
Subject Re: Bug in Decimal??
Date Wed, 30 Apr 2014 19:59:46 +1200
Lines 13
Message-ID <bsborkFdqjjU1@mid.individual.net> (permalink)
References <973d2677-03c6-464a-8c88-f07282806468@googlegroups.com>
Mime-Version 1.0
Content-Type text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding 7bit
X-Trace individual.net G9OV5XndrTt2gT7o3Q7qZA6yRT1HYmDQsDWgbQz5K1iTV1bkQq
Cancel-Lock sha1:YXVLyVSsaTtYhjRsXYVPkKBuRDU=
User-Agent Mozilla Thunderbird 1.0.5 (Macintosh/20050711)
X-Accept-Language en-us, en
In-Reply-To <973d2677-03c6-464a-8c88-f07282806468@googlegroups.com>
Xref csiph.com comp.lang.python:70766

Show key headers only | View raw

pleasedontspam@isp.com wrote:
> I compared the results with wolfram Alpha, and
> also with an open source arbitrary precision calculator, which matches Alpha
> results.

Decimal is *not* an arbitrary precision data type, so you
can't expect exact results from it. You can set the precision
to be very large, but it's still essentially a floating point
type, and as such you can expect the last few digits to
depend heavily on the details of the algorithm used.

-- 
Greg

Back to comp.lang.python | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

Bug in Decimal?? pleasedontspam@isp.com - 2014-04-29 19:37 -0700
  Re: Bug in Decimal?? Steven D'Aprano <steve+comp.lang.python@pearwood.info> - 2014-04-30 03:39 +0000
    Re: Bug in Decimal?? pleasedontspam@isp.com - 2014-04-30 05:01 -0700
    Re: Bug in Decimal?? pleasedontspam@isp.com - 2014-04-30 05:13 -0700
  Re: Bug in Decimal?? Gregory Ewing <greg.ewing@canterbury.ac.nz> - 2014-04-30 19:59 +1200
  Re: Bug in Decimal?? Mark Dickinson <mdickinson@enthought.com> - 2014-05-04 10:53 +0000
    Re: Bug in Decimal?? pleasedontspam@isp.com - 2014-05-15 13:45 -0700
      Re: Bug in Decimal?? Mark H Harris <harrismh777@gmail.com> - 2014-05-15 16:26 -0500
      Re: Bug in Decimal?? Mark Dickinson <mdickinson@enthought.com> - 2014-05-19 16:10 +0000

csiph-web