Ruud H.G. van Tol on Fri, 23 Feb 2024 14:04:45 +0100


[Date Prev] [Date Next] [Thread Prev] [Thread Next] [Date Index] [Thread Index]

Re: bnfisintnorm() is eager for memory



On 2024-02-23 13:58, Max Alekseyev wrote:

What if I look for solutions where at least one of the coefficients is below 10^16 by absolute value?

Is that related to "binary64"?

Whenever I read 10^16, I think 53 bits ...

https://en.wikipedia.org/wiki/Double-precision_floating-point_format
https://en.wikipedia.org/wiki/IEEE_754

-- Ruud