All Questions
Tagged with floating-point number-theory
3 questions
0
votes
0
answers
29
views
Exact computation with fractional powers as integer bounds
Context: I am implementing the prime-counting function $\pi(x)$ with the Meissel-Lehmer algorithm, extended by Lagarias, Miller, and Odlyzko. The notation comes from an overview by Oliveira e Silva. $\...
- 628
1
vote
0
answers
50
views
What are the most number of bits ever used in arbitrary/multiple precision floating point arithmetic?
I've been exploring the evolution of floating-point arithmetic formats from single to octuple precision. Here's what I THINK I have learned about the key specifications and capabilities for each ...
- 111
1
vote
2
answers
1k
views
Half precision floating point question -- smallest non-zero number
There's a floating point question that popped up and I'm confused about the solution. It states that
IEEE 754-2008 introduces half precision, which is a binary
floating-point representation that uses ...
- 13