Searched refs:precision (Results 1 - 19 of 19) sorted by relevance

/barrelfish-master/lib/compiler-rt/builtins/
H A Dfp_trunc.h1 //=== lib/fp_trunc.h - high precision -> low precision conversion *- C -*-===//
9 // Set source and destination precision setting
37 #error Source should be double precision or quad precision!
38 #endif // end source precision
59 #error Destination should be single precision or double precision!
60 #endif // end destination precision
H A Dfp_extend.h1 //===-lib/fp_extend.h - low precision -> high precision conversion -*- C
50 #error Source should be half, single, or double precision!
51 #endif // end source precision
72 #error Destination should be single, double, or quad precision!
73 #endif // end destination precision
/barrelfish-master/usr/eclipseclp/ecrc_solvers/chr/
H A Dmath-utilities.pl10 % for use in is/2: precision, slack variables, simulated infimum, etc.
15 % adapt precision for zero/1 test
17 (G==single -> setval(precision,1e-06),setval(mprecision,-1e-06)
19 G==double -> setval(precision,1e-12),setval(mprecision,-1e-12)
98 getval(precision,P), % otherwise call-kernel does not work
/barrelfish-master/lib/openssl-1.0.0d/crypto/ts/
H A Dts_rsp_sign.c132 /* Use the time function call that provides only seconds precision. */
145 /* Return time to caller, only second precision. */
409 int TS_RESP_CTX_set_clock_precision_digits(TS_RESP_CTX *ctx, unsigned precision) argument
411 if (precision > TS_MAX_CLOCK_PRECISION_DIGITS)
413 ctx->clock_precision_digits = precision;
951 long sec, long usec, unsigned precision)
959 if (precision > TS_MAX_CLOCK_PRECISION_DIGITS)
977 if (precision > 0)
980 BIO_snprintf(p, 2 + precision, ".%ld", usec);
950 TS_RESP_set_genTime_with_precision(ASN1_GENERALIZEDTIME *asn1_time, long sec, long usec, unsigned precision) argument
/barrelfish-master/lib/tommath/
H A Dtommath.tex129 great deal of work in which multiple precision mathematics was needed. Understanding the possibilities for speeding up
130 multiple precision calculations is often very important since we deal with outdated machine architecture where modular
170 raise or lower the precision of the numbers we are dealing with. For example, in decimal we almost immediate can
171 reason that $7$ times $6$ is $42$. However, $42$ has two digits of precision as opposed to one digit we started with.
172 Further multiplications of say $3$ result in a larger precision result $126$. In these few examples we have multiple
173 precisions for the numbers we are working with. Despite the various levels of precision a single subset\footnote{With the occasional optimization.}
176 By way of comparison a fixed or single precision operation would lose precision on various operations. For example, in
177 the decimal system with fixed precision $6 \cdot 7 = 2$.
179 Essentially at the heart of computer based multiple precision arithmeti
[all...]
H A Dbn.tex248 source code is also accessible for computer science students attempting to learn ``BigNum'' or multiple precision
334 The basic ``multiple precision integer'' type is known as the ``mp\_int'' within LibTomMath. This data type is used to
1233 considerably less work. For example, a 10000-digit multiplication would take roughly 724,000 single precision
1234 multiplications with Toom-Cook or 100,000,000 single precision multiplications with the standard Comba (a factor
/barrelfish-master/usr/eclipseclp/documents/libman/
H A Dic.tex79 manipulated become large enough that they approach the precision
80 limit of a double precision floating point number ($2^{51}$ or so).
81 Beyond this, lack of precision may mean that the solver cannot be
84 domain solver. Note however that this precision limit is way beyond
154 is that it is only approximate. Finite precision means a floating point
943 Note that a higher threshold speeds up computations, but reduces precision
958 this predicate (requiring a higher level of precision), the current state of
960 is important that the new level of precision be realised for all or part of
1040 minimum required precision, i.e.\ the maximum size of the resulting
1044 of magnitude smaller than {\em precision}, otherwis
[all...]
H A Dintroduction.tex168 The second {\em clpqr} can support infinite precision, but is less
/barrelfish-master/usr/eclipseclp/documents/tutorial/
H A Dreal.tex35 floating point numbers, which have a finite precision. This approximation
75 because of the limited precision with which is has been calculated
354 until they are narrower than a specified precision (in either absolute or
/barrelfish-master/usr/eclipseclp/documents/embedding/
H A Dumscmacros.tex152 {\tt IsFloat(tag)} & single precision float number. \\
154 {\tt IsDouble(tag)} & double precision float number. \\
467 precision Prolog float, return a C double.\\
H A Ddbi.tex220 to the database's C API at the maximum precision and size supported by
/barrelfish-master/usr/eclipseclp/documents/internal/kernel/
H A Dumscmacros.tex166 {\tt IsFloat(tag)} & single precision float number. \\
168 {\tt IsDouble(tag)} & double precision float number. \\
477 precision Prolog float, return a C double.\\
H A Dio.tex210 the required precision, and the required digits on both sides of
H A Druntime.tex38 Bignum and rational arithmetic are implemented using the GMP\index{GMP} multi-precision
H A Dkernel.tex236 multi-precision, www.swox.com/gmp) library. Gmp's limb array is stored
/barrelfish-master/usr/eclipseclp/documents/userman/
H A Dumsarith.tex167 {\eclipse} uses double precision floats\footnote{%
168 {\eclipse} versions older than 5.5 optionally supported single precision
232 Beware of the potential loss of precision in the
H A Dumsopsys.tex336 arbitrary-precision arithmetic language) to a {\eclipse} process.
H A Dumsparallel.tex176 On hardware that provides a high-precision low-overhead timer,
/barrelfish-master/usr/eclipseclp/Kernel/lib/
H A Dbranch_and_bound.pl322 NewTo < To % can only be violated if precision problems
518 % case of precision/rounding problems. It then prevents looping.

Completed in 94 milliseconds